Jul 28 01:23:56.907061 ip-10-0-135-95 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 28 01:23:56.907075 ip-10-0-135-95 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 28 01:23:56.907084 ip-10-0-135-95 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 28 01:23:56.907394 ip-10-0-135-95 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 28 01:24:06.947267 ip-10-0-135-95 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 28 01:24:06.947288 ip-10-0-135-95 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7d3b0a129a5744d5ae5eb9d22cd3e71e --
Jul 28 01:26:06.865822 ip-10-0-135-95 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 01:26:07.268079 ip-10-0-135-95 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 01:26:07.268079 ip-10-0-135-95 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 01:26:07.268079 ip-10-0-135-95 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 01:26:07.268079 ip-10-0-135-95 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 01:26:07.268079 ip-10-0-135-95 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 01:26:07.269658 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.269536    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 01:26:07.275883 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275868    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:26:07.275883 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275884    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275889    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275892    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275895    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275898    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275901    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275903    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275907    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275910    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275912    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275915    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275917    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275920    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275922    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275925    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275927    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275930    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275933    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275935    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275938    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:26:07.275952 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275940    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275943    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275945    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275949    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275954    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275957    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275959    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275962    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275965    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275968    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275970    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275973    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275976    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275979    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275981    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275984    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275986    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275989    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275991    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275994    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:26:07.276428 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275996    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.275999    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276001    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276004    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276006    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276008    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276011    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276013    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276016    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276018    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276021    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276023    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276025    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276028    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276031    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276035    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276037    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276040    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276044    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:26:07.276938 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276047    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276051    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276054    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276056    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276059    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276061    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276064    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276066    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276069    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276071    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276074    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276077    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276079    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276081    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276084    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276087    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276089    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276091    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276094    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276096    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:26:07.277396 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276099    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276101    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276104    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276106    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276109    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276111    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276115    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276118    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276121    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276123    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276126    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276129    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276131    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276134    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276136    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276139    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276141    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276144    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276147    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276867    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:26:07.277914 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276875    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276878    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276881    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276884    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276887    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276890    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276892    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276896    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276900    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276903    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276905    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276908    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276910    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276913    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276915    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276917    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276920    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276922    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276925    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:26:07.278385 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276928    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276931    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276935    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276939    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276942    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276945    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276948    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276950    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276953    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276956    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276959    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276962    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276964    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276967    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276970    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276973    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276975    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276977    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276981    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:26:07.278864 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276983    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276986    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276988    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276991    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276993    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276996    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.276999    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277001    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277003    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277006    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277009    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277011    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277015    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277017    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277021    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277024    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277026    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277029    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277031    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277034    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:26:07.279399 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277036    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277039    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277041    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277044    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277047    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277049    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277051    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277054    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277056    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277059    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277061    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277064    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277067    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277069    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277072    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277075    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277078    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277080    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277082    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277085    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:26:07.279896 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277087    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277090    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277092    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277095    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277098    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277100    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277104    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277107    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277110    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277112    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277115    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277118    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277121    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277123    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277126    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277129    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277132    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277134    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277137    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:26:07.280375 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277139    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277492    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277497    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277500    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277502    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277505    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277508    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277510    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277513    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277516    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277519    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277522    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277524    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277527    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277529    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277532    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277535    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277537    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277540    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277565    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:26:07.280855 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277568    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277571    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277573    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277576    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277578    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277581    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277584    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277586    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277588    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277591    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277594    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277596    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277599    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277601    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277604    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277606    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277609    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277611    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277614    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277616    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:26:07.281328 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277619    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277622    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277624    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277627    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277630    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277632    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277635    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277637    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277640    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277642    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277645    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277647    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277650    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277653    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277655    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277658    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277661    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277663    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277665    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277668    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:26:07.281821 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277670    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:26:07.282299 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277673    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:26:07.282299 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277675    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:26:07.282299 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277678    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:26:07.282299 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277682    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:26:07.282299 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277685    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:26:07.282299 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277688    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:26:07.282299 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277690    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:26:07.282299 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277692    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:26:07.282299 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277695    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:26:07.282299 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277697    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:26:07.282299 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277701    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:26:07.282299 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277703    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:26:07.282299 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277708    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:26:07.282299 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277711    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:26:07.282299 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277715    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:26:07.282299 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277719    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:26:07.282299 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277724    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:26:07.282299 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277728    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277731    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277734    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277751    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277755    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277758    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277761    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277764    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277766    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277769    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277771    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277774    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277776    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277779    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277782    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277784    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277786    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277789    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277791    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:26:07.282792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277793    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277796    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.277798    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277861    2558 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277867    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277873    2558 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277877    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277881    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277886    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277890    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277895    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277898    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277901    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277904    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277907    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277910    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277913    2558 flags.go:64] FLAG: --cgroup-root=""
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277916    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277919    2558 flags.go:64] FLAG: --client-ca-file=""
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277922    2558 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277925    2558 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277929    2558 flags.go:64] FLAG: --cluster-domain=""
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277931    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 01:26:07.283239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277934    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277937    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277941    2558 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277944    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277947    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277949    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277952    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277955    2558 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277958    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277961    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277964    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277967    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277970    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277973    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277976    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277979    2558 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277982    2558 flags.go:64] FLAG: --enable-server="true"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277989    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277993    2558 flags.go:64] FLAG: --event-burst="100"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.277998    2558 flags.go:64] FLAG: --event-qps="50"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278000    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278003    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278006    2558 flags.go:64] FLAG: --eviction-hard=""
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278009    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 01:26:07.283799 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278012    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278015    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278017    2558 flags.go:64] FLAG: --eviction-soft=""
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278020    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278023    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278026    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278028    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278031    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278034    2558 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278036    2558 flags.go:64] FLAG: --feature-gates=""
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278040    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278043    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278046    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278049    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278052    2558 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278055    2558 flags.go:64] FLAG: --help="false"
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278058    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-135-95.ec2.internal"
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278060    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278063    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278066    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278069    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278072    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278075    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 01:26:07.284409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278078    2558 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278080    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278084    2558 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278088    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278092    2558 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278095    2558 flags.go:64] FLAG: --kube-reserved=""
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278097    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278100    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278103    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278105    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278108    2558 flags.go:64] FLAG: --lock-file=""
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278111    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278114    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278116    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278121    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278124    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278127    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278129    2558 flags.go:64] FLAG: --logging-format="text"
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278132    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278136    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278138    2558 flags.go:64] FLAG: --manifest-url=""
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278141    2558 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278145    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278148    2558 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278152    2558 flags.go:64] FLAG: --max-pods="110"
Jul 28 01:26:07.285021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278154    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278157    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278160    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278163    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278166    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278168    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278171    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278177    2558 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278180    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278185    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278188    2558 flags.go:64] FLAG: --pod-cidr=""
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278192    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278197    2558 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278200    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278203    2558 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278205    2558 flags.go:64] FLAG: --port="10250"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278208    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278211    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03d7465113565d21a"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278214    2558 flags.go:64] FLAG: --qos-reserved=""
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278217    2558 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278220    2558 flags.go:64] FLAG: --register-node="true"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278223    2558 flags.go:64] FLAG: --register-with-taints=""
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278226    2558 flags.go:64] FLAG: --registry-burst="10"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278229    2558 flags.go:64] FLAG: --registry-qps="5"
Jul 28 01:26:07.285645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278231    2558 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278234    2558 flags.go:64] FLAG: --reserved-memory=""
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278237    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278240    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278243    2558 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278245    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278248    2558 flags.go:64] FLAG: --runonce="false"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278251    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278254    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278257    2558 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278259    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278262    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278265    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278268    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278271    2558 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278273    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278276    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278280    2558 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278282    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278285    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278289    2558 flags.go:64] FLAG: --system-cgroups=""
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278292    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278297    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278300    2558 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278303    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 01:26:07.286270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278306    2558 flags.go:64] FLAG: --tls-min-version=""
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278309    2558 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278311    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278314    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278317    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278319    2558 flags.go:64] FLAG: --v="2"
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278323    2558 flags.go:64] FLAG: --version="false"
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278327    2558 flags.go:64] FLAG: --vmodule=""
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278330    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.278333    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278438    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278442    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278445    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278447    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278450    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278452    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278455    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278458    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278460    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278463    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278465    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278468    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:26:07.286915 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278470    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278473    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278476    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278478    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278481    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278485    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278488    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278490    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278493    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278495    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278497    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278500    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278503    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278505    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278507    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278510    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278512    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278515    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278517    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:26:07.287560 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278521    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278525    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278527    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278530    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278533    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278535    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278538    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278540    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278556    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278559    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278562    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278564    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278567    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278569    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278572    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278575    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278577    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278580    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278583    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:26:07.288313 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278586    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278589    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278592    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278594    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278597    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278599    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278602    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278604    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278607    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278609    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278612    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278614    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278617    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278619    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278622    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278624    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278627    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278629    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278632    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278635    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:26:07.288839 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278637    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278639    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278642    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278644    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278648    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278651    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278654    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278657    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278659    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278662    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278665    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278670    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278673    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278676    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278679    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278681    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278684    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278686    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278689    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:26:07.289331 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278691    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:26:07.289840 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278694    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:26:07.289840 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278697    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:26:07.289840 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278699    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:26:07.289840 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278702    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:26:07.289840 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278704    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:26:07.289840 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278707    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:26:07.289840 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278709    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:26:07.289840 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278711    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:26:07.289840 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.278714    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:26:07.289840 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.279111    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 01:26:07.289840 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.285650    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 01:26:07.289840 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.285668    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 01:26:07.289840 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.285683    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 01:26:07.289840 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.285689    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285753    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285758    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285761    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285765    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285767    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285770    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285774    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285777    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285780    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285782    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285786    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285790    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285793    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285796    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285800    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285803    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285806    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285808    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:26:07.290338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285811    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285814    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285816    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285819    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285821    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285823    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285826    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285828    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285831    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285833    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285836    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285839    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285842    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285845    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285847    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285850    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285852    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285855    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285857    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285860    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:26:07.290961 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285862    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285865    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285867    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285869    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285872    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285874    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285877    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285879    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285882    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285884    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285887    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285890    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285892    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285896    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285899    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285902    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285905    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285908    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285910    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:26:07.291445 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285914    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285916    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285919    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285922    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285925    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285928    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285930    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285933    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285936    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285938    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285942    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285945    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285948    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285950    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285953    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285955    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285958    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285960    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285963    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:26:07.291936 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285965    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285967    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285970    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285973    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285975    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285978    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285980    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285983    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285985    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285987    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285990    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285992    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285995    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.285998    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286000    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286003    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286005    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286007    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286010    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286013    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286015    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:26:07.292392 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286018    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:26:07.292911 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286021    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:26:07.292911 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.286025    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 01:26:07.292911 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286133    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:26:07.292911 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286137    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:26:07.292911 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286140    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:26:07.292911 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286143    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:26:07.292911 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286145    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:26:07.292911 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286148    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:26:07.292911 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286150    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:26:07.292911 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286153    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:26:07.292911 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286155    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:26:07.292911 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286158    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:26:07.292911 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286160    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:26:07.292911 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286164    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:26:07.292911 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286168    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286171    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286173    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286175    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286178    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286180    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286183    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286185    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286187    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286191    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286194    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286198    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286201    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286204    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286206    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286209    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286212    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286215    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286218    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:26:07.293265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286221    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286223    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286226    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286229    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286231    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286234    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286236    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286239    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286241    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286244    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286246    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286249    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286251    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286254    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286256    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286259    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286261    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286263    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286266    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286269    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:26:07.293729 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286271    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286274    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286277    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286279    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286282    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286284    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286287    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286289    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286292    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286294    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286297    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286300    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286302    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286304    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286307    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286309    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286312    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286314    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286316    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286319    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:26:07.294205 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286321    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286323    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286326    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286328    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286331    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286333    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286335    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286338    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286340    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286343    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286345    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286348    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286350    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286353    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286355    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286357    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286360    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286362    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286365    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286368    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:26:07.294764 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286370    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:26:07.295260 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286372    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:26:07.295260 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286375    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:26:07.295260 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286377    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:26:07.295260 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286380    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:26:07.295260 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286382    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:26:07.295260 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286385    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:26:07.295260 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:07.286387    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:26:07.295260 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.286392    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 01:26:07.295260 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.286490    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 01:26:07.295260 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.291396    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 01:26:07.295260 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.292613    2558 server.go:1019] "Starting client certificate rotation"
Jul 28 01:26:07.295260 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.292706    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 01:26:07.295260 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.292735    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 01:26:07.295260 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.294861    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 01:26:07.298719 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.298705    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 01:26:07.307579 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.307527    2558 log.go:25] "Validated CRI v1 runtime API"
Jul 28 01:26:07.309530 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.309515    2558 log.go:25] "Validated CRI v1 image API"
Jul 28 01:26:07.310399 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.310371    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 01:26:07.315865 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.315841    2558 fs.go:135] Filesystem UUIDs: map[215c4512-4a4e-483a-a03b-66835c67f6e6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7add5d8a-1290-47a7-9aef-b06ed962170e:/dev/nvme0n1p3]
Jul 28 01:26:07.315940 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.315864    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 01:26:07.321473 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.321355    2558 manager.go:216] Machine: {Timestamp:2026-07-28 01:26:07.319991672 +0000 UTC m=+0.336690306 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106494 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e1f63c7aa2618ebe21d19bd8ad6ba SystemUUID:ec2e1f63-c7aa-2618-ebe2-1d19bd8ad6ba BootID:7d3b0a12-9a57-44d5-ae5e-b9d22cd3e71e Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:62:83:55:0f:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:62:83:55:0f:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:03:eb:3a:7b:6c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 01:26:07.321473 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.321466    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 01:26:07.321625 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.321537    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 01:26:07.324232 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.324202    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 01:26:07.324362 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.324232    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-95.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 01:26:07.324980 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.324971    2558 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 01:26:07.325018 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.324982    2558 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 01:26:07.325018 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.324990    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 01:26:07.325240 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.325225    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 01:26:07.325598 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.325588    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 01:26:07.326297 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.326288    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 01:26:07.327902 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.327891    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 01:26:07.328008 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.327998    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 01:26:07.328042 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.328027    2558 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 01:26:07.328042 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.328036    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 01:26:07.328095 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.328051    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 01:26:07.328095 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.328061    2558 kubelet.go:398] "Adding apiserver pod source"
Jul 28 01:26:07.328095 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.328071    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 01:26:07.328494 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.328480    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 01:26:07.328566 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.328515    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 01:26:07.332719 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.331010    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 01:26:07.335710 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.335694    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 01:26:07.335785 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.335725    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 01:26:07.337183 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.337171    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 01:26:07.337217 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.337188    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 01:26:07.337217 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.337194    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 01:26:07.337217 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.337199    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 01:26:07.337217 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.337212    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 01:26:07.337322 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.337222    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 01:26:07.337322 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.337231    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 01:26:07.337322 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.337236    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 01:26:07.337322 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.337243    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 01:26:07.337322 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.337248    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 01:26:07.337322 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.337256    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 01:26:07.337322 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.337262    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 01:26:07.337322 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.337286    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 01:26:07.337322 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.337304    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 01:26:07.340351 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.340338    2558 server.go:1268] "Started kubelet"
Jul 28 01:26:07.340530 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.340447    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 01:26:07.340627 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.340519    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 01:26:07.340627 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.340590    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 01:26:07.341236 ip-10-0-135-95 systemd[1]: Started Kubernetes Kubelet.
Jul 28 01:26:07.342240 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.342155    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 01:26:07.342807 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.342791    2558 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 01:26:07.343090 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.343073    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-95.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 01:26:07.343175 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.343117    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 01:26:07.343175 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.343144    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 01:26:07.344563 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.344531    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 01:26:07.346435 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.345621    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-95.ec2.internal.18c64fbb1ba5da50  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-95.ec2.internal,UID:ip-10-0-135-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-95.ec2.internal,},FirstTimestamp:2026-07-28 01:26:07.340313168 +0000 UTC m=+0.357011802,LastTimestamp:2026-07-28 01:26:07.340313168 +0000 UTC m=+0.357011802,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-95.ec2.internal,}"
Jul 28 01:26:07.348005 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.347989    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 01:26:07.348083 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.348039    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 01:26:07.348133 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.348108    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found"
Jul 28 01:26:07.349712 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.349046    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 01:26:07.349835 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.349813    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 01:26:07.349835 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.349837    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 01:26:07.350279 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.350128    2558 factory.go:153] Registering CRI-O factory
Jul 28 01:26:07.350279 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.350145    2558 factory.go:223] Registration of the crio container factory successfully
Jul 28 01:26:07.350279 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.350194    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 01:26:07.350279 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.350204    2558 factory.go:55] Registering systemd factory
Jul 28 01:26:07.350279 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.350211    2558 factory.go:223] Registration of the systemd container factory successfully
Jul 28 01:26:07.350279 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.350230    2558 factory.go:103] Registering Raw factory
Jul 28 01:26:07.350279 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.350242    2558 manager.go:1196] Started watching for new ooms in manager
Jul 28 01:26:07.350606 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.350300    2558 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 01:26:07.350606 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.350308    2558 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 01:26:07.350876 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.350863    2558 manager.go:349] Starting recovery of all containers
Jul 28 01:26:07.356194 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.356170    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2r6tj"
Jul 28 01:26:07.359816 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.359787    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 01:26:07.359917 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.359890    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 01:26:07.361381 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.361360    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2r6tj"
Jul 28 01:26:07.361687 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.361666    2558 manager.go:354] Recovery completed
Jul 28 01:26:07.364123 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.363995    2558 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": readdirent /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 28 01:26:07.367031 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.366938    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:26:07.368842 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.368825    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:26:07.368930 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.368852    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:26:07.368930 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.368862    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:26:07.369305 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.369282    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 01:26:07.369305 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.369294    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 01:26:07.369305 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.369308    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 01:26:07.369437 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.369342    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:26:07.370044 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.370029    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:26:07.370115 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.370056    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:26:07.370115 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.370067    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:26:07.370796 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.370783    2558 policy_none.go:49] "None policy: Start"
Jul 28 01:26:07.370849 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.370799    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 01:26:07.370849 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.370809    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 01:26:07.371921 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.371911    2558 policy_none.go:47] "Start"
Jul 28 01:26:07.406148 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.406131    2558 manager.go:337] "Starting Device Plugin manager"
Jul 28 01:26:07.406218 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.406157    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 01:26:07.406218 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.406166    2558 server.go:87] "Starting device plugin registration server"
Jul 28 01:26:07.406374 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.406361    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 01:26:07.406454 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.406377    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 01:26:07.406501 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.406478    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 01:26:07.406589 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.406574    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 01:26:07.406589 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.406587    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 01:26:07.407048 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.407029    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 01:26:07.407126 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.407081    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-95.ec2.internal\" not found"
Jul 28 01:26:07.506764 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.506748    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:26:07.507730 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.507585    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:26:07.507730 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.507617    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:26:07.507730 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.507634    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:26:07.507730 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.507669    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-95.ec2.internal"
Jul 28 01:26:07.515745 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.515731    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-95.ec2.internal"
Jul 28 01:26:07.515795 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.515752    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-95.ec2.internal\": node \"ip-10-0-135-95.ec2.internal\" not found"
Jul 28 01:26:07.538129 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.538081    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found"
Jul 28 01:26:07.543275 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.543254    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 01:26:07.544604 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.544588    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 01:26:07.544663 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.544653    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 01:26:07.544697 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.544678    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 01:26:07.544738 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.544712    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 01:26:07.547642 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.547623    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:26:07.639073 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.639054    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found"
Jul 28 01:26:07.645208 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.645191    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal"]
Jul 28 01:26:07.645254 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.645241    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:26:07.646129 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.646110    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:26:07.646243 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.646144    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:26:07.646243 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.646157    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:26:07.647458 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.647443    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:26:07.647610 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.647596    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal"
Jul 28 01:26:07.647671 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.647626    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:26:07.648145 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.648132    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:26:07.648195 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.648154    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:26:07.648195 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.648168    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:26:07.648288 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.648251    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:26:07.648288 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.648275    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:26:07.648380 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.648289    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:26:07.649195 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.649170    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal"
Jul 28 01:26:07.649278 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.649201    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:26:07.649890 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.649876    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:26:07.649968 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.649902    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:26:07.649968 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.649918    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:26:07.652623 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.652607    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c456831f14043ef3813c57eda43b448-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal\" (UID: \"8c456831f14043ef3813c57eda43b448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal"
Jul 28 01:26:07.652696 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.652634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c456831f14043ef3813c57eda43b448-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal\" (UID: \"8c456831f14043ef3813c57eda43b448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal"
Jul 28 01:26:07.652696 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.652653    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/89ce73b10fe517b9feb646e9ce269241-config\") pod \"kube-apiserver-proxy-ip-10-0-135-95.ec2.internal\" (UID: \"89ce73b10fe517b9feb646e9ce269241\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal"
Jul 28 01:26:07.686082 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.686063    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-95.ec2.internal\" not found" node="ip-10-0-135-95.ec2.internal"
Jul 28 01:26:07.690591 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.690576    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-95.ec2.internal\" not found" node="ip-10-0-135-95.ec2.internal"
Jul 28 01:26:07.739603 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.739584    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found"
Jul 28 01:26:07.753225 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.753202    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/89ce73b10fe517b9feb646e9ce269241-config\") pod \"kube-apiserver-proxy-ip-10-0-135-95.ec2.internal\" (UID: \"89ce73b10fe517b9feb646e9ce269241\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal"
Jul 28 01:26:07.753291 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.753231    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c456831f14043ef3813c57eda43b448-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal\" (UID: \"8c456831f14043ef3813c57eda43b448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal"
Jul 28 01:26:07.753291 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.753255    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c456831f14043ef3813c57eda43b448-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal\" (UID: \"8c456831f14043ef3813c57eda43b448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal"
Jul 28 01:26:07.753352 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.753290    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c456831f14043ef3813c57eda43b448-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal\" (UID: \"8c456831f14043ef3813c57eda43b448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal"
Jul 28 01:26:07.753352 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.753313    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c456831f14043ef3813c57eda43b448-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal\" (UID: \"8c456831f14043ef3813c57eda43b448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal"
Jul 28 01:26:07.753352 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.753290    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/89ce73b10fe517b9feb646e9ce269241-config\") pod \"kube-apiserver-proxy-ip-10-0-135-95.ec2.internal\" (UID: \"89ce73b10fe517b9feb646e9ce269241\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal"
Jul 28 01:26:07.839813 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.839758    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found"
Jul 28 01:26:07.940277 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:07.940259    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found"
Jul 28 01:26:07.988771 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.988739    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal"
Jul 28 01:26:07.993447 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:07.993429    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal"
Jul 28 01:26:08.040636 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:08.040608    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found"
Jul 28 01:26:08.141102 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:08.141039    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found"
Jul 28 01:26:08.241494 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:08.241467    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found"
Jul 28 01:26:08.256283 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:08.256265    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:26:08.292578 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:08.292539    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 01:26:08.292952 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:08.292675    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 01:26:08.292952 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:08.292715    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 01:26:08.341985 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:08.341965    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found"
Jul 28 01:26:08.366342 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:08.366308    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 01:21:07 +0000 UTC" deadline="2028-04-04 09:44:53.072469966 +0000 UTC"
Jul 28 01:26:08.366342 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:08.366339    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14792h18m44.706133788s"
Jul 28 01:26:08.442628 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:08.442576    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found"
Jul 28 01:26:08.543031 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:08.543003    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-95.ec2.internal\" not found"
Jul 28 01:26:08.623362 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:08.623337    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:26:08.648393 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:08.648371    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal"
Jul 28 01:26:08.659036 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:08.659012    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 01:26:08.659957 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:08.659940    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal"
Jul 28 01:26:08.671025 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:08.671004    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 01:26:08.671265 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:08.671242    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c456831f14043ef3813c57eda43b448.slice/crio-00c8b57609909a1adc5474cf967f2ddcd8941907b9b6feced9be20f440f8d9e6 WatchSource:0}: Error finding container 00c8b57609909a1adc5474cf967f2ddcd8941907b9b6feced9be20f440f8d9e6: Status 404 returned error can't find the container with id 00c8b57609909a1adc5474cf967f2ddcd8941907b9b6feced9be20f440f8d9e6
Jul 28 01:26:08.671687 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:08.671671    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ce73b10fe517b9feb646e9ce269241.slice/crio-1556c81881c7a79d6601aa73bfc6f8f58cccce7bedebe992d96776df02244b3e WatchSource:0}: Error finding container 1556c81881c7a79d6601aa73bfc6f8f58cccce7bedebe992d96776df02244b3e: Status 404 returned error can't find the container with id 1556c81881c7a79d6601aa73bfc6f8f58cccce7bedebe992d96776df02244b3e
Jul 28 01:26:08.677331 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:08.677312    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 01:26:08.806391 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:08.806335    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:26:09.283204 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.283125    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:26:09.329458 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.329430    2558 apiserver.go:52] "Watching apiserver"
Jul 28 01:26:09.348912 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.348886    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 01:26:09.349299 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.349278    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 01:26:09.349390 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.349372    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-mg49d","kube-system/konnectivity-agent-tlvdp","kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal","openshift-cluster-node-tuning-operator/tuned-fv88b","openshift-dns/node-resolver-j84km","openshift-image-registry/node-ca-9kp6b","openshift-multus/multus-additional-cni-plugins-cfrlp","openshift-network-operator/iptables-alerter-xkxr9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal","openshift-multus/multus-q7phb","openshift-multus/network-metrics-daemon-lmrxw","openshift-network-diagnostics/network-check-target-b262s","openshift-ovn-kubernetes/ovnkube-node-xftxq"]
Jul 28 01:26:09.351159 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.351125    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.352356 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.352331    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:09.352454 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:09.352402    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b262s" podUID="78f08e99-cb7b-4f45-9713-9afd7f2fad94"
Jul 28 01:26:09.353656 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.353482    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.354588 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.354225    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 01:26:09.354588 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.354283    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 01:26:09.354588 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.354448    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 01:26:09.354768 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.354646    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 01:26:09.354768 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.354661    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qg8n9\""
Jul 28 01:26:09.354916 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.354897    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 01:26:09.357183 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.357162    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 01:26:09.357373 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.357358    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 01:26:09.357594 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.357577    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qgtl7\""
Jul 28 01:26:09.357756 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.357740    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 01:26:09.357883 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.357868    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 01:26:09.358113 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.358094    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 01:26:09.358321 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.358295    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 01:26:09.362905 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.362386    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.363627 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.363609    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j84km"
Jul 28 01:26:09.364413 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.364390    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 01:26:09.364712 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.364692    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 01:26:09.364897 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.364863    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9kp6b"
Jul 28 01:26:09.365512 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.365493    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 01:26:09.365735 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.365720    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zbmt2\""
Jul 28 01:26:09.367601 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.367206    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 01:26:09.367601 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.367391    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 01:26:09.369678 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.368687    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 01:26:09.369678 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.368768    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 01:26:09.369678 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.368998    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.369678 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.369068    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 01:26:09.369678 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.369001    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gqnqs\""
Jul 28 01:26:09.369678 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.369475    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:09.369678 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:09.369524    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg49d" podUID="78c22c72-ea97-4178-a43b-b731dd3956b7"
Jul 28 01:26:09.370111 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.369721    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tlvdp"
Jul 28 01:26:09.370111 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.369819    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gmbq2\""
Jul 28 01:26:09.371162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.370780    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xkxr9"
Jul 28 01:26:09.371842 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.371818    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 01:26:09.371842 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.371837    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v85qb\""
Jul 28 01:26:09.372173 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.372154    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 01:26:09.372173 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.372164    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 01:26:09.372696 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.372677    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 01:26:09.372786 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.372775    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gw7ts\""
Jul 28 01:26:09.372894 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.372876    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 01:26:09.373094 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.373063    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 01:26:09.373301 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.373285    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5t7gd\""
Jul 28 01:26:09.373378 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.373349    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 01:26:09.373800 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.373658    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 01:26:09.375162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.374911    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.378687 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.377161    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 01:26:09.378687 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.378053    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:09.378687 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:09.378150    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmrxw" podUID="b94d344e-9357-41ea-a7a7-36490cfe27bd"
Jul 28 01:26:09.380262 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.379876    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rvgf2\""
Jul 28 01:26:09.387913 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.387843    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xckq2"
Jul 28 01:26:09.394716 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.394700    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xckq2"
Jul 28 01:26:09.450690 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.450624    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 01:26:09.463698 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.463672    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-host-run-netns\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.463818 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.463707    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-hostroot\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.463818 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.463727    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2ead989-c1b2-42a6-9c17-e00a21d8d757-os-release\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.463818 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.463749    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-systemd\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.463818 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.463774    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q42bg\" (UniqueName: \"kubernetes.io/projected/5c4f5668-1f21-447d-8bab-dd8da04835d4-kube-api-access-q42bg\") pod \"iptables-alerter-xkxr9\" (UID: \"5c4f5668-1f21-447d-8bab-dd8da04835d4\") " pod="openshift-network-operator/iptables-alerter-xkxr9"
Jul 28 01:26:09.463818 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.463795    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-node-log\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.463818 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.463813    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-log-socket\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.464162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.463827    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-run-ovn-kubernetes\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.464162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.463843    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2ead989-c1b2-42a6-9c17-e00a21d8d757-cni-binary-copy\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.464162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.463859    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c4f5668-1f21-447d-8bab-dd8da04835d4-iptables-alerter-script\") pod \"iptables-alerter-xkxr9\" (UID: \"5c4f5668-1f21-447d-8bab-dd8da04835d4\") " pod="openshift-network-operator/iptables-alerter-xkxr9"
Jul 28 01:26:09.464162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.463873    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkt9r\" (UniqueName: \"kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r\") pod \"network-check-target-b262s\" (UID: \"78f08e99-cb7b-4f45-9713-9afd7f2fad94\") " pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:09.464162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.463888    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-systemd-units\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.464162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.463911    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/489f9e99-b968-4ac5-b583-7a04541903c0-ovn-node-metrics-cert\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.464162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.463932    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-system-cni-dir\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.464162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.463952    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-sys\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.464162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.463966    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret\") pod \"global-pull-secret-syncer-mg49d\" (UID: \"78c22c72-ea97-4178-a43b-b731dd3956b7\") " pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:09.464162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.463980    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-slash\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.464162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.463996    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/20045825-79f7-46f4-917d-2846016a45b2-serviceca\") pod \"node-ca-9kp6b\" (UID: \"20045825-79f7-46f4-917d-2846016a45b2\") " pod="openshift-image-registry/node-ca-9kp6b"
Jul 28 01:26:09.464162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464012    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-host-var-lib-cni-bin\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.464162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464027    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2ead989-c1b2-42a6-9c17-e00a21d8d757-system-cni-dir\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.464162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464041    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-sysctl-conf\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.464162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464064    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zm7n\" (UniqueName: \"kubernetes.io/projected/4af086fc-42a0-4bc5-a391-d35f222d8606-kube-api-access-5zm7n\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.464162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464087    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a19469af-bf1b-44e7-9596-ad3566e692e2-agent-certs\") pod \"konnectivity-agent-tlvdp\" (UID: \"a19469af-bf1b-44e7-9596-ad3566e692e2\") " pod="kube-system/konnectivity-agent-tlvdp"
Jul 28 01:26:09.464898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.464898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464127    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ed638d60-247b-4576-af02-b563cae3703a-device-dir\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.464898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464140    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2ead989-c1b2-42a6-9c17-e00a21d8d757-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.464898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464157    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-tuned\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.464898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464171    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b19da232-9d4c-41fe-b81a-1a34a4166a6c-hosts-file\") pod \"node-resolver-j84km\" (UID: \"b19da232-9d4c-41fe-b81a-1a34a4166a6c\") " pod="openshift-dns/node-resolver-j84km"
Jul 28 01:26:09.464898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464186    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjdq5\" (UniqueName: \"kubernetes.io/projected/20045825-79f7-46f4-917d-2846016a45b2-kube-api-access-sjdq5\") pod \"node-ca-9kp6b\" (UID: \"20045825-79f7-46f4-917d-2846016a45b2\") " pod="openshift-image-registry/node-ca-9kp6b"
Jul 28 01:26:09.464898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464207    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-multus-cni-dir\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.464898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464241    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-etc-kubernetes\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.464898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464263    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs\") pod \"network-metrics-daemon-lmrxw\" (UID: \"b94d344e-9357-41ea-a7a7-36490cfe27bd\") " pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:09.464898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464295    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d2ead989-c1b2-42a6-9c17-e00a21d8d757-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.464898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464310    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-sysctl-d\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.464898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464329    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ed638d60-247b-4576-af02-b563cae3703a-registration-dir\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.464898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464345    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d2ead989-c1b2-42a6-9c17-e00a21d8d757-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.464898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464364    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-modprobe-d\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.464898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464392    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-kubernetes\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.464898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464432    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78c22c72-ea97-4178-a43b-b731dd3956b7-kubelet-config\") pod \"global-pull-secret-syncer-mg49d\" (UID: \"78c22c72-ea97-4178-a43b-b731dd3956b7\") " pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:09.465476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464455    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a19469af-bf1b-44e7-9596-ad3566e692e2-konnectivity-ca\") pod \"konnectivity-agent-tlvdp\" (UID: \"a19469af-bf1b-44e7-9596-ad3566e692e2\") " pod="kube-system/konnectivity-agent-tlvdp"
Jul 28 01:26:09.465476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464488    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-host-run-multus-certs\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.465476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464514    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-etc-openvswitch\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.465476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464538    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/489f9e99-b968-4ac5-b583-7a04541903c0-ovnkube-script-lib\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.465476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464578    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2ead989-c1b2-42a6-9c17-e00a21d8d757-cnibin\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.465476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464600    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4af086fc-42a0-4bc5-a391-d35f222d8606-tmp\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.465476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464626    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-run-ovn\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.465476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464649    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/489f9e99-b968-4ac5-b583-7a04541903c0-env-overrides\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.465476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464676    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhhmh\" (UniqueName: \"kubernetes.io/projected/b19da232-9d4c-41fe-b81a-1a34a4166a6c-kube-api-access-jhhmh\") pod \"node-resolver-j84km\" (UID: \"b19da232-9d4c-41fe-b81a-1a34a4166a6c\") " pod="openshift-dns/node-resolver-j84km"
Jul 28 01:26:09.465476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464700    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a264e673-0627-4b00-8de1-753170b00bee-cni-binary-copy\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.465476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464723    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-host-var-lib-kubelet\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.465476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464749    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6mdh\" (UniqueName: \"kubernetes.io/projected/489f9e99-b968-4ac5-b583-7a04541903c0-kube-api-access-q6mdh\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.465476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464774    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-multus-socket-dir-parent\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.465476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464798    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcnfc\" (UniqueName: \"kubernetes.io/projected/d2ead989-c1b2-42a6-9c17-e00a21d8d757-kube-api-access-bcnfc\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.465476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464821    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-lib-modules\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.465476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464849    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-run-systemd\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.466162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464875    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-var-lib-openvswitch\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.466162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464900    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-cni-bin\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.466162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464922    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-cni-netd\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.466162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464947    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-host-var-lib-cni-multus\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.466162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.464980    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-var-lib-kubelet\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.466162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465003    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-run-netns\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.466162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465021    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b19da232-9d4c-41fe-b81a-1a34a4166a6c-tmp-dir\") pod \"node-resolver-j84km\" (UID: \"b19da232-9d4c-41fe-b81a-1a34a4166a6c\") " pod="openshift-dns/node-resolver-j84km"
Jul 28 01:26:09.466162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465047    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdtj6\" (UniqueName: \"kubernetes.io/projected/a264e673-0627-4b00-8de1-753170b00bee-kube-api-access-cdtj6\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.466162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465073    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c4f5668-1f21-447d-8bab-dd8da04835d4-host-slash\") pod \"iptables-alerter-xkxr9\" (UID: \"5c4f5668-1f21-447d-8bab-dd8da04835d4\") " pod="openshift-network-operator/iptables-alerter-xkxr9"
Jul 28 01:26:09.466162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465101    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-kubelet\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.466162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465124    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ed638d60-247b-4576-af02-b563cae3703a-etc-selinux\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.466162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465150    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-cnibin\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.466162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465172    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-run\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.466162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465225    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78c22c72-ea97-4178-a43b-b731dd3956b7-dbus\") pod \"global-pull-secret-syncer-mg49d\" (UID: \"78c22c72-ea97-4178-a43b-b731dd3956b7\") " pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:09.466162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465244    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20045825-79f7-46f4-917d-2846016a45b2-host\") pod \"node-ca-9kp6b\" (UID: \"20045825-79f7-46f4-917d-2846016a45b2\") " pod="openshift-image-registry/node-ca-9kp6b"
Jul 28 01:26:09.466162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465268    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-multus-conf-dir\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.466162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465296    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d59h\" (UniqueName: \"kubernetes.io/projected/b94d344e-9357-41ea-a7a7-36490cfe27bd-kube-api-access-2d59h\") pod \"network-metrics-daemon-lmrxw\" (UID: \"b94d344e-9357-41ea-a7a7-36490cfe27bd\") " pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:09.466989 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465321    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-host\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.466989 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465347    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-run-openvswitch\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.466989 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465372    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/489f9e99-b968-4ac5-b583-7a04541903c0-ovnkube-config\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.466989 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465397    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpzt8\" (UniqueName: \"kubernetes.io/projected/ed638d60-247b-4576-af02-b563cae3703a-kube-api-access-rpzt8\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.466989 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-os-release\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.466989 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465446    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-host-run-k8s-cni-cncf-io\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.466989 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465470    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a264e673-0627-4b00-8de1-753170b00bee-multus-daemon-config\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.466989 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465495    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-sysconfig\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.466989 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465522    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ed638d60-247b-4576-af02-b563cae3703a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.466989 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465563    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ed638d60-247b-4576-af02-b563cae3703a-socket-dir\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.466989 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.465590    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ed638d60-247b-4576-af02-b563cae3703a-sys-fs\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.550935 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.550846    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal" event={"ID":"89ce73b10fe517b9feb646e9ce269241","Type":"ContainerStarted","Data":"1556c81881c7a79d6601aa73bfc6f8f58cccce7bedebe992d96776df02244b3e"}
Jul 28 01:26:09.555847 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.555401    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal" event={"ID":"8c456831f14043ef3813c57eda43b448","Type":"ContainerStarted","Data":"00c8b57609909a1adc5474cf967f2ddcd8941907b9b6feced9be20f440f8d9e6"}
Jul 28 01:26:09.566103 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.566075    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-sysctl-d\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.566207 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.566116    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ed638d60-247b-4576-af02-b563cae3703a-registration-dir\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.566207 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.566138    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d2ead989-c1b2-42a6-9c17-e00a21d8d757-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.566207 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.566164    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-modprobe-d\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.566207 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.566185    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-kubernetes\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.566207 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.566206    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78c22c72-ea97-4178-a43b-b731dd3956b7-kubelet-config\") pod \"global-pull-secret-syncer-mg49d\" (UID: \"78c22c72-ea97-4178-a43b-b731dd3956b7\") " pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:09.566508 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.566458    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ed638d60-247b-4576-af02-b563cae3703a-registration-dir\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.567744 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.567716    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-sysctl-d\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.567842 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.567761    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a19469af-bf1b-44e7-9596-ad3566e692e2-konnectivity-ca\") pod \"konnectivity-agent-tlvdp\" (UID: \"a19469af-bf1b-44e7-9596-ad3566e692e2\") " pod="kube-system/konnectivity-agent-tlvdp"
Jul 28 01:26:09.567842 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.567810    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-host-run-multus-certs\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.567967 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.567846    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-etc-openvswitch\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.567967 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.567894    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/489f9e99-b968-4ac5-b583-7a04541903c0-ovnkube-script-lib\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.567967 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.567922    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2ead989-c1b2-42a6-9c17-e00a21d8d757-cnibin\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.567967 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.567952    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4af086fc-42a0-4bc5-a391-d35f222d8606-tmp\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.568171 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.567982    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-run-ovn\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.568171 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568012    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/489f9e99-b968-4ac5-b583-7a04541903c0-env-overrides\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.568171 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568044    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhhmh\" (UniqueName: \"kubernetes.io/projected/b19da232-9d4c-41fe-b81a-1a34a4166a6c-kube-api-access-jhhmh\") pod \"node-resolver-j84km\" (UID: \"b19da232-9d4c-41fe-b81a-1a34a4166a6c\") " pod="openshift-dns/node-resolver-j84km"
Jul 28 01:26:09.568171 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568070    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a264e673-0627-4b00-8de1-753170b00bee-cni-binary-copy\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.568171 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568102    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-host-var-lib-kubelet\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.568171 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568136    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6mdh\" (UniqueName: \"kubernetes.io/projected/489f9e99-b968-4ac5-b583-7a04541903c0-kube-api-access-q6mdh\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.568171 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568169    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-multus-socket-dir-parent\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.568450 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568199    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcnfc\" (UniqueName: \"kubernetes.io/projected/d2ead989-c1b2-42a6-9c17-e00a21d8d757-kube-api-access-bcnfc\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.568450 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568231    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-lib-modules\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.568450 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568261    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-run-systemd\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.568450 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568292    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-var-lib-openvswitch\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.568450 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568324    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-cni-bin\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.568450 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568348    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-cni-netd\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.568450 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568379    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-host-var-lib-cni-multus\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.568450 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568410    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-var-lib-kubelet\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.568450 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568443    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-run-netns\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.568778 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568476    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b19da232-9d4c-41fe-b81a-1a34a4166a6c-tmp-dir\") pod \"node-resolver-j84km\" (UID: \"b19da232-9d4c-41fe-b81a-1a34a4166a6c\") " pod="openshift-dns/node-resolver-j84km"
Jul 28 01:26:09.568778 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568503    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdtj6\" (UniqueName: \"kubernetes.io/projected/a264e673-0627-4b00-8de1-753170b00bee-kube-api-access-cdtj6\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.568778 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568535    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c4f5668-1f21-447d-8bab-dd8da04835d4-host-slash\") pod \"iptables-alerter-xkxr9\" (UID: \"5c4f5668-1f21-447d-8bab-dd8da04835d4\") " pod="openshift-network-operator/iptables-alerter-xkxr9"
Jul 28 01:26:09.568778 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568587    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-kubelet\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.568778 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568620    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ed638d60-247b-4576-af02-b563cae3703a-etc-selinux\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.568778 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568656    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-cnibin\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.568778 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568686    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-run\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.568778 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78c22c72-ea97-4178-a43b-b731dd3956b7-dbus\") pod \"global-pull-secret-syncer-mg49d\" (UID: \"78c22c72-ea97-4178-a43b-b731dd3956b7\") " pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:09.568778 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568746    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20045825-79f7-46f4-917d-2846016a45b2-host\") pod \"node-ca-9kp6b\" (UID: \"20045825-79f7-46f4-917d-2846016a45b2\") " pod="openshift-image-registry/node-ca-9kp6b"
Jul 28 01:26:09.569060 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568778    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-multus-conf-dir\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.569060 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568807    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d59h\" (UniqueName: \"kubernetes.io/projected/b94d344e-9357-41ea-a7a7-36490cfe27bd-kube-api-access-2d59h\") pod \"network-metrics-daemon-lmrxw\" (UID: \"b94d344e-9357-41ea-a7a7-36490cfe27bd\") " pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:09.569060 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568837    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-host\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.569060 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568868    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-run-openvswitch\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.569060 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568899    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/489f9e99-b968-4ac5-b583-7a04541903c0-ovnkube-config\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.569060 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568957    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpzt8\" (UniqueName: \"kubernetes.io/projected/ed638d60-247b-4576-af02-b563cae3703a-kube-api-access-rpzt8\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.569060 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.568989    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-os-release\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.569060 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569023    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-host-run-k8s-cni-cncf-io\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.569060 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a264e673-0627-4b00-8de1-753170b00bee-multus-daemon-config\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.569389 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569088    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-sysconfig\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.569389 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569116    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ed638d60-247b-4576-af02-b563cae3703a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.569389 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569149    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ed638d60-247b-4576-af02-b563cae3703a-socket-dir\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.569389 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569182    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ed638d60-247b-4576-af02-b563cae3703a-sys-fs\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.569389 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569212    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-host-run-netns\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.569389 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569245    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-hostroot\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.569389 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569274    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2ead989-c1b2-42a6-9c17-e00a21d8d757-os-release\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.569389 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569305    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-systemd\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.569389 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569337    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q42bg\" (UniqueName: \"kubernetes.io/projected/5c4f5668-1f21-447d-8bab-dd8da04835d4-kube-api-access-q42bg\") pod \"iptables-alerter-xkxr9\" (UID: \"5c4f5668-1f21-447d-8bab-dd8da04835d4\") " pod="openshift-network-operator/iptables-alerter-xkxr9"
Jul 28 01:26:09.569389 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569367    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-node-log\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.569724 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569397    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-log-socket\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.569724 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569426    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-run-ovn-kubernetes\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.569724 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569458    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2ead989-c1b2-42a6-9c17-e00a21d8d757-cni-binary-copy\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.569724 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569490    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c4f5668-1f21-447d-8bab-dd8da04835d4-iptables-alerter-script\") pod \"iptables-alerter-xkxr9\" (UID: \"5c4f5668-1f21-447d-8bab-dd8da04835d4\") " pod="openshift-network-operator/iptables-alerter-xkxr9"
Jul 28 01:26:09.569724 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569525    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkt9r\" (UniqueName: \"kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r\") pod \"network-check-target-b262s\" (UID: \"78f08e99-cb7b-4f45-9713-9afd7f2fad94\") " pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:09.569724 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569575    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-systemd-units\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.569724 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569608    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/489f9e99-b968-4ac5-b583-7a04541903c0-ovn-node-metrics-cert\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.569724 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569638    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-system-cni-dir\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.569724 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569668    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-sys\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.569724 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569702    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret\") pod \"global-pull-secret-syncer-mg49d\" (UID: \"78c22c72-ea97-4178-a43b-b731dd3956b7\") " pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:09.570019 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569730    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-slash\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.570019 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569762    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/20045825-79f7-46f4-917d-2846016a45b2-serviceca\") pod \"node-ca-9kp6b\" (UID: \"20045825-79f7-46f4-917d-2846016a45b2\") " pod="openshift-image-registry/node-ca-9kp6b"
Jul 28 01:26:09.570019 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569794    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-host-var-lib-cni-bin\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.570019 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569828    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2ead989-c1b2-42a6-9c17-e00a21d8d757-system-cni-dir\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.570019 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569860    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-sysctl-conf\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.570019 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569888    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zm7n\" (UniqueName: \"kubernetes.io/projected/4af086fc-42a0-4bc5-a391-d35f222d8606-kube-api-access-5zm7n\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.570019 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569921    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a19469af-bf1b-44e7-9596-ad3566e692e2-agent-certs\") pod \"konnectivity-agent-tlvdp\" (UID: \"a19469af-bf1b-44e7-9596-ad3566e692e2\") " pod="kube-system/konnectivity-agent-tlvdp"
Jul 28 01:26:09.570019 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569955    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.570019 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.569989    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ed638d60-247b-4576-af02-b563cae3703a-device-dir\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.570019 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.570018    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2ead989-c1b2-42a6-9c17-e00a21d8d757-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.570323 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.570053    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-tuned\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.570323 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.570085    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b19da232-9d4c-41fe-b81a-1a34a4166a6c-hosts-file\") pod \"node-resolver-j84km\" (UID: \"b19da232-9d4c-41fe-b81a-1a34a4166a6c\") " pod="openshift-dns/node-resolver-j84km"
Jul 28 01:26:09.570323 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.570118    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjdq5\" (UniqueName: \"kubernetes.io/projected/20045825-79f7-46f4-917d-2846016a45b2-kube-api-access-sjdq5\") pod \"node-ca-9kp6b\" (UID: \"20045825-79f7-46f4-917d-2846016a45b2\") " pod="openshift-image-registry/node-ca-9kp6b"
Jul 28 01:26:09.570323 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.570150    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-multus-cni-dir\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.570323 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.570178    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-etc-kubernetes\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.570323 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.570211    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs\") pod \"network-metrics-daemon-lmrxw\" (UID: \"b94d344e-9357-41ea-a7a7-36490cfe27bd\") " pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:09.570323 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.570243    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d2ead989-c1b2-42a6-9c17-e00a21d8d757-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.570820 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.570799    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d2ead989-c1b2-42a6-9c17-e00a21d8d757-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.570912 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.570892    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-host-run-multus-certs\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.570975 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.570932    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-etc-openvswitch\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.571353 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.571336    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/489f9e99-b968-4ac5-b583-7a04541903c0-ovnkube-script-lib\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.571410 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.571400    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2ead989-c1b2-42a6-9c17-e00a21d8d757-cnibin\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.571636 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.571619    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 01:26:09.572121 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.572101    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-run-ovn\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.572501 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.572481    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/489f9e99-b968-4ac5-b583-7a04541903c0-env-overrides\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.573192 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.573170    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a264e673-0627-4b00-8de1-753170b00bee-cni-binary-copy\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.573298 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.573249    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-host-var-lib-kubelet\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.573424 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.573398    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-modprobe-d\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.573842 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.573826    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-kubernetes\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.578125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.575068    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4af086fc-42a0-4bc5-a391-d35f222d8606-tmp\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.578125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.575529    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d2ead989-c1b2-42a6-9c17-e00a21d8d757-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.578125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.575639    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-host-var-lib-cni-multus\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.578125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.575698    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-var-lib-kubelet\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.578125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.575739    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-run-netns\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.578125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.575989    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b19da232-9d4c-41fe-b81a-1a34a4166a6c-tmp-dir\") pod \"node-resolver-j84km\" (UID: \"b19da232-9d4c-41fe-b81a-1a34a4166a6c\") " pod="openshift-dns/node-resolver-j84km"
Jul 28 01:26:09.578125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.576071    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c4f5668-1f21-447d-8bab-dd8da04835d4-host-slash\") pod \"iptables-alerter-xkxr9\" (UID: \"5c4f5668-1f21-447d-8bab-dd8da04835d4\") " pod="openshift-network-operator/iptables-alerter-xkxr9"
Jul 28 01:26:09.578125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.576126    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-kubelet\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.578125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.576215    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ed638d60-247b-4576-af02-b563cae3703a-etc-selinux\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.578125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.576235    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-cnibin\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.578125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.576311    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-multus-socket-dir-parent\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.578125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.576361    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20045825-79f7-46f4-917d-2846016a45b2-host\") pod \"node-ca-9kp6b\" (UID: \"20045825-79f7-46f4-917d-2846016a45b2\") " pod="openshift-image-registry/node-ca-9kp6b"
Jul 28 01:26:09.578125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.576373    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78c22c72-ea97-4178-a43b-b731dd3956b7-dbus\") pod \"global-pull-secret-syncer-mg49d\" (UID: \"78c22c72-ea97-4178-a43b-b731dd3956b7\") " pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:09.578125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.576588    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-lib-modules\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.578125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.576597    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-run-systemd\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.578125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.576666    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-var-lib-openvswitch\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.578125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.576665    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-run-openvswitch\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.578125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.576876    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-sysconfig\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.578950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.576947    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ed638d60-247b-4576-af02-b563cae3703a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.578950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.577060    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ed638d60-247b-4576-af02-b563cae3703a-socket-dir\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.578950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.577090    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/489f9e99-b968-4ac5-b583-7a04541903c0-ovnkube-config\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.578950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.577149    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-host\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.578950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.577191    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-run-ovn-kubernetes\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.578950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.577485    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-systemd-units\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.578950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.577622    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2ead989-c1b2-42a6-9c17-e00a21d8d757-cni-binary-copy\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.578950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.577653    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2ead989-c1b2-42a6-9c17-e00a21d8d757-os-release\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.578950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.577663    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-systemd\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.578950 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:09.577768    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:09.578950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.577786    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-slash\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.578950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.577848    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-host-var-lib-cni-bin\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.578950 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:09.577855    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret podName:78c22c72-ea97-4178-a43b-b731dd3956b7 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:10.077827163 +0000 UTC m=+3.094525807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret") pod "global-pull-secret-syncer-mg49d" (UID: "78c22c72-ea97-4178-a43b-b731dd3956b7") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:09.578950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.578175    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2ead989-c1b2-42a6-9c17-e00a21d8d757-system-cni-dir\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.578950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.578530    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/20045825-79f7-46f4-917d-2846016a45b2-serviceca\") pod \"node-ca-9kp6b\" (UID: \"20045825-79f7-46f4-917d-2846016a45b2\") " pod="openshift-image-registry/node-ca-9kp6b"
Jul 28 01:26:09.578950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.578627    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c4f5668-1f21-447d-8bab-dd8da04835d4-iptables-alerter-script\") pod \"iptables-alerter-xkxr9\" (UID: \"5c4f5668-1f21-447d-8bab-dd8da04835d4\") " pod="openshift-network-operator/iptables-alerter-xkxr9"
Jul 28 01:26:09.578950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.578696    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-sysctl-conf\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.579710 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.578710    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ed638d60-247b-4576-af02-b563cae3703a-device-dir\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.579710 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.578764    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.579710 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.578893    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2ead989-c1b2-42a6-9c17-e00a21d8d757-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.579710 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.579261    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-etc-kubernetes\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.579710 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.579339    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-multus-cni-dir\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.579710 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:09.579424    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:09.579710 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:09.579502    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs podName:b94d344e-9357-41ea-a7a7-36490cfe27bd nodeName:}" failed. No retries permitted until 2026-07-28 01:26:10.079483799 +0000 UTC m=+3.096182437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs") pod "network-metrics-daemon-lmrxw" (UID: "b94d344e-9357-41ea-a7a7-36490cfe27bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:09.579710 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.579531    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b19da232-9d4c-41fe-b81a-1a34a4166a6c-hosts-file\") pod \"node-resolver-j84km\" (UID: \"b19da232-9d4c-41fe-b81a-1a34a4166a6c\") " pod="openshift-dns/node-resolver-j84km"
Jul 28 01:26:09.579710 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.579633    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-run\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.579710 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.579685    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-multus-conf-dir\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.580129 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.579740    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-hostroot\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.580129 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.579799    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-system-cni-dir\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.580129 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.579846    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-node-log\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.580129 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.579916    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-host-run-k8s-cni-cncf-io\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.580129 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.579971    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78c22c72-ea97-4178-a43b-b731dd3956b7-kubelet-config\") pod \"global-pull-secret-syncer-mg49d\" (UID: \"78c22c72-ea97-4178-a43b-b731dd3956b7\") " pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:09.580129 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.580016    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-host-run-netns\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.580129 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.580077    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-cni-netd\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.580508 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.580475    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-host-cni-bin\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.580889 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.580580    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a264e673-0627-4b00-8de1-753170b00bee-os-release\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.580889 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.580631    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a264e673-0627-4b00-8de1-753170b00bee-multus-daemon-config\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.580889 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.580677    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/489f9e99-b968-4ac5-b583-7a04541903c0-log-socket\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.580889 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.580738    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ed638d60-247b-4576-af02-b563cae3703a-sys-fs\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.580889 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.580877    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4af086fc-42a0-4bc5-a391-d35f222d8606-sys\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.581198 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.581032    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/489f9e99-b968-4ac5-b583-7a04541903c0-ovn-node-metrics-cert\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.581198 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.581184    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a19469af-bf1b-44e7-9596-ad3566e692e2-agent-certs\") pod \"konnectivity-agent-tlvdp\" (UID: \"a19469af-bf1b-44e7-9596-ad3566e692e2\") " pod="kube-system/konnectivity-agent-tlvdp"
Jul 28 01:26:09.581706 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.581682    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhhmh\" (UniqueName: \"kubernetes.io/projected/b19da232-9d4c-41fe-b81a-1a34a4166a6c-kube-api-access-jhhmh\") pod \"node-resolver-j84km\" (UID: \"b19da232-9d4c-41fe-b81a-1a34a4166a6c\") " pod="openshift-dns/node-resolver-j84km"
Jul 28 01:26:09.581981 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.581946    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a19469af-bf1b-44e7-9596-ad3566e692e2-konnectivity-ca\") pod \"konnectivity-agent-tlvdp\" (UID: \"a19469af-bf1b-44e7-9596-ad3566e692e2\") " pod="kube-system/konnectivity-agent-tlvdp"
Jul 28 01:26:09.582257 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.582236    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4af086fc-42a0-4bc5-a391-d35f222d8606-etc-tuned\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.584259 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.584233    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6mdh\" (UniqueName: \"kubernetes.io/projected/489f9e99-b968-4ac5-b583-7a04541903c0-kube-api-access-q6mdh\") pod \"ovnkube-node-xftxq\" (UID: \"489f9e99-b968-4ac5-b583-7a04541903c0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.585487 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.585438    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcnfc\" (UniqueName: \"kubernetes.io/projected/d2ead989-c1b2-42a6-9c17-e00a21d8d757-kube-api-access-bcnfc\") pod \"multus-additional-cni-plugins-cfrlp\" (UID: \"d2ead989-c1b2-42a6-9c17-e00a21d8d757\") " pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.585823 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:09.585802    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:26:09.585905 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:09.585836    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:26:09.585905 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:09.585852    2558 projected.go:196] Error preparing data for projected volume kube-api-access-tkt9r for pod openshift-network-diagnostics/network-check-target-b262s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:09.585980 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.585906    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpzt8\" (UniqueName: \"kubernetes.io/projected/ed638d60-247b-4576-af02-b563cae3703a-kube-api-access-rpzt8\") pod \"aws-ebs-csi-driver-node-r2tnx\" (UID: \"ed638d60-247b-4576-af02-b563cae3703a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.585980 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:09.585918    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r podName:78f08e99-cb7b-4f45-9713-9afd7f2fad94 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:10.08590539 +0000 UTC m=+3.102604031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tkt9r" (UniqueName: "kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r") pod "network-check-target-b262s" (UID: "78f08e99-cb7b-4f45-9713-9afd7f2fad94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:09.586128 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.586103    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdtj6\" (UniqueName: \"kubernetes.io/projected/a264e673-0627-4b00-8de1-753170b00bee-kube-api-access-cdtj6\") pod \"multus-q7phb\" (UID: \"a264e673-0627-4b00-8de1-753170b00bee\") " pod="openshift-multus/multus-q7phb"
Jul 28 01:26:09.587514 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.587488    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d59h\" (UniqueName: \"kubernetes.io/projected/b94d344e-9357-41ea-a7a7-36490cfe27bd-kube-api-access-2d59h\") pod \"network-metrics-daemon-lmrxw\" (UID: \"b94d344e-9357-41ea-a7a7-36490cfe27bd\") " pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:09.589723 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.589654    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjdq5\" (UniqueName: \"kubernetes.io/projected/20045825-79f7-46f4-917d-2846016a45b2-kube-api-access-sjdq5\") pod \"node-ca-9kp6b\" (UID: \"20045825-79f7-46f4-917d-2846016a45b2\") " pod="openshift-image-registry/node-ca-9kp6b"
Jul 28 01:26:09.590142 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.590082    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zm7n\" (UniqueName: \"kubernetes.io/projected/4af086fc-42a0-4bc5-a391-d35f222d8606-kube-api-access-5zm7n\") pod \"tuned-fv88b\" (UID: \"4af086fc-42a0-4bc5-a391-d35f222d8606\") " pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.591649 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.591632    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q42bg\" (UniqueName: \"kubernetes.io/projected/5c4f5668-1f21-447d-8bab-dd8da04835d4-kube-api-access-q42bg\") pod \"iptables-alerter-xkxr9\" (UID: \"5c4f5668-1f21-447d-8bab-dd8da04835d4\") " pod="openshift-network-operator/iptables-alerter-xkxr9"
Jul 28 01:26:09.672137 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.672104    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cfrlp"
Jul 28 01:26:09.683168 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.683147    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:09.692053 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.692031    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fv88b"
Jul 28 01:26:09.699688 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.699668    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j84km"
Jul 28 01:26:09.707340 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.707319    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9kp6b"
Jul 28 01:26:09.717127 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.717103    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx"
Jul 28 01:26:09.722811 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.722795    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tlvdp"
Jul 28 01:26:09.732205 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.732187    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xkxr9"
Jul 28 01:26:09.739058 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:09.739038    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q7phb"
Jul 28 01:26:10.174162 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:10.174135    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkt9r\" (UniqueName: \"kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r\") pod \"network-check-target-b262s\" (UID: \"78f08e99-cb7b-4f45-9713-9afd7f2fad94\") " pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:10.174345 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:10.174168    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret\") pod \"global-pull-secret-syncer-mg49d\" (UID: \"78c22c72-ea97-4178-a43b-b731dd3956b7\") " pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:10.174345 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:10.174192    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs\") pod \"network-metrics-daemon-lmrxw\" (UID: \"b94d344e-9357-41ea-a7a7-36490cfe27bd\") " pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:10.174345 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:10.174277    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:10.174345 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:10.174301    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:10.174345 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:10.174334    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs podName:b94d344e-9357-41ea-a7a7-36490cfe27bd nodeName:}" failed. No retries permitted until 2026-07-28 01:26:11.174319039 +0000 UTC m=+4.191017661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs") pod "network-metrics-daemon-lmrxw" (UID: "b94d344e-9357-41ea-a7a7-36490cfe27bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:10.174525 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:10.174374    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret podName:78c22c72-ea97-4178-a43b-b731dd3956b7 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:11.174356162 +0000 UTC m=+4.191054784 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret") pod "global-pull-secret-syncer-mg49d" (UID: "78c22c72-ea97-4178-a43b-b731dd3956b7") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:10.174525 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:10.174307    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:26:10.174525 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:10.174406    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:26:10.174525 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:10.174420    2558 projected.go:196] Error preparing data for projected volume kube-api-access-tkt9r for pod openshift-network-diagnostics/network-check-target-b262s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:10.174525 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:10.174464    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r podName:78f08e99-cb7b-4f45-9713-9afd7f2fad94 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:11.174453265 +0000 UTC m=+4.191151893 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkt9r" (UniqueName: "kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r") pod "network-check-target-b262s" (UID: "78f08e99-cb7b-4f45-9713-9afd7f2fad94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:10.396816 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:10.396763    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 01:21:09 +0000 UTC" deadline="2028-01-31 01:22:59.429145115 +0000 UTC"
Jul 28 01:26:10.396816 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:10.396815    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13247h56m49.032334284s"
Jul 28 01:26:10.475801 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:10.475772    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb19da232_9d4c_41fe_b81a_1a34a4166a6c.slice/crio-69e45a1bb8192be825284b8f989611ad8b78441b0eff578f67d2c3aaecc3ce4a WatchSource:0}: Error finding container 69e45a1bb8192be825284b8f989611ad8b78441b0eff578f67d2c3aaecc3ce4a: Status 404 returned error can't find the container with id 69e45a1bb8192be825284b8f989611ad8b78441b0eff578f67d2c3aaecc3ce4a
Jul 28 01:26:10.479338 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:10.479270    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ead989_c1b2_42a6_9c17_e00a21d8d757.slice/crio-f8314fb4a6f6c8812c3ecab870ffce58195b5d6718564a0339e4c740cd97d077 WatchSource:0}: Error finding container f8314fb4a6f6c8812c3ecab870ffce58195b5d6718564a0339e4c740cd97d077: Status 404 returned error can't find the container with id f8314fb4a6f6c8812c3ecab870ffce58195b5d6718564a0339e4c740cd97d077
Jul 28 01:26:10.499174 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:10.499154    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda19469af_bf1b_44e7_9596_ad3566e692e2.slice/crio-468d3046cbb56cb0d4ce2cdea5066a22d2f388cd062fc53febfa24c970b4735a WatchSource:0}: Error finding container 468d3046cbb56cb0d4ce2cdea5066a22d2f388cd062fc53febfa24c970b4735a: Status 404 returned error can't find the container with id 468d3046cbb56cb0d4ce2cdea5066a22d2f388cd062fc53febfa24c970b4735a
Jul 28 01:26:10.499806 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:10.499780    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20045825_79f7_46f4_917d_2846016a45b2.slice/crio-e09fab0fe2960d98a0e5be4ba04803c1734998940d30dcc5ca465f53d3ccd2d1 WatchSource:0}: Error finding container e09fab0fe2960d98a0e5be4ba04803c1734998940d30dcc5ca465f53d3ccd2d1: Status 404 returned error can't find the container with id e09fab0fe2960d98a0e5be4ba04803c1734998940d30dcc5ca465f53d3ccd2d1
Jul 28 01:26:10.501073 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:10.501048    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c4f5668_1f21_447d_8bab_dd8da04835d4.slice/crio-bb267a47eb38fe71d289850070f68d948d58fb9316bc228e5897abc4f2f20099 WatchSource:0}: Error finding container bb267a47eb38fe71d289850070f68d948d58fb9316bc228e5897abc4f2f20099: Status 404 returned error can't find the container with id bb267a47eb38fe71d289850070f68d948d58fb9316bc228e5897abc4f2f20099
Jul 28 01:26:10.502269 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:10.502247    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af086fc_42a0_4bc5_a391_d35f222d8606.slice/crio-8e4e1bb047609129bdb859f509ddf04a309f5e587d3299adf27d7cac5a155a80 WatchSource:0}: Error finding container 8e4e1bb047609129bdb859f509ddf04a309f5e587d3299adf27d7cac5a155a80: Status 404 returned error can't find the container with id 8e4e1bb047609129bdb859f509ddf04a309f5e587d3299adf27d7cac5a155a80
Jul 28 01:26:10.503052 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:10.503023    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489f9e99_b968_4ac5_b583_7a04541903c0.slice/crio-df4dff4870bff6a70638c5b49b1b51eed9f5abd9e93d2598e5ce34349bf22a77 WatchSource:0}: Error finding container df4dff4870bff6a70638c5b49b1b51eed9f5abd9e93d2598e5ce34349bf22a77: Status 404 returned error can't find the container with id df4dff4870bff6a70638c5b49b1b51eed9f5abd9e93d2598e5ce34349bf22a77
Jul 28 01:26:10.504250 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:10.504194    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded638d60_247b_4576_af02_b563cae3703a.slice/crio-f7688a123862c7a2c35a10bc7b5f9e11a0ffc16aacf308901f8131a2f4708f9b WatchSource:0}: Error finding container f7688a123862c7a2c35a10bc7b5f9e11a0ffc16aacf308901f8131a2f4708f9b: Status 404 returned error can't find the container with id f7688a123862c7a2c35a10bc7b5f9e11a0ffc16aacf308901f8131a2f4708f9b
Jul 28 01:26:10.545352 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:10.545330    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:10.545431 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:10.545366    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:10.545481 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:10.545448    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg49d" podUID="78c22c72-ea97-4178-a43b-b731dd3956b7"
Jul 28 01:26:10.545537 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:10.545506    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b262s" podUID="78f08e99-cb7b-4f45-9713-9afd7f2fad94"
Jul 28 01:26:10.545609 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:10.545569    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:10.545680 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:10.545662    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmrxw" podUID="b94d344e-9357-41ea-a7a7-36490cfe27bd"
Jul 28 01:26:10.559169 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:10.559024    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q7phb" event={"ID":"a264e673-0627-4b00-8de1-753170b00bee","Type":"ContainerStarted","Data":"65100b11fef59f7da84e70c224c63e61d6334aaba17f2eceb073dfb6d15fb5ae"}
Jul 28 01:26:10.560187 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:10.560161    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9kp6b" event={"ID":"20045825-79f7-46f4-917d-2846016a45b2","Type":"ContainerStarted","Data":"e09fab0fe2960d98a0e5be4ba04803c1734998940d30dcc5ca465f53d3ccd2d1"}
Jul 28 01:26:10.561427 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:10.561401    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tlvdp" event={"ID":"a19469af-bf1b-44e7-9596-ad3566e692e2","Type":"ContainerStarted","Data":"468d3046cbb56cb0d4ce2cdea5066a22d2f388cd062fc53febfa24c970b4735a"}
Jul 28 01:26:10.562692 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:10.562667    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cfrlp" event={"ID":"d2ead989-c1b2-42a6-9c17-e00a21d8d757","Type":"ContainerStarted","Data":"f8314fb4a6f6c8812c3ecab870ffce58195b5d6718564a0339e4c740cd97d077"}
Jul 28 01:26:10.563885 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:10.563859    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j84km" event={"ID":"b19da232-9d4c-41fe-b81a-1a34a4166a6c","Type":"ContainerStarted","Data":"69e45a1bb8192be825284b8f989611ad8b78441b0eff578f67d2c3aaecc3ce4a"}
Jul 28 01:26:10.566011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:10.565942    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx" event={"ID":"ed638d60-247b-4576-af02-b563cae3703a","Type":"ContainerStarted","Data":"f7688a123862c7a2c35a10bc7b5f9e11a0ffc16aacf308901f8131a2f4708f9b"}
Jul 28 01:26:10.567392 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:10.567359    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fv88b" event={"ID":"4af086fc-42a0-4bc5-a391-d35f222d8606","Type":"ContainerStarted","Data":"8e4e1bb047609129bdb859f509ddf04a309f5e587d3299adf27d7cac5a155a80"}
Jul 28 01:26:10.569956 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:10.569933    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq" event={"ID":"489f9e99-b968-4ac5-b583-7a04541903c0","Type":"ContainerStarted","Data":"df4dff4870bff6a70638c5b49b1b51eed9f5abd9e93d2598e5ce34349bf22a77"}
Jul 28 01:26:10.571822 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:10.571794    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xkxr9" event={"ID":"5c4f5668-1f21-447d-8bab-dd8da04835d4","Type":"ContainerStarted","Data":"bb267a47eb38fe71d289850070f68d948d58fb9316bc228e5897abc4f2f20099"}
Jul 28 01:26:10.942222 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:10.942102    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:26:11.185772 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:11.184807    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs\") pod \"network-metrics-daemon-lmrxw\" (UID: \"b94d344e-9357-41ea-a7a7-36490cfe27bd\") " pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:11.185772 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:11.184897    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkt9r\" (UniqueName: \"kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r\") pod \"network-check-target-b262s\" (UID: \"78f08e99-cb7b-4f45-9713-9afd7f2fad94\") " pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:11.185772 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:11.184929    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret\") pod \"global-pull-secret-syncer-mg49d\" (UID: \"78c22c72-ea97-4178-a43b-b731dd3956b7\") " pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:11.185772 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:11.185055    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:11.185772 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:11.185116    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret podName:78c22c72-ea97-4178-a43b-b731dd3956b7 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:13.185097878 +0000 UTC m=+6.201796505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret") pod "global-pull-secret-syncer-mg49d" (UID: "78c22c72-ea97-4178-a43b-b731dd3956b7") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:11.185772 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:11.185519    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:11.185772 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:11.185592    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs podName:b94d344e-9357-41ea-a7a7-36490cfe27bd nodeName:}" failed. No retries permitted until 2026-07-28 01:26:13.185575557 +0000 UTC m=+6.202274181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs") pod "network-metrics-daemon-lmrxw" (UID: "b94d344e-9357-41ea-a7a7-36490cfe27bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:11.185772 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:11.185670    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:26:11.185772 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:11.185683    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:26:11.185772 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:11.185694    2558 projected.go:196] Error preparing data for projected volume kube-api-access-tkt9r for pod openshift-network-diagnostics/network-check-target-b262s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:11.185772 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:11.185727    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r podName:78f08e99-cb7b-4f45-9713-9afd7f2fad94 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:13.185717294 +0000 UTC m=+6.202415922 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkt9r" (UniqueName: "kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r") pod "network-check-target-b262s" (UID: "78f08e99-cb7b-4f45-9713-9afd7f2fad94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:11.398126 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:11.398022    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 01:21:09 +0000 UTC" deadline="2028-04-13 08:35:44.166068956 +0000 UTC"
Jul 28 01:26:11.398126 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:11.398055    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15007h9m32.768018668s"
Jul 28 01:26:11.587986 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:11.587862    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal" event={"ID":"89ce73b10fe517b9feb646e9ce269241","Type":"ContainerStarted","Data":"f10ce223aebbe28f28455101f842794ddd1d72d106da463739b550a5dfd7ff35"}
Jul 28 01:26:11.606248 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:11.606214    2558 generic.go:356] "Generic (PLEG): container finished" podID="8c456831f14043ef3813c57eda43b448" containerID="0286fec5980127852af84b9fe2f55cafb6469c4bf926c303e41d2aa230881d0d" exitCode=0
Jul 28 01:26:11.606403 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:11.606262    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal" event={"ID":"8c456831f14043ef3813c57eda43b448","Type":"ContainerDied","Data":"0286fec5980127852af84b9fe2f55cafb6469c4bf926c303e41d2aa230881d0d"}
Jul 28 01:26:11.646954 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:11.646876    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-95.ec2.internal" podStartSLOduration=3.64685583 podStartE2EDuration="3.64685583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:26:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:11.620752564 +0000 UTC m=+4.637451208" watchObservedRunningTime="2026-07-28 01:26:11.64685583 +0000 UTC m=+4.663554476"
Jul 28 01:26:12.545653 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:12.545619    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:12.546135 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:12.545751    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b262s" podUID="78f08e99-cb7b-4f45-9713-9afd7f2fad94"
Jul 28 01:26:12.546196 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:12.546179    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:12.546390 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:12.546363    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg49d" podUID="78c22c72-ea97-4178-a43b-b731dd3956b7"
Jul 28 01:26:12.546527 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:12.546398    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:12.546527 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:12.546489    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmrxw" podUID="b94d344e-9357-41ea-a7a7-36490cfe27bd"
Jul 28 01:26:12.623797 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:12.623611    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal" event={"ID":"8c456831f14043ef3813c57eda43b448","Type":"ContainerStarted","Data":"68249bffedb0bf033c241f387ec55e02e2a504066c77378604cf4d530d5f95b2"}
Jul 28 01:26:13.206950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:13.205866    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkt9r\" (UniqueName: \"kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r\") pod \"network-check-target-b262s\" (UID: \"78f08e99-cb7b-4f45-9713-9afd7f2fad94\") " pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:13.206950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:13.205918    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret\") pod \"global-pull-secret-syncer-mg49d\" (UID: \"78c22c72-ea97-4178-a43b-b731dd3956b7\") " pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:13.206950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:13.205953    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs\") pod \"network-metrics-daemon-lmrxw\" (UID: \"b94d344e-9357-41ea-a7a7-36490cfe27bd\") " pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:13.206950 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:13.206115    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:13.206950 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:13.206184    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs podName:b94d344e-9357-41ea-a7a7-36490cfe27bd nodeName:}" failed. No retries permitted until 2026-07-28 01:26:17.206162291 +0000 UTC m=+10.222860931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs") pod "network-metrics-daemon-lmrxw" (UID: "b94d344e-9357-41ea-a7a7-36490cfe27bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:13.206950 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:13.206630    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:26:13.206950 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:13.206650    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:26:13.206950 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:13.206663    2558 projected.go:196] Error preparing data for projected volume kube-api-access-tkt9r for pod openshift-network-diagnostics/network-check-target-b262s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:13.206950 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:13.206711    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r podName:78f08e99-cb7b-4f45-9713-9afd7f2fad94 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:17.206695374 +0000 UTC m=+10.223393998 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkt9r" (UniqueName: "kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r") pod "network-check-target-b262s" (UID: "78f08e99-cb7b-4f45-9713-9afd7f2fad94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:13.206950 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:13.206771    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:13.206950 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:13.206800    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret podName:78c22c72-ea97-4178-a43b-b731dd3956b7 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:17.206790814 +0000 UTC m=+10.223489435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret") pod "global-pull-secret-syncer-mg49d" (UID: "78c22c72-ea97-4178-a43b-b731dd3956b7") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:14.545568 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:14.545519    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:14.546022 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:14.545664    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b262s" podUID="78f08e99-cb7b-4f45-9713-9afd7f2fad94"
Jul 28 01:26:14.546022 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:14.545733    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:14.546022 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:14.545849    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmrxw" podUID="b94d344e-9357-41ea-a7a7-36490cfe27bd"
Jul 28 01:26:14.546022 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:14.545888    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:14.546022 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:14.545957    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg49d" podUID="78c22c72-ea97-4178-a43b-b731dd3956b7"
Jul 28 01:26:16.545101 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:16.545050    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:16.545101 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:16.545097    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:16.545591 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:16.545164    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg49d" podUID="78c22c72-ea97-4178-a43b-b731dd3956b7"
Jul 28 01:26:16.545591 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:16.545248    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:16.545591 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:16.545397    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmrxw" podUID="b94d344e-9357-41ea-a7a7-36490cfe27bd"
Jul 28 01:26:16.545591 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:16.545473    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b262s" podUID="78f08e99-cb7b-4f45-9713-9afd7f2fad94"
Jul 28 01:26:17.243132 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:17.242328    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs\") pod \"network-metrics-daemon-lmrxw\" (UID: \"b94d344e-9357-41ea-a7a7-36490cfe27bd\") " pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:17.243132 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:17.242415    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkt9r\" (UniqueName: \"kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r\") pod \"network-check-target-b262s\" (UID: \"78f08e99-cb7b-4f45-9713-9afd7f2fad94\") " pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:17.243132 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:17.242447    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret\") pod \"global-pull-secret-syncer-mg49d\" (UID: \"78c22c72-ea97-4178-a43b-b731dd3956b7\") " pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:17.243132 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:17.242569    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:17.243132 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:17.242629    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret podName:78c22c72-ea97-4178-a43b-b731dd3956b7 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:25.242610253 +0000 UTC m=+18.259308888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret") pod "global-pull-secret-syncer-mg49d" (UID: "78c22c72-ea97-4178-a43b-b731dd3956b7") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:17.243132 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:17.242696    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:17.243132 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:17.242728    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs podName:b94d344e-9357-41ea-a7a7-36490cfe27bd nodeName:}" failed. No retries permitted until 2026-07-28 01:26:25.242716771 +0000 UTC m=+18.259415399 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs") pod "network-metrics-daemon-lmrxw" (UID: "b94d344e-9357-41ea-a7a7-36490cfe27bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:17.243132 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:17.242807    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:26:17.243132 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:17.242821    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:26:17.243132 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:17.242833    2558 projected.go:196] Error preparing data for projected volume kube-api-access-tkt9r for pod openshift-network-diagnostics/network-check-target-b262s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:17.243132 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:17.242864    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r podName:78f08e99-cb7b-4f45-9713-9afd7f2fad94 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:25.242854045 +0000 UTC m=+18.259552680 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkt9r" (UniqueName: "kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r") pod "network-check-target-b262s" (UID: "78f08e99-cb7b-4f45-9713-9afd7f2fad94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:18.545595 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:18.545542    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:18.546024 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:18.545678    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:18.546024 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:18.545690    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg49d" podUID="78c22c72-ea97-4178-a43b-b731dd3956b7"
Jul 28 01:26:18.546024 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:18.545791    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b262s" podUID="78f08e99-cb7b-4f45-9713-9afd7f2fad94"
Jul 28 01:26:18.546024 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:18.545843    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:18.546024 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:18.545926    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmrxw" podUID="b94d344e-9357-41ea-a7a7-36490cfe27bd"
Jul 28 01:26:20.545067 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:20.545029    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:20.545562 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:20.545039    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:20.545562 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:20.545147    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b262s" podUID="78f08e99-cb7b-4f45-9713-9afd7f2fad94"
Jul 28 01:26:20.545562 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:20.545263    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmrxw" podUID="b94d344e-9357-41ea-a7a7-36490cfe27bd"
Jul 28 01:26:20.545562 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:20.545039    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:20.545562 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:20.545384    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg49d" podUID="78c22c72-ea97-4178-a43b-b731dd3956b7"
Jul 28 01:26:22.545710 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:22.545674    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:22.545710 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:22.545706    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:22.546252 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:22.545683    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:22.546252 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:22.545800    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg49d" podUID="78c22c72-ea97-4178-a43b-b731dd3956b7"
Jul 28 01:26:22.546252 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:22.545929    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmrxw" podUID="b94d344e-9357-41ea-a7a7-36490cfe27bd"
Jul 28 01:26:22.546252 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:22.546018    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b262s" podUID="78f08e99-cb7b-4f45-9713-9afd7f2fad94"
Jul 28 01:26:24.545042 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:24.545008    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:24.545511 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:24.545018    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:24.545511 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:24.545019    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:24.545511 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:24.545189    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmrxw" podUID="b94d344e-9357-41ea-a7a7-36490cfe27bd"
Jul 28 01:26:24.545511 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:24.545271    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b262s" podUID="78f08e99-cb7b-4f45-9713-9afd7f2fad94"
Jul 28 01:26:24.545511 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:24.545345    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg49d" podUID="78c22c72-ea97-4178-a43b-b731dd3956b7"
Jul 28 01:26:25.304594 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:25.304543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkt9r\" (UniqueName: \"kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r\") pod \"network-check-target-b262s\" (UID: \"78f08e99-cb7b-4f45-9713-9afd7f2fad94\") " pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:25.304849 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:25.304605    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret\") pod \"global-pull-secret-syncer-mg49d\" (UID: \"78c22c72-ea97-4178-a43b-b731dd3956b7\") " pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:25.304849 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:25.304636    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs\") pod \"network-metrics-daemon-lmrxw\" (UID: \"b94d344e-9357-41ea-a7a7-36490cfe27bd\") " pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:25.304849 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:25.304673    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:26:25.304849 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:25.304696    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:26:25.304849 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:25.304706    2558 projected.go:196] Error preparing data for projected volume kube-api-access-tkt9r for pod openshift-network-diagnostics/network-check-target-b262s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:25.304849 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:25.304738    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:25.304849 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:25.304755    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r podName:78f08e99-cb7b-4f45-9713-9afd7f2fad94 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:41.304736954 +0000 UTC m=+34.321435591 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkt9r" (UniqueName: "kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r") pod "network-check-target-b262s" (UID: "78f08e99-cb7b-4f45-9713-9afd7f2fad94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:25.304849 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:25.304784    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs podName:b94d344e-9357-41ea-a7a7-36490cfe27bd nodeName:}" failed. No retries permitted until 2026-07-28 01:26:41.304769002 +0000 UTC m=+34.321467623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs") pod "network-metrics-daemon-lmrxw" (UID: "b94d344e-9357-41ea-a7a7-36490cfe27bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:25.304849 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:25.304820    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:25.304849 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:25.304849    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret podName:78c22c72-ea97-4178-a43b-b731dd3956b7 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:41.304839558 +0000 UTC m=+34.321538184 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret") pod "global-pull-secret-syncer-mg49d" (UID: "78c22c72-ea97-4178-a43b-b731dd3956b7") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:26.545712 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:26.545678    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:26.546170 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:26.545811    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg49d" podUID="78c22c72-ea97-4178-a43b-b731dd3956b7"
Jul 28 01:26:26.546170 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:26.545823    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:26.546170 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:26.545832    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:26.546170 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:26.545958    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmrxw" podUID="b94d344e-9357-41ea-a7a7-36490cfe27bd"
Jul 28 01:26:26.546170 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:26.546038    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b262s" podUID="78f08e99-cb7b-4f45-9713-9afd7f2fad94"
Jul 28 01:26:28.545277 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:28.545239    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:28.545754 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:28.545293    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:28.545754 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:28.545351    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:28.545754 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:28.545362    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg49d" podUID="78c22c72-ea97-4178-a43b-b731dd3956b7"
Jul 28 01:26:28.545754 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:28.545462    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmrxw" podUID="b94d344e-9357-41ea-a7a7-36490cfe27bd"
Jul 28 01:26:28.545754 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:28.545562    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b262s" podUID="78f08e99-cb7b-4f45-9713-9afd7f2fad94"
Jul 28 01:26:29.658605 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:29.658423    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fv88b" event={"ID":"4af086fc-42a0-4bc5-a391-d35f222d8606","Type":"ContainerStarted","Data":"17fb974b211ebf3f0233547246cca3291c0ac0583dcd555d112c944c06291cb5"}
Jul 28 01:26:29.660093 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:29.659994    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 01:26:29.660405 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:29.660385    2558 generic.go:356] "Generic (PLEG): container finished" podID="489f9e99-b968-4ac5-b583-7a04541903c0" containerID="5a5b168aa13c8d75dc56f5b86119ec0126f682cc7f0da5a020e2fa47f7c602c7" exitCode=1
Jul 28 01:26:29.660504 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:29.660458    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq" event={"ID":"489f9e99-b968-4ac5-b583-7a04541903c0","Type":"ContainerDied","Data":"5a5b168aa13c8d75dc56f5b86119ec0126f682cc7f0da5a020e2fa47f7c602c7"}
Jul 28 01:26:29.660583 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:29.660521    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq" event={"ID":"489f9e99-b968-4ac5-b583-7a04541903c0","Type":"ContainerStarted","Data":"5036f4ba5a60fe87b76ee490f3b8a7798ce6cbc93bc57f25813e8ccc1ad7f7c9"}
Jul 28 01:26:29.661852 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:29.661830    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9kp6b" event={"ID":"20045825-79f7-46f4-917d-2846016a45b2","Type":"ContainerStarted","Data":"475723f48975fe55c138f8117eea86e6fb1699d91e85cf5d380ead6f2b186294"}
Jul 28 01:26:29.663367 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:29.663340    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tlvdp" event={"ID":"a19469af-bf1b-44e7-9596-ad3566e692e2","Type":"ContainerStarted","Data":"78d3099eedc0af782f981d0d98e41e56a91c01a32785bc839dd106d54c42390d"}
Jul 28 01:26:29.664714 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:29.664693    2558 generic.go:356] "Generic (PLEG): container finished" podID="d2ead989-c1b2-42a6-9c17-e00a21d8d757" containerID="e6700c0fb643b489158e425afcb19930cbe06ca5a91a817fca2a2c090bc3db4b" exitCode=0
Jul 28 01:26:29.664802 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:29.664772    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cfrlp" event={"ID":"d2ead989-c1b2-42a6-9c17-e00a21d8d757","Type":"ContainerDied","Data":"e6700c0fb643b489158e425afcb19930cbe06ca5a91a817fca2a2c090bc3db4b"}
Jul 28 01:26:29.666218 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:29.666196    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j84km" event={"ID":"b19da232-9d4c-41fe-b81a-1a34a4166a6c","Type":"ContainerStarted","Data":"40866e51178508d71cce3dd36cd8ad050de17abddabc10ac6cf0c6b619ef231a"}
Jul 28 01:26:29.667495 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:29.667478    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx" event={"ID":"ed638d60-247b-4576-af02-b563cae3703a","Type":"ContainerStarted","Data":"c3eba18f55a7432545b714f58147e3f4698b570361698fcb7b89cc870b1ad75c"}
Jul 28 01:26:29.678196 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:29.678160    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fv88b" podStartSLOduration=3.866721896 podStartE2EDuration="22.678149372s" totalImagesPullingTime="18.811427476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:29.678074184 +0000 UTC m=+22.694772827" watchObservedRunningTime="2026-07-28 01:26:29.678149372 +0000 UTC m=+22.694848015"
Jul 28 01:26:29.678465 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:29.678446    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-95.ec2.internal" podStartSLOduration=21.67844035 podStartE2EDuration="21.67844035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:26:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:12.645900758 +0000 UTC m=+5.662599402" watchObservedRunningTime="2026-07-28 01:26:29.67844035 +0000 UTC m=+22.695138993"
Jul 28 01:26:29.692521 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:29.692488    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tlvdp" podStartSLOduration=8.443298071 podStartE2EDuration="22.692476651s" totalImagesPullingTime="14.24917858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:29.691786957 +0000 UTC m=+22.708485600" watchObservedRunningTime="2026-07-28 01:26:29.692476651 +0000 UTC m=+22.709175273"
Jul 28 01:26:29.744354 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:29.744298    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j84km" podStartSLOduration=3.930534591 podStartE2EDuration="22.744277359s" totalImagesPullingTime="18.813742768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:29.728687432 +0000 UTC m=+22.745386075" watchObservedRunningTime="2026-07-28 01:26:29.744277359 +0000 UTC m=+22.760976003"
Jul 28 01:26:29.744444 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:29.744414    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9kp6b" podStartSLOduration=3.956782494 podStartE2EDuration="22.744406432s" totalImagesPullingTime="18.787623938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:29.743954558 +0000 UTC m=+22.760653202" watchObservedRunningTime="2026-07-28 01:26:29.744406432 +0000 UTC m=+22.761105075"
Jul 28 01:26:30.545878 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:30.545852    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:30.546050 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:30.545855    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:30.546050 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:30.545955    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmrxw" podUID="b94d344e-9357-41ea-a7a7-36490cfe27bd"
Jul 28 01:26:30.546184 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:30.546044    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b262s" podUID="78f08e99-cb7b-4f45-9713-9afd7f2fad94"
Jul 28 01:26:30.546184 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:30.545863    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:30.546184 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:30.546130    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg49d" podUID="78c22c72-ea97-4178-a43b-b731dd3956b7"
Jul 28 01:26:30.671709 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:30.671673    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q7phb" event={"ID":"a264e673-0627-4b00-8de1-753170b00bee","Type":"ContainerStarted","Data":"4a940748a643ab29a16fea7d6a8bac4dfc98a8b0f59e0304bd4934ee40a9c02f"}
Jul 28 01:26:30.674907 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:30.674883    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 01:26:30.675372 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:30.675331    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq" event={"ID":"489f9e99-b968-4ac5-b583-7a04541903c0","Type":"ContainerStarted","Data":"1120cd5a5bfeb27317d4742d0a1fdafa24b7127c817fcf89fb174fbf30240b76"}
Jul 28 01:26:30.675492 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:30.675422    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq" event={"ID":"489f9e99-b968-4ac5-b583-7a04541903c0","Type":"ContainerStarted","Data":"9eee6c8ca4b00c865442030ffa7210e0200e417d2e0fd338aacd62b2383f8ebd"}
Jul 28 01:26:30.675492 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:30.675458    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq" event={"ID":"489f9e99-b968-4ac5-b583-7a04541903c0","Type":"ContainerStarted","Data":"fcb80c538582594f78604dbb8986c6c58a46917d4afca43c5eef937377dfc7af"}
Jul 28 01:26:30.675492 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:30.675485    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq" event={"ID":"489f9e99-b968-4ac5-b583-7a04541903c0","Type":"ContainerStarted","Data":"c80efa0003492e13a0f79dc480e6a32a7965db9f75d34d850a9c9053b0072502"}
Jul 28 01:26:30.691963 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:30.691921    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q7phb" podStartSLOduration=4.5887462150000005 podStartE2EDuration="23.691902646s" totalImagesPullingTime="19.103156431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:30.691359881 +0000 UTC m=+23.708058527" watchObservedRunningTime="2026-07-28 01:26:30.691902646 +0000 UTC m=+23.708601291"
Jul 28 01:26:30.979821 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:30.979794    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 01:26:31.419356 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:31.419232    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T01:26:30.979817131Z","UUID":"ef86816a-8986-462e-8941-c09d36a40f8b","Handler":null,"Name":"","Endpoint":""}
Jul 28 01:26:31.421010 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:31.420984    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 01:26:31.421121 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:31.421021    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 01:26:31.679464 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:31.679377    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx" event={"ID":"ed638d60-247b-4576-af02-b563cae3703a","Type":"ContainerStarted","Data":"01a945d04fab228fc84ff3eb603a20102dc7a8ac74a4915cea0150d428d8b720"}
Jul 28 01:26:31.680996 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:31.680968    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xkxr9" event={"ID":"5c4f5668-1f21-447d-8bab-dd8da04835d4","Type":"ContainerStarted","Data":"2c92fb17d68ff17dbe4491374801aa5e3958d33adc9e2111e509d0955b89dc2e"}
Jul 28 01:26:31.697801 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:31.697758    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xkxr9" podStartSLOduration=5.886464757 podStartE2EDuration="24.697745143s" totalImagesPullingTime="18.811280386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:31.697678658 +0000 UTC m=+24.714377302" watchObservedRunningTime="2026-07-28 01:26:31.697745143 +0000 UTC m=+24.714443788"
Jul 28 01:26:32.545436 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:32.545361    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:32.545693 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:32.545484    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg49d" podUID="78c22c72-ea97-4178-a43b-b731dd3956b7"
Jul 28 01:26:32.545693 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:32.545496    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:32.545693 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:32.545490    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:32.545693 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:32.545624    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b262s" podUID="78f08e99-cb7b-4f45-9713-9afd7f2fad94"
Jul 28 01:26:32.545855 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:32.545736    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmrxw" podUID="b94d344e-9357-41ea-a7a7-36490cfe27bd"
Jul 28 01:26:32.685531 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:32.685419    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx" event={"ID":"ed638d60-247b-4576-af02-b563cae3703a","Type":"ContainerStarted","Data":"f4e0ddf8ed047cfbf6be1a6242115012d71bf728cebdcf55a457e723f9604f70"}
Jul 28 01:26:32.688969 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:32.688945    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 01:26:32.689361 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:32.689338    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq" event={"ID":"489f9e99-b968-4ac5-b583-7a04541903c0","Type":"ContainerStarted","Data":"b10e90dc8ca1a415cc5ebe94801cb846fdae47d3119d22912b7bab399fba4e79"}
Jul 28 01:26:32.706727 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:32.706680    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2tnx" podStartSLOduration=4.421383238 podStartE2EDuration="25.706663978s" totalImagesPullingTime="21.28528074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:26:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:32.706032553 +0000 UTC m=+25.722731195" watchObservedRunningTime="2026-07-28 01:26:32.706663978 +0000 UTC m=+25.723362625"
Jul 28 01:26:34.464026 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:34.463857    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tlvdp"
Jul 28 01:26:34.464760 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:34.464388    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tlvdp"
Jul 28 01:26:34.545014 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:34.544984    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:34.545170 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:34.545091    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg49d" podUID="78c22c72-ea97-4178-a43b-b731dd3956b7"
Jul 28 01:26:34.545230 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:34.545182    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:34.545281 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:34.545246    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b262s" podUID="78f08e99-cb7b-4f45-9713-9afd7f2fad94"
Jul 28 01:26:34.545328 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:34.545288    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:34.545371 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:34.545341    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmrxw" podUID="b94d344e-9357-41ea-a7a7-36490cfe27bd"
Jul 28 01:26:34.696132 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:34.695962    2558 generic.go:356] "Generic (PLEG): container finished" podID="d2ead989-c1b2-42a6-9c17-e00a21d8d757" containerID="a55e01639a6044ad330aceb4499076b15e87fecfe348f45c0c7865340720d426" exitCode=0
Jul 28 01:26:34.696276 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:34.696022    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cfrlp" event={"ID":"d2ead989-c1b2-42a6-9c17-e00a21d8d757","Type":"ContainerDied","Data":"a55e01639a6044ad330aceb4499076b15e87fecfe348f45c0c7865340720d426"}
Jul 28 01:26:34.699736 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:34.699719    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 01:26:34.700103 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:34.700072    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq" event={"ID":"489f9e99-b968-4ac5-b583-7a04541903c0","Type":"ContainerStarted","Data":"463f8a1eb28ac6b27a6f7c6a999295347cec85318dc6817c5637c81ac5ca73df"}
Jul 28 01:26:34.700304 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:34.700288    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tlvdp"
Jul 28 01:26:34.700466 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:34.700445    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:34.700583 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:34.700570    2558 scope.go:117] "RemoveContainer" containerID="5a5b168aa13c8d75dc56f5b86119ec0126f682cc7f0da5a020e2fa47f7c602c7"
Jul 28 01:26:34.701177 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:34.701112    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tlvdp"
Jul 28 01:26:34.717332 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:34.717309    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:35.705885 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:35.705862    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 01:26:35.706350 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:35.706280    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq" event={"ID":"489f9e99-b968-4ac5-b583-7a04541903c0","Type":"ContainerStarted","Data":"f406148e9ab66d976e75804c0e39f6d88e27ec037552620f91a11b9c355ebdd0"}
Jul 28 01:26:35.706350 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:35.706320    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 01:26:35.706431 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:35.706417    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:35.722208 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:35.722182    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:35.752567 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:35.752503    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq" podStartSLOduration=9.887628216 podStartE2EDuration="28.752488892s" totalImagesPullingTime="18.864860676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:35.752321086 +0000 UTC m=+28.769019729" watchObservedRunningTime="2026-07-28 01:26:35.752488892 +0000 UTC m=+28.769187535"
Jul 28 01:26:36.006029 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:36.005988    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:26:36.217654 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:36.217572    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mg49d"]
Jul 28 01:26:36.217784 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:36.217678    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:36.217784 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:36.217762    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg49d" podUID="78c22c72-ea97-4178-a43b-b731dd3956b7"
Jul 28 01:26:36.221733 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:36.221708    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b262s"]
Jul 28 01:26:36.221872 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:36.221807    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:36.221918 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:36.221882    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b262s" podUID="78f08e99-cb7b-4f45-9713-9afd7f2fad94"
Jul 28 01:26:36.222581 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:36.222559    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lmrxw"]
Jul 28 01:26:36.222659 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:36.222649    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:36.222731 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:36.222717    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmrxw" podUID="b94d344e-9357-41ea-a7a7-36490cfe27bd"
Jul 28 01:26:36.710075 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:36.710046    2558 generic.go:356] "Generic (PLEG): container finished" podID="d2ead989-c1b2-42a6-9c17-e00a21d8d757" containerID="a805341cf0fb8198ecef632b1fdfc8016e37bd7771457cadb9088c045a5ba2aa" exitCode=0
Jul 28 01:26:36.710469 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:36.710141    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cfrlp" event={"ID":"d2ead989-c1b2-42a6-9c17-e00a21d8d757","Type":"ContainerDied","Data":"a805341cf0fb8198ecef632b1fdfc8016e37bd7771457cadb9088c045a5ba2aa"}
Jul 28 01:26:37.545841 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:37.545811    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:37.546032 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:37.545898    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b262s" podUID="78f08e99-cb7b-4f45-9713-9afd7f2fad94"
Jul 28 01:26:37.546032 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:37.545927    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:37.546138 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:37.546048    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmrxw" podUID="b94d344e-9357-41ea-a7a7-36490cfe27bd"
Jul 28 01:26:38.545376 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:38.545165    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:38.545810 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:38.545417    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg49d" podUID="78c22c72-ea97-4178-a43b-b731dd3956b7"
Jul 28 01:26:38.716954 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:38.716924    2558 generic.go:356] "Generic (PLEG): container finished" podID="d2ead989-c1b2-42a6-9c17-e00a21d8d757" containerID="1b107fe9d5e886c9e36e2a27804eb86fbb23d8ec9db6bc5ee3863866ea96fc7d" exitCode=0
Jul 28 01:26:38.717141 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:38.716995    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cfrlp" event={"ID":"d2ead989-c1b2-42a6-9c17-e00a21d8d757","Type":"ContainerDied","Data":"1b107fe9d5e886c9e36e2a27804eb86fbb23d8ec9db6bc5ee3863866ea96fc7d"}
Jul 28 01:26:39.545659 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:39.545623    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:39.546198 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:39.545749    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b262s" podUID="78f08e99-cb7b-4f45-9713-9afd7f2fad94"
Jul 28 01:26:39.546198 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:39.545842    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:39.546198 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:39.545960    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmrxw" podUID="b94d344e-9357-41ea-a7a7-36490cfe27bd"
Jul 28 01:26:40.545049 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:40.545017    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:40.545218 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:40.545150    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg49d" podUID="78c22c72-ea97-4178-a43b-b731dd3956b7"
Jul 28 01:26:41.338314 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:41.338273    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs\") pod \"network-metrics-daemon-lmrxw\" (UID: \"b94d344e-9357-41ea-a7a7-36490cfe27bd\") " pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:41.338930 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:41.338364    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkt9r\" (UniqueName: \"kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r\") pod \"network-check-target-b262s\" (UID: \"78f08e99-cb7b-4f45-9713-9afd7f2fad94\") " pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:41.338930 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:41.338388    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret\") pod \"global-pull-secret-syncer-mg49d\" (UID: \"78c22c72-ea97-4178-a43b-b731dd3956b7\") " pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:41.338930 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:41.338461    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:41.338930 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:41.338490    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:41.338930 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:41.338534    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:26:41.338930 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:41.338558    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs podName:b94d344e-9357-41ea-a7a7-36490cfe27bd nodeName:}" failed. No retries permitted until 2026-07-28 01:27:13.338523273 +0000 UTC m=+66.355221894 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs") pod "network-metrics-daemon-lmrxw" (UID: "b94d344e-9357-41ea-a7a7-36490cfe27bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:26:41.338930 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:41.338567    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:26:41.338930 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:41.338577    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret podName:78c22c72-ea97-4178-a43b-b731dd3956b7 nodeName:}" failed. No retries permitted until 2026-07-28 01:27:13.338568671 +0000 UTC m=+66.355267292 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret") pod "global-pull-secret-syncer-mg49d" (UID: "78c22c72-ea97-4178-a43b-b731dd3956b7") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:26:41.338930 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:41.338583    2558 projected.go:196] Error preparing data for projected volume kube-api-access-tkt9r for pod openshift-network-diagnostics/network-check-target-b262s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:41.338930 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:41.338626    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r podName:78f08e99-cb7b-4f45-9713-9afd7f2fad94 nodeName:}" failed. No retries permitted until 2026-07-28 01:27:13.33861427 +0000 UTC m=+66.355312894 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkt9r" (UniqueName: "kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r") pod "network-check-target-b262s" (UID: "78f08e99-cb7b-4f45-9713-9afd7f2fad94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:26:41.545560 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:41.545528    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:41.545713 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:41.545670    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmrxw" podUID="b94d344e-9357-41ea-a7a7-36490cfe27bd"
Jul 28 01:26:41.545751 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:41.545727    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:41.545858 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:41.545837    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b262s" podUID="78f08e99-cb7b-4f45-9713-9afd7f2fad94"
Jul 28 01:26:42.283247 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.283182    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-95.ec2.internal" event="NodeReady"
Jul 28 01:26:42.283388 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.283317    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 01:26:42.318826 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.318796    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69f8c7f5fd-h56fx"]
Jul 28 01:26:42.344626 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.344595    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8g6j6"]
Jul 28 01:26:42.345176 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.344822    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.347330 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.347307    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 01:26:42.347330 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.347324    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 01:26:42.347523 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.347444    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 01:26:42.347604 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.347525    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m2p2f\""
Jul 28 01:26:42.354174 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.353568    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 01:26:42.361269 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.360535    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4srvw"]
Jul 28 01:26:42.361269 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.360643    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:42.363204 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.363187    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 01:26:42.363295 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.363186    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7zgnb\""
Jul 28 01:26:42.363351 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.363306    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 01:26:42.374602 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.374584    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69f8c7f5fd-h56fx"]
Jul 28 01:26:42.374694 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.374613    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8g6j6"]
Jul 28 01:26:42.374694 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.374640    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4srvw"]
Jul 28 01:26:42.375018 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.374997    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4srvw"
Jul 28 01:26:42.378448 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.377931    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 01:26:42.378448 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.378088    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x7c4m\""
Jul 28 01:26:42.378448 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.378216    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 01:26:42.378893 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.378873    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 01:26:42.446237 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.446205    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-trusted-ca\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.446398 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.446248    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-image-registry-private-configuration\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.446398 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.446364    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.446523 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.446403    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-installation-pull-secrets\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.446523 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.446433    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-bound-sa-token\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.446523 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.446505    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-ca-trust-extracted\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.446685 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.446534    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7rpk\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-kube-api-access-v7rpk\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.446685 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.446578    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-certificates\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.545661 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.545589    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:26:42.547418 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.547264    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-image-registry-private-configuration\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.547418 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.547311    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxcn8\" (UniqueName: \"kubernetes.io/projected/fc5800f8-5c7e-484e-8481-54616647a748-kube-api-access-cxcn8\") pod \"dns-default-8g6j6\" (UID: \"fc5800f8-5c7e-484e-8481-54616647a748\") " pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:42.547418 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.547331    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6df4508-4b57-4b4a-8f7d-246f0af70ddb-cert\") pod \"ingress-canary-4srvw\" (UID: \"c6df4508-4b57-4b4a-8f7d-246f0af70ddb\") " pod="openshift-ingress-canary/ingress-canary-4srvw"
Jul 28 01:26:42.547418 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.547363    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7vtp\" (UniqueName: \"kubernetes.io/projected/c6df4508-4b57-4b4a-8f7d-246f0af70ddb-kube-api-access-j7vtp\") pod \"ingress-canary-4srvw\" (UID: \"c6df4508-4b57-4b4a-8f7d-246f0af70ddb\") " pod="openshift-ingress-canary/ingress-canary-4srvw"
Jul 28 01:26:42.547418 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.547409    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.547771 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.547441    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-installation-pull-secrets\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.547771 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.547468    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-bound-sa-token\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.547771 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.547508    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc5800f8-5c7e-484e-8481-54616647a748-metrics-tls\") pod \"dns-default-8g6j6\" (UID: \"fc5800f8-5c7e-484e-8481-54616647a748\") " pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:42.547771 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:42.547539    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 01:26:42.547771 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.547561    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc5800f8-5c7e-484e-8481-54616647a748-tmp-dir\") pod \"dns-default-8g6j6\" (UID: \"fc5800f8-5c7e-484e-8481-54616647a748\") " pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:42.547771 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:42.547570    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69f8c7f5fd-h56fx: secret "image-registry-tls" not found
Jul 28 01:26:42.547771 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.547588    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-ca-trust-extracted\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.547771 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.547613    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7rpk\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-kube-api-access-v7rpk\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.547771 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:42.547627    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls podName:d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef nodeName:}" failed. No retries permitted until 2026-07-28 01:26:43.047607426 +0000 UTC m=+36.064306068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls") pod "image-registry-69f8c7f5fd-h56fx" (UID: "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef") : secret "image-registry-tls" not found
Jul 28 01:26:42.548071 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.547790    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-certificates\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.548071 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.547821    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc5800f8-5c7e-484e-8481-54616647a748-config-volume\") pod \"dns-default-8g6j6\" (UID: \"fc5800f8-5c7e-484e-8481-54616647a748\") " pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:42.548071 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.547847    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-trusted-ca\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.548071 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.547894    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-ca-trust-extracted\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.548283 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.548260    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 01:26:42.548826 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.548734    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-certificates\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.549779 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.549761    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-trusted-ca\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.552310 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.552279    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-installation-pull-secrets\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.552414 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.552331    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-image-registry-private-configuration\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.555757 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.555737    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-bound-sa-token\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.556255 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.556228    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7rpk\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-kube-api-access-v7rpk\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:42.648509 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.648473    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxcn8\" (UniqueName: \"kubernetes.io/projected/fc5800f8-5c7e-484e-8481-54616647a748-kube-api-access-cxcn8\") pod \"dns-default-8g6j6\" (UID: \"fc5800f8-5c7e-484e-8481-54616647a748\") " pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:42.648509 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.648518    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6df4508-4b57-4b4a-8f7d-246f0af70ddb-cert\") pod \"ingress-canary-4srvw\" (UID: \"c6df4508-4b57-4b4a-8f7d-246f0af70ddb\") " pod="openshift-ingress-canary/ingress-canary-4srvw"
Jul 28 01:26:42.648733 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.648574    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7vtp\" (UniqueName: \"kubernetes.io/projected/c6df4508-4b57-4b4a-8f7d-246f0af70ddb-kube-api-access-j7vtp\") pod \"ingress-canary-4srvw\" (UID: \"c6df4508-4b57-4b4a-8f7d-246f0af70ddb\") " pod="openshift-ingress-canary/ingress-canary-4srvw"
Jul 28 01:26:42.648733 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.648619    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc5800f8-5c7e-484e-8481-54616647a748-metrics-tls\") pod \"dns-default-8g6j6\" (UID: \"fc5800f8-5c7e-484e-8481-54616647a748\") " pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:42.648733 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.648656    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc5800f8-5c7e-484e-8481-54616647a748-tmp-dir\") pod \"dns-default-8g6j6\" (UID: \"fc5800f8-5c7e-484e-8481-54616647a748\") " pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:42.648733 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.648690    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc5800f8-5c7e-484e-8481-54616647a748-config-volume\") pod \"dns-default-8g6j6\" (UID: \"fc5800f8-5c7e-484e-8481-54616647a748\") " pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:42.648915 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:42.648782    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:26:42.648915 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:42.648859    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc5800f8-5c7e-484e-8481-54616647a748-metrics-tls podName:fc5800f8-5c7e-484e-8481-54616647a748 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:43.148839181 +0000 UTC m=+36.165537821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc5800f8-5c7e-484e-8481-54616647a748-metrics-tls") pod "dns-default-8g6j6" (UID: "fc5800f8-5c7e-484e-8481-54616647a748") : secret "dns-default-metrics-tls" not found
Jul 28 01:26:42.649102 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.649078    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc5800f8-5c7e-484e-8481-54616647a748-tmp-dir\") pod \"dns-default-8g6j6\" (UID: \"fc5800f8-5c7e-484e-8481-54616647a748\") " pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:42.649249 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.649229    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc5800f8-5c7e-484e-8481-54616647a748-config-volume\") pod \"dns-default-8g6j6\" (UID: \"fc5800f8-5c7e-484e-8481-54616647a748\") " pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:42.651238 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.651217    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6df4508-4b57-4b4a-8f7d-246f0af70ddb-cert\") pod \"ingress-canary-4srvw\" (UID: \"c6df4508-4b57-4b4a-8f7d-246f0af70ddb\") " pod="openshift-ingress-canary/ingress-canary-4srvw"
Jul 28 01:26:42.659239 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.659220    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxcn8\" (UniqueName: \"kubernetes.io/projected/fc5800f8-5c7e-484e-8481-54616647a748-kube-api-access-cxcn8\") pod \"dns-default-8g6j6\" (UID: \"fc5800f8-5c7e-484e-8481-54616647a748\") " pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:42.659388 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.659369    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7vtp\" (UniqueName: \"kubernetes.io/projected/c6df4508-4b57-4b4a-8f7d-246f0af70ddb-kube-api-access-j7vtp\") pod \"ingress-canary-4srvw\" (UID: \"c6df4508-4b57-4b4a-8f7d-246f0af70ddb\") " pod="openshift-ingress-canary/ingress-canary-4srvw"
Jul 28 01:26:42.684274 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.684246    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4srvw"
Jul 28 01:26:42.939143 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:42.938867    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4srvw"]
Jul 28 01:26:42.980686 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:42.980662    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6df4508_4b57_4b4a_8f7d_246f0af70ddb.slice/crio-b9414ac37b841c3d1f6fe13a0c6fbc8ec897f0040cc8af9ea7eaee70ebde6c0b WatchSource:0}: Error finding container b9414ac37b841c3d1f6fe13a0c6fbc8ec897f0040cc8af9ea7eaee70ebde6c0b: Status 404 returned error can't find the container with id b9414ac37b841c3d1f6fe13a0c6fbc8ec897f0040cc8af9ea7eaee70ebde6c0b
Jul 28 01:26:43.051189 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:43.051166    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:43.051308 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:43.051289    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 01:26:43.051308 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:43.051299    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69f8c7f5fd-h56fx: secret "image-registry-tls" not found
Jul 28 01:26:43.051387 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:43.051339    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls podName:d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef nodeName:}" failed. No retries permitted until 2026-07-28 01:26:44.05132697 +0000 UTC m=+37.068025590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls") pod "image-registry-69f8c7f5fd-h56fx" (UID: "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef") : secret "image-registry-tls" not found
Jul 28 01:26:43.152498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:43.152471    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc5800f8-5c7e-484e-8481-54616647a748-metrics-tls\") pod \"dns-default-8g6j6\" (UID: \"fc5800f8-5c7e-484e-8481-54616647a748\") " pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:43.152644 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:43.152628    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:26:43.152688 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:43.152683    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc5800f8-5c7e-484e-8481-54616647a748-metrics-tls podName:fc5800f8-5c7e-484e-8481-54616647a748 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:44.152669432 +0000 UTC m=+37.169368053 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc5800f8-5c7e-484e-8481-54616647a748-metrics-tls") pod "dns-default-8g6j6" (UID: "fc5800f8-5c7e-484e-8481-54616647a748") : secret "dns-default-metrics-tls" not found
Jul 28 01:26:43.545274 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:43.545237    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:26:43.545812 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:43.545288    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:26:43.548207 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:43.548183    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 01:26:43.548359 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:43.548342    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 01:26:43.549471 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:43.549452    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 01:26:43.549683 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:43.549651    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lkkxh\""
Jul 28 01:26:43.549683 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:43.549667    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cq5js\""
Jul 28 01:26:43.732044 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:43.732012    2558 generic.go:356] "Generic (PLEG): container finished" podID="d2ead989-c1b2-42a6-9c17-e00a21d8d757" containerID="5f1915d22aa18896cb2976eb3bb00e3ab3ec21b87f35445ef495841a544a1115" exitCode=0
Jul 28 01:26:43.732220 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:43.732114    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cfrlp" event={"ID":"d2ead989-c1b2-42a6-9c17-e00a21d8d757","Type":"ContainerDied","Data":"5f1915d22aa18896cb2976eb3bb00e3ab3ec21b87f35445ef495841a544a1115"}
Jul 28 01:26:43.733420 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:43.733400    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4srvw" event={"ID":"c6df4508-4b57-4b4a-8f7d-246f0af70ddb","Type":"ContainerStarted","Data":"b9414ac37b841c3d1f6fe13a0c6fbc8ec897f0040cc8af9ea7eaee70ebde6c0b"}
Jul 28 01:26:44.058938 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:44.058897    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:44.059125 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:44.059064    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 01:26:44.059125 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:44.059087    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69f8c7f5fd-h56fx: secret "image-registry-tls" not found
Jul 28 01:26:44.059229 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:44.059156    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls podName:d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef nodeName:}" failed. No retries permitted until 2026-07-28 01:26:46.059133234 +0000 UTC m=+39.075831856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls") pod "image-registry-69f8c7f5fd-h56fx" (UID: "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef") : secret "image-registry-tls" not found
Jul 28 01:26:44.159646 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:44.159538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc5800f8-5c7e-484e-8481-54616647a748-metrics-tls\") pod \"dns-default-8g6j6\" (UID: \"fc5800f8-5c7e-484e-8481-54616647a748\") " pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:44.159807 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:44.159697    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:26:44.159807 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:44.159776    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc5800f8-5c7e-484e-8481-54616647a748-metrics-tls podName:fc5800f8-5c7e-484e-8481-54616647a748 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:46.159756911 +0000 UTC m=+39.176455545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc5800f8-5c7e-484e-8481-54616647a748-metrics-tls") pod "dns-default-8g6j6" (UID: "fc5800f8-5c7e-484e-8481-54616647a748") : secret "dns-default-metrics-tls" not found
Jul 28 01:26:44.739836 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:44.739806    2558 generic.go:356] "Generic (PLEG): container finished" podID="d2ead989-c1b2-42a6-9c17-e00a21d8d757" containerID="913c42b2b4dc5a9669cebd9f3351db3f5ea64faf7ff35f0cd681997419288f38" exitCode=0
Jul 28 01:26:44.740257 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:44.739849    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cfrlp" event={"ID":"d2ead989-c1b2-42a6-9c17-e00a21d8d757","Type":"ContainerDied","Data":"913c42b2b4dc5a9669cebd9f3351db3f5ea64faf7ff35f0cd681997419288f38"}
Jul 28 01:26:45.745583 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:45.745286    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cfrlp" event={"ID":"d2ead989-c1b2-42a6-9c17-e00a21d8d757","Type":"ContainerStarted","Data":"5666f9c34a6c61d2cb2254de2d7f5af455b706c9f06a06d359683ff32a115768"}
Jul 28 01:26:45.746880 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:45.746854    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4srvw" event={"ID":"c6df4508-4b57-4b4a-8f7d-246f0af70ddb","Type":"ContainerStarted","Data":"c963a918f7b62cf6974bc0b8c26c43035a2732d248945140680a576aee72ccad"}
Jul 28 01:26:45.770172 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:45.770128    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cfrlp" podStartSLOduration=9.155152295 podStartE2EDuration="38.770109088s" totalImagesPullingTime="29.614956793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:26:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:45.769089252 +0000 UTC m=+38.785787894" watchObservedRunningTime="2026-07-28 01:26:45.770109088 +0000 UTC m=+38.786807734"
Jul 28 01:26:45.785509 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:45.785470    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4srvw" podStartSLOduration=1.401768567 podStartE2EDuration="3.785457585s" totalImagesPullingTime="2.383689018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:45.784471939 +0000 UTC m=+38.801170583" watchObservedRunningTime="2026-07-28 01:26:45.785457585 +0000 UTC m=+38.802156227"
Jul 28 01:26:46.075488 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:46.075397    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:46.075649 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:46.075505    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 01:26:46.075649 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:46.075517    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69f8c7f5fd-h56fx: secret "image-registry-tls" not found
Jul 28 01:26:46.075649 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:46.075594    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls podName:d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef nodeName:}" failed. No retries permitted until 2026-07-28 01:26:50.075575092 +0000 UTC m=+43.092273730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls") pod "image-registry-69f8c7f5fd-h56fx" (UID: "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef") : secret "image-registry-tls" not found
Jul 28 01:26:46.175953 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:46.175921    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc5800f8-5c7e-484e-8481-54616647a748-metrics-tls\") pod \"dns-default-8g6j6\" (UID: \"fc5800f8-5c7e-484e-8481-54616647a748\") " pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:46.176095 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:46.176067    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:26:46.176142 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:46.176125    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc5800f8-5c7e-484e-8481-54616647a748-metrics-tls podName:fc5800f8-5c7e-484e-8481-54616647a748 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:50.176110927 +0000 UTC m=+43.192809551 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc5800f8-5c7e-484e-8481-54616647a748-metrics-tls") pod "dns-default-8g6j6" (UID: "fc5800f8-5c7e-484e-8481-54616647a748") : secret "dns-default-metrics-tls" not found
Jul 28 01:26:47.264612 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.264579    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mjh5h"]
Jul 28 01:26:47.286558 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.286503    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:47.287794 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.287768    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mjh5h"]
Jul 28 01:26:47.290117 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.290098    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 01:26:47.290620 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.290601    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 01:26:47.290718 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.290602    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-spb28\""
Jul 28 01:26:47.290928 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.290906    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 01:26:47.291181 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.291158    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 01:26:47.387190 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.387157    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01e345cd-8032-4983-9078-5570c9cd1e3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:47.387329 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.387207    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfk2t\" (UniqueName: \"kubernetes.io/projected/01e345cd-8032-4983-9078-5570c9cd1e3c-kube-api-access-hfk2t\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:47.387329 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.387257    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01e345cd-8032-4983-9078-5570c9cd1e3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:47.387431 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.387342    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01e345cd-8032-4983-9078-5570c9cd1e3c-data-volume\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:47.387431 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.387375    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01e345cd-8032-4983-9078-5570c9cd1e3c-crio-socket\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:47.488281 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.488253    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01e345cd-8032-4983-9078-5570c9cd1e3c-data-volume\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:47.488429 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.488290    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01e345cd-8032-4983-9078-5570c9cd1e3c-crio-socket\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:47.488429 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.488327    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01e345cd-8032-4983-9078-5570c9cd1e3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:47.488429 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.488363    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfk2t\" (UniqueName: \"kubernetes.io/projected/01e345cd-8032-4983-9078-5570c9cd1e3c-kube-api-access-hfk2t\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:47.488429 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.488404    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01e345cd-8032-4983-9078-5570c9cd1e3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:47.488612 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.488481    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01e345cd-8032-4983-9078-5570c9cd1e3c-crio-socket\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:47.488612 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:47.488492    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 01:26:47.488695 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:47.488622    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01e345cd-8032-4983-9078-5570c9cd1e3c-kube-rbac-proxy-cm podName:01e345cd-8032-4983-9078-5570c9cd1e3c nodeName:}" failed. No retries permitted until 2026-07-28 01:26:47.988599909 +0000 UTC m=+41.005298548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01e345cd-8032-4983-9078-5570c9cd1e3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mjh5h" (UID: "01e345cd-8032-4983-9078-5570c9cd1e3c") : configmap "kube-rbac-proxy" not found
Jul 28 01:26:47.488695 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:47.488505    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 01:26:47.488695 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.488642    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01e345cd-8032-4983-9078-5570c9cd1e3c-data-volume\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:47.488695 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:47.488693    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e345cd-8032-4983-9078-5570c9cd1e3c-insights-runtime-extractor-tls podName:01e345cd-8032-4983-9078-5570c9cd1e3c nodeName:}" failed. No retries permitted until 2026-07-28 01:26:47.988675719 +0000 UTC m=+41.005374344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01e345cd-8032-4983-9078-5570c9cd1e3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjh5h" (UID: "01e345cd-8032-4983-9078-5570c9cd1e3c") : secret "insights-runtime-extractor-tls" not found
Jul 28 01:26:47.502250 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.502230    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfk2t\" (UniqueName: \"kubernetes.io/projected/01e345cd-8032-4983-9078-5570c9cd1e3c-kube-api-access-hfk2t\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:47.993204 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.993168    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01e345cd-8032-4983-9078-5570c9cd1e3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:47.993362 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:47.993222    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01e345cd-8032-4983-9078-5570c9cd1e3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:47.993362 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:47.993309    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 01:26:47.993362 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:47.993314    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 01:26:47.993362 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:47.993363    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e345cd-8032-4983-9078-5570c9cd1e3c-insights-runtime-extractor-tls podName:01e345cd-8032-4983-9078-5570c9cd1e3c nodeName:}" failed. No retries permitted until 2026-07-28 01:26:48.993349581 +0000 UTC m=+42.010048203 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01e345cd-8032-4983-9078-5570c9cd1e3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjh5h" (UID: "01e345cd-8032-4983-9078-5570c9cd1e3c") : secret "insights-runtime-extractor-tls" not found
Jul 28 01:26:47.993600 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:47.993377    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01e345cd-8032-4983-9078-5570c9cd1e3c-kube-rbac-proxy-cm podName:01e345cd-8032-4983-9078-5570c9cd1e3c nodeName:}" failed. No retries permitted until 2026-07-28 01:26:48.993371325 +0000 UTC m=+42.010069947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01e345cd-8032-4983-9078-5570c9cd1e3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mjh5h" (UID: "01e345cd-8032-4983-9078-5570c9cd1e3c") : configmap "kube-rbac-proxy" not found
Jul 28 01:26:49.000526 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:49.000493    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01e345cd-8032-4983-9078-5570c9cd1e3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:49.000986 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:49.000557    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01e345cd-8032-4983-9078-5570c9cd1e3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:49.000986 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:49.000625    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 01:26:49.000986 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:49.000641    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 01:26:49.000986 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:49.000675    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01e345cd-8032-4983-9078-5570c9cd1e3c-kube-rbac-proxy-cm podName:01e345cd-8032-4983-9078-5570c9cd1e3c nodeName:}" failed. No retries permitted until 2026-07-28 01:26:51.000661777 +0000 UTC m=+44.017360398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01e345cd-8032-4983-9078-5570c9cd1e3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mjh5h" (UID: "01e345cd-8032-4983-9078-5570c9cd1e3c") : configmap "kube-rbac-proxy" not found
Jul 28 01:26:49.000986 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:49.000693    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e345cd-8032-4983-9078-5570c9cd1e3c-insights-runtime-extractor-tls podName:01e345cd-8032-4983-9078-5570c9cd1e3c nodeName:}" failed. No retries permitted until 2026-07-28 01:26:51.000681077 +0000 UTC m=+44.017379698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01e345cd-8032-4983-9078-5570c9cd1e3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjh5h" (UID: "01e345cd-8032-4983-9078-5570c9cd1e3c") : secret "insights-runtime-extractor-tls" not found
Jul 28 01:26:49.244365 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:49.244335    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j84km_b19da232-9d4c-41fe-b81a-1a34a4166a6c/dns-node-resolver/0.log"
Jul 28 01:26:49.806219 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:49.806188    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-sncxq"]
Jul 28 01:26:49.833518 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:49.833489    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-sncxq"]
Jul 28 01:26:49.833680 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:49.833611    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-sncxq"
Jul 28 01:26:49.838138 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:49.838116    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 28 01:26:49.838719 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:49.838701    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 28 01:26:49.838790 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:49.838711    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 28 01:26:49.839164 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:49.839147    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 28 01:26:49.839242 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:49.839224    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-n9qjw\""
Jul 28 01:26:49.905723 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:49.905696    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqbch\" (UniqueName: \"kubernetes.io/projected/49f26c79-5919-42a6-a698-30ac752ed31e-kube-api-access-rqbch\") pod \"service-ca-658d7b7c78-sncxq\" (UID: \"49f26c79-5919-42a6-a698-30ac752ed31e\") " pod="openshift-service-ca/service-ca-658d7b7c78-sncxq"
Jul 28 01:26:49.905809 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:49.905727    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/49f26c79-5919-42a6-a698-30ac752ed31e-signing-cabundle\") pod \"service-ca-658d7b7c78-sncxq\" (UID: \"49f26c79-5919-42a6-a698-30ac752ed31e\") " pod="openshift-service-ca/service-ca-658d7b7c78-sncxq"
Jul 28 01:26:49.905809 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:49.905767    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/49f26c79-5919-42a6-a698-30ac752ed31e-signing-key\") pod \"service-ca-658d7b7c78-sncxq\" (UID: \"49f26c79-5919-42a6-a698-30ac752ed31e\") " pod="openshift-service-ca/service-ca-658d7b7c78-sncxq"
Jul 28 01:26:50.006127 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:50.006103    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqbch\" (UniqueName: \"kubernetes.io/projected/49f26c79-5919-42a6-a698-30ac752ed31e-kube-api-access-rqbch\") pod \"service-ca-658d7b7c78-sncxq\" (UID: \"49f26c79-5919-42a6-a698-30ac752ed31e\") " pod="openshift-service-ca/service-ca-658d7b7c78-sncxq"
Jul 28 01:26:50.006413 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:50.006132    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/49f26c79-5919-42a6-a698-30ac752ed31e-signing-cabundle\") pod \"service-ca-658d7b7c78-sncxq\" (UID: \"49f26c79-5919-42a6-a698-30ac752ed31e\") " pod="openshift-service-ca/service-ca-658d7b7c78-sncxq"
Jul 28 01:26:50.006413 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:50.006165    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/49f26c79-5919-42a6-a698-30ac752ed31e-signing-key\") pod \"service-ca-658d7b7c78-sncxq\" (UID: \"49f26c79-5919-42a6-a698-30ac752ed31e\") " pod="openshift-service-ca/service-ca-658d7b7c78-sncxq"
Jul 28 01:26:50.006815 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:50.006794    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/49f26c79-5919-42a6-a698-30ac752ed31e-signing-cabundle\") pod \"service-ca-658d7b7c78-sncxq\" (UID: \"49f26c79-5919-42a6-a698-30ac752ed31e\") " pod="openshift-service-ca/service-ca-658d7b7c78-sncxq"
Jul 28 01:26:50.008645 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:50.008629    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/49f26c79-5919-42a6-a698-30ac752ed31e-signing-key\") pod \"service-ca-658d7b7c78-sncxq\" (UID: \"49f26c79-5919-42a6-a698-30ac752ed31e\") " pod="openshift-service-ca/service-ca-658d7b7c78-sncxq"
Jul 28 01:26:50.019601 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:50.019583    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqbch\" (UniqueName: \"kubernetes.io/projected/49f26c79-5919-42a6-a698-30ac752ed31e-kube-api-access-rqbch\") pod \"service-ca-658d7b7c78-sncxq\" (UID: \"49f26c79-5919-42a6-a698-30ac752ed31e\") " pod="openshift-service-ca/service-ca-658d7b7c78-sncxq"
Jul 28 01:26:50.047740 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:50.047723    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9kp6b_20045825-79f7-46f4-917d-2846016a45b2/node-ca/0.log"
Jul 28 01:26:50.106706 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:50.106649    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:50.106805 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:50.106790    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 01:26:50.106841 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:50.106808    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69f8c7f5fd-h56fx: secret "image-registry-tls" not found
Jul 28 01:26:50.106870 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:50.106855    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls podName:d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef nodeName:}" failed. No retries permitted until 2026-07-28 01:26:58.106842999 +0000 UTC m=+51.123541624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls") pod "image-registry-69f8c7f5fd-h56fx" (UID: "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef") : secret "image-registry-tls" not found
Jul 28 01:26:50.142509 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:50.142486    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-sncxq"
Jul 28 01:26:50.207389 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:50.207359    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc5800f8-5c7e-484e-8481-54616647a748-metrics-tls\") pod \"dns-default-8g6j6\" (UID: \"fc5800f8-5c7e-484e-8481-54616647a748\") " pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:50.207706 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:50.207687    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:26:50.207859 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:50.207848    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc5800f8-5c7e-484e-8481-54616647a748-metrics-tls podName:fc5800f8-5c7e-484e-8481-54616647a748 nodeName:}" failed. No retries permitted until 2026-07-28 01:26:58.207827395 +0000 UTC m=+51.224526021 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc5800f8-5c7e-484e-8481-54616647a748-metrics-tls") pod "dns-default-8g6j6" (UID: "fc5800f8-5c7e-484e-8481-54616647a748") : secret "dns-default-metrics-tls" not found
Jul 28 01:26:50.301353 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:50.301202    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-sncxq"]
Jul 28 01:26:50.303259 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:50.303234    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f26c79_5919_42a6_a698_30ac752ed31e.slice/crio-c8452ebe4802785388eb221bf1773b292bbd00ea3392a037ea06a16aafa99272 WatchSource:0}: Error finding container c8452ebe4802785388eb221bf1773b292bbd00ea3392a037ea06a16aafa99272: Status 404 returned error can't find the container with id c8452ebe4802785388eb221bf1773b292bbd00ea3392a037ea06a16aafa99272
Jul 28 01:26:50.759374 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:50.759335    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-sncxq" event={"ID":"49f26c79-5919-42a6-a698-30ac752ed31e","Type":"ContainerStarted","Data":"c8452ebe4802785388eb221bf1773b292bbd00ea3392a037ea06a16aafa99272"}
Jul 28 01:26:50.848059 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:50.848018    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4srvw_c6df4508-4b57-4b4a-8f7d-246f0af70ddb/serve-healthcheck-canary/0.log"
Jul 28 01:26:51.012335 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:51.012261    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01e345cd-8032-4983-9078-5570c9cd1e3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:51.012335 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:51.012325    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01e345cd-8032-4983-9078-5570c9cd1e3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:51.012830 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:51.012411    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 01:26:51.012830 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:51.012416    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 01:26:51.012830 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:51.012491    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01e345cd-8032-4983-9078-5570c9cd1e3c-kube-rbac-proxy-cm podName:01e345cd-8032-4983-9078-5570c9cd1e3c nodeName:}" failed. No retries permitted until 2026-07-28 01:26:55.012470658 +0000 UTC m=+48.029169293 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01e345cd-8032-4983-9078-5570c9cd1e3c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mjh5h" (UID: "01e345cd-8032-4983-9078-5570c9cd1e3c") : configmap "kube-rbac-proxy" not found
Jul 28 01:26:51.012830 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:51.012512    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e345cd-8032-4983-9078-5570c9cd1e3c-insights-runtime-extractor-tls podName:01e345cd-8032-4983-9078-5570c9cd1e3c nodeName:}" failed. No retries permitted until 2026-07-28 01:26:55.01250207 +0000 UTC m=+48.029200706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01e345cd-8032-4983-9078-5570c9cd1e3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjh5h" (UID: "01e345cd-8032-4983-9078-5570c9cd1e3c") : secret "insights-runtime-extractor-tls" not found
Jul 28 01:26:53.768625 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:53.768591    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-sncxq" event={"ID":"49f26c79-5919-42a6-a698-30ac752ed31e","Type":"ContainerStarted","Data":"0b937e4608abb4c64de5010d4b3ce21594c68398d82ce88a1758f20927ac04d5"}
Jul 28 01:26:53.801777 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:53.801730    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-sncxq" podStartSLOduration=2.102496071 podStartE2EDuration="4.801714763s" totalImagesPullingTime="2.699218692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:53.801401417 +0000 UTC m=+46.818100060" watchObservedRunningTime="2026-07-28 01:26:53.801714763 +0000 UTC m=+46.818413406"
Jul 28 01:26:55.039783 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:55.039750    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01e345cd-8032-4983-9078-5570c9cd1e3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:55.040146 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:55.039825    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01e345cd-8032-4983-9078-5570c9cd1e3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:55.040146 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:55.039926    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 01:26:55.040146 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:26:55.039981    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e345cd-8032-4983-9078-5570c9cd1e3c-insights-runtime-extractor-tls podName:01e345cd-8032-4983-9078-5570c9cd1e3c nodeName:}" failed. No retries permitted until 2026-07-28 01:27:03.039965854 +0000 UTC m=+56.056664495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01e345cd-8032-4983-9078-5570c9cd1e3c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjh5h" (UID: "01e345cd-8032-4983-9078-5570c9cd1e3c") : secret "insights-runtime-extractor-tls" not found
Jul 28 01:26:55.040386 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:55.040282    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01e345cd-8032-4983-9078-5570c9cd1e3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:26:58.162916 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:58.162879    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:58.165416 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:58.165396    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls\") pod \"image-registry-69f8c7f5fd-h56fx\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") " pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:58.258627 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:58.258591    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:58.263592 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:58.263569    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc5800f8-5c7e-484e-8481-54616647a748-metrics-tls\") pod \"dns-default-8g6j6\" (UID: \"fc5800f8-5c7e-484e-8481-54616647a748\") " pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:58.265902 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:58.265880    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc5800f8-5c7e-484e-8481-54616647a748-metrics-tls\") pod \"dns-default-8g6j6\" (UID: \"fc5800f8-5c7e-484e-8481-54616647a748\") " pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:58.270837 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:58.270816    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:26:58.407212 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:58.407187    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69f8c7f5fd-h56fx"]
Jul 28 01:26:58.408792 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:58.408760    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c4276b_9f6f_4a9a_b3e0_7804bc4f35ef.slice/crio-956f807c8adbaa1a9df8ddcb13d0f62260b691b279debaca86650645d41cb736 WatchSource:0}: Error finding container 956f807c8adbaa1a9df8ddcb13d0f62260b691b279debaca86650645d41cb736: Status 404 returned error can't find the container with id 956f807c8adbaa1a9df8ddcb13d0f62260b691b279debaca86650645d41cb736
Jul 28 01:26:58.425203 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:58.425180    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8g6j6"]
Jul 28 01:26:58.437511 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:26:58.437480    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc5800f8_5c7e_484e_8481_54616647a748.slice/crio-f08516eb4d73dd6076dd5cafe34a15c2b7270813fc98e1a63b1049989c408ef1 WatchSource:0}: Error finding container f08516eb4d73dd6076dd5cafe34a15c2b7270813fc98e1a63b1049989c408ef1: Status 404 returned error can't find the container with id f08516eb4d73dd6076dd5cafe34a15c2b7270813fc98e1a63b1049989c408ef1
Jul 28 01:26:58.783015 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:58.782972    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8g6j6" event={"ID":"fc5800f8-5c7e-484e-8481-54616647a748","Type":"ContainerStarted","Data":"f08516eb4d73dd6076dd5cafe34a15c2b7270813fc98e1a63b1049989c408ef1"}
Jul 28 01:26:58.784573 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:58.784526    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx" event={"ID":"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef","Type":"ContainerStarted","Data":"18549806fa41d38e145376311f2712419e47e826cf1913a68324f077c326e597"}
Jul 28 01:26:58.784573 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:58.784587    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx" event={"ID":"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef","Type":"ContainerStarted","Data":"956f807c8adbaa1a9df8ddcb13d0f62260b691b279debaca86650645d41cb736"}
Jul 28 01:26:58.784795 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:58.784680    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:26:58.805704 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:26:58.805651    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx" podStartSLOduration=35.805631842 podStartE2EDuration="35.805631842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:58.805036119 +0000 UTC m=+51.821734763" watchObservedRunningTime="2026-07-28 01:26:58.805631842 +0000 UTC m=+51.822330486"
Jul 28 01:27:00.791748 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:00.791712    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8g6j6" event={"ID":"fc5800f8-5c7e-484e-8481-54616647a748","Type":"ContainerStarted","Data":"43b9db40d8965128f8bfaa288ad0a90362f2d80f375e9f9e94f0fb634839eab1"}
Jul 28 01:27:00.792225 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:00.791803    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8g6j6" event={"ID":"fc5800f8-5c7e-484e-8481-54616647a748","Type":"ContainerStarted","Data":"c2de27cfde6b74679c88c37806045831cfabfdcb83c8bf80691b1445e8ba73d2"}
Jul 28 01:27:00.792225 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:00.791849    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:27:00.811736 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:00.811690    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8g6j6" podStartSLOduration=17.329693415 podStartE2EDuration="18.811677569s" totalImagesPullingTime="1.481984154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:00.8110787 +0000 UTC m=+53.827777343" watchObservedRunningTime="2026-07-28 01:27:00.811677569 +0000 UTC m=+53.828376211"
Jul 28 01:27:03.105691 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:03.105652    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01e345cd-8032-4983-9078-5570c9cd1e3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:27:03.108070 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:03.108050    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01e345cd-8032-4983-9078-5570c9cd1e3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjh5h\" (UID: \"01e345cd-8032-4983-9078-5570c9cd1e3c\") " pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:27:03.196126 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:03.196086    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mjh5h"
Jul 28 01:27:03.361417 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:03.361348    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mjh5h"]
Jul 28 01:27:03.371034 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:27:03.371001    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01e345cd_8032_4983_9078_5570c9cd1e3c.slice/crio-e8860970e9725cd1e1fff26edb8a1e108633e791763dae58a255d1703fc636ba WatchSource:0}: Error finding container e8860970e9725cd1e1fff26edb8a1e108633e791763dae58a255d1703fc636ba: Status 404 returned error can't find the container with id e8860970e9725cd1e1fff26edb8a1e108633e791763dae58a255d1703fc636ba
Jul 28 01:27:03.802798 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:03.802762    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjh5h" event={"ID":"01e345cd-8032-4983-9078-5570c9cd1e3c","Type":"ContainerStarted","Data":"e8860970e9725cd1e1fff26edb8a1e108633e791763dae58a255d1703fc636ba"}
Jul 28 01:27:07.723706 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:07.723675    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xftxq"
Jul 28 01:27:08.822310 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:08.822269    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjh5h" event={"ID":"01e345cd-8032-4983-9078-5570c9cd1e3c","Type":"ContainerStarted","Data":"2fb2b39d3b49a561c30db5e57b83e423ded31022a4dbe39b8bdf7cad54ee6716"}
Jul 28 01:27:10.798120 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:10.798093    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8g6j6"
Jul 28 01:27:11.834185 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:11.834107    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjh5h" event={"ID":"01e345cd-8032-4983-9078-5570c9cd1e3c","Type":"ContainerStarted","Data":"4d74ed250b9eadd93946b966532939adfb306868a23fdf922708eaff63dc495a"}
Jul 28 01:27:12.873027 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:12.872995    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fb67f78-zp9dk"]
Jul 28 01:27:12.875208 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:12.875187    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fb67f78-zp9dk"
Jul 28 01:27:12.879341 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:12.879315    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 01:27:12.879472 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:12.879387    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 01:27:12.879533 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:12.879504    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2kh4z\""
Jul 28 01:27:12.879643 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:12.879324    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 28 01:27:12.879688 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:12.879633    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 01:27:12.895323 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:12.895302    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fb67f78-zp9dk"]
Jul 28 01:27:12.919093 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:12.919066    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69f8c7f5fd-h56fx"]
Jul 28 01:27:12.980668 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:12.980641    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drkng\" (UniqueName: \"kubernetes.io/projected/4d6c95ac-3e81-4d33-b35f-fc881a71f5eb-kube-api-access-drkng\") pod \"managed-serviceaccount-addon-agent-59fb67f78-zp9dk\" (UID: \"4d6c95ac-3e81-4d33-b35f-fc881a71f5eb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fb67f78-zp9dk"
Jul 28 01:27:12.980781 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:12.980681    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d6c95ac-3e81-4d33-b35f-fc881a71f5eb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59fb67f78-zp9dk\" (UID: \"4d6c95ac-3e81-4d33-b35f-fc881a71f5eb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fb67f78-zp9dk"
Jul 28 01:27:12.983642 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:12.983620    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-dm7d9"]
Jul 28 01:27:12.985573 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:12.985536    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-dm7d9"
Jul 28 01:27:12.989781 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:12.989764    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 01:27:12.989897 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:12.989880    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lpbgs\""
Jul 28 01:27:12.990669 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:12.990654    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 01:27:13.014186 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.014161    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-dm7d9"]
Jul 28 01:27:13.081300 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.081270    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drkng\" (UniqueName: \"kubernetes.io/projected/4d6c95ac-3e81-4d33-b35f-fc881a71f5eb-kube-api-access-drkng\") pod \"managed-serviceaccount-addon-agent-59fb67f78-zp9dk\" (UID: \"4d6c95ac-3e81-4d33-b35f-fc881a71f5eb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fb67f78-zp9dk"
Jul 28 01:27:13.081450 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.081333    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d6c95ac-3e81-4d33-b35f-fc881a71f5eb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59fb67f78-zp9dk\" (UID: \"4d6c95ac-3e81-4d33-b35f-fc881a71f5eb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fb67f78-zp9dk"
Jul 28 01:27:13.081450 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.081385    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k48x5\" (UniqueName: \"kubernetes.io/projected/4fc7091d-0514-4ace-b06a-5d5553701527-kube-api-access-k48x5\") pod \"downloads-7c97dc4555-dm7d9\" (UID: \"4fc7091d-0514-4ace-b06a-5d5553701527\") " pod="openshift-console/downloads-7c97dc4555-dm7d9"
Jul 28 01:27:13.084258 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.084236    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d6c95ac-3e81-4d33-b35f-fc881a71f5eb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59fb67f78-zp9dk\" (UID: \"4d6c95ac-3e81-4d33-b35f-fc881a71f5eb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fb67f78-zp9dk"
Jul 28 01:27:13.085806 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.085779    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54d68ff985-nmq2c"]
Jul 28 01:27:13.087655 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.087637    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.106969 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.106945    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54d68ff985-nmq2c"]
Jul 28 01:27:13.107801 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.107777    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drkng\" (UniqueName: \"kubernetes.io/projected/4d6c95ac-3e81-4d33-b35f-fc881a71f5eb-kube-api-access-drkng\") pod \"managed-serviceaccount-addon-agent-59fb67f78-zp9dk\" (UID: \"4d6c95ac-3e81-4d33-b35f-fc881a71f5eb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fb67f78-zp9dk"
Jul 28 01:27:13.182377 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.182293    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0895846-cecf-467d-b179-0bc9d9211934-bound-sa-token\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.182377 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.182361    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0895846-cecf-467d-b179-0bc9d9211934-trusted-ca\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.182635 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.182421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0895846-cecf-467d-b179-0bc9d9211934-image-registry-private-configuration\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.182635 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.182525    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0895846-cecf-467d-b179-0bc9d9211934-installation-pull-secrets\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.182731 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.182642    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27xqp\" (UniqueName: \"kubernetes.io/projected/f0895846-cecf-467d-b179-0bc9d9211934-kube-api-access-27xqp\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.182731 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.182687    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0895846-cecf-467d-b179-0bc9d9211934-registry-tls\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.182731 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.182711    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0895846-cecf-467d-b179-0bc9d9211934-ca-trust-extracted\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.182845 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.182756    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0895846-cecf-467d-b179-0bc9d9211934-registry-certificates\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.182845 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.182787    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k48x5\" (UniqueName: \"kubernetes.io/projected/4fc7091d-0514-4ace-b06a-5d5553701527-kube-api-access-k48x5\") pod \"downloads-7c97dc4555-dm7d9\" (UID: \"4fc7091d-0514-4ace-b06a-5d5553701527\") " pod="openshift-console/downloads-7c97dc4555-dm7d9"
Jul 28 01:27:13.191316 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.191283    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fb67f78-zp9dk"
Jul 28 01:27:13.201261 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.201240    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k48x5\" (UniqueName: \"kubernetes.io/projected/4fc7091d-0514-4ace-b06a-5d5553701527-kube-api-access-k48x5\") pod \"downloads-7c97dc4555-dm7d9\" (UID: \"4fc7091d-0514-4ace-b06a-5d5553701527\") " pod="openshift-console/downloads-7c97dc4555-dm7d9"
Jul 28 01:27:13.284106 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.284079    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0895846-cecf-467d-b179-0bc9d9211934-bound-sa-token\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.284237 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.284122    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0895846-cecf-467d-b179-0bc9d9211934-trusted-ca\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.284237 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.284151    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0895846-cecf-467d-b179-0bc9d9211934-image-registry-private-configuration\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.284237 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.284171    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0895846-cecf-467d-b179-0bc9d9211934-installation-pull-secrets\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.284237 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.284202    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27xqp\" (UniqueName: \"kubernetes.io/projected/f0895846-cecf-467d-b179-0bc9d9211934-kube-api-access-27xqp\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.284237 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.284222    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0895846-cecf-467d-b179-0bc9d9211934-registry-tls\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.284237 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.284236    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0895846-cecf-467d-b179-0bc9d9211934-ca-trust-extracted\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.284519 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.284254    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0895846-cecf-467d-b179-0bc9d9211934-registry-certificates\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.284990 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.284961    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0895846-cecf-467d-b179-0bc9d9211934-ca-trust-extracted\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.285152 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.285092    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0895846-cecf-467d-b179-0bc9d9211934-registry-certificates\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.285473 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.285449    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0895846-cecf-467d-b179-0bc9d9211934-trusted-ca\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.287901 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.287878    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0895846-cecf-467d-b179-0bc9d9211934-installation-pull-secrets\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.287997 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.287878    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0895846-cecf-467d-b179-0bc9d9211934-image-registry-private-configuration\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.288947 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.288926    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0895846-cecf-467d-b179-0bc9d9211934-registry-tls\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.296168 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.295953    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-dm7d9"
Jul 28 01:27:13.298127 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.298104    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0895846-cecf-467d-b179-0bc9d9211934-bound-sa-token\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.298608 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.298110    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27xqp\" (UniqueName: \"kubernetes.io/projected/f0895846-cecf-467d-b179-0bc9d9211934-kube-api-access-27xqp\") pod \"image-registry-54d68ff985-nmq2c\" (UID: \"f0895846-cecf-467d-b179-0bc9d9211934\") " pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.331105 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.331069    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fb67f78-zp9dk"]
Jul 28 01:27:13.385078 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.385053    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs\") pod \"network-metrics-daemon-lmrxw\" (UID: \"b94d344e-9357-41ea-a7a7-36490cfe27bd\") " pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:27:13.385235 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.385103    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkt9r\" (UniqueName: \"kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r\") pod \"network-check-target-b262s\" (UID: \"78f08e99-cb7b-4f45-9713-9afd7f2fad94\") " pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:27:13.385235 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.385129    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret\") pod \"global-pull-secret-syncer-mg49d\" (UID: \"78c22c72-ea97-4178-a43b-b731dd3956b7\") " pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:27:13.387778 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.387678    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 01:27:13.387917 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.387681    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 01:27:13.388053 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.388036    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 01:27:13.397772 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.397752    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c22c72-ea97-4178-a43b-b731dd3956b7-original-pull-secret\") pod \"global-pull-secret-syncer-mg49d\" (UID: \"78c22c72-ea97-4178-a43b-b731dd3956b7\") " pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:27:13.397900 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.397863    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 01:27:13.397992 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.397974    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:13.398124 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.398108    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b94d344e-9357-41ea-a7a7-36490cfe27bd-metrics-certs\") pod \"network-metrics-daemon-lmrxw\" (UID: \"b94d344e-9357-41ea-a7a7-36490cfe27bd\") " pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:27:13.408719 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.408671    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkt9r\" (UniqueName: \"kubernetes.io/projected/78f08e99-cb7b-4f45-9713-9afd7f2fad94-kube-api-access-tkt9r\") pod \"network-check-target-b262s\" (UID: \"78f08e99-cb7b-4f45-9713-9afd7f2fad94\") " pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:27:13.468307 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.468282    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg49d"
Jul 28 01:27:13.567900 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.567871    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cq5js\""
Jul 28 01:27:13.574008 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.573985    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lkkxh\""
Jul 28 01:27:13.575798 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.575782    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmrxw"
Jul 28 01:27:13.582715 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:13.582697    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:27:14.946393 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:27:14.946334    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d6c95ac_3e81_4d33_b35f_fc881a71f5eb.slice/crio-0ca048a47b8b0533565ef238ee959fa942a1567a1b6dc1d71f70b6f1a8917b1e WatchSource:0}: Error finding container 0ca048a47b8b0533565ef238ee959fa942a1567a1b6dc1d71f70b6f1a8917b1e: Status 404 returned error can't find the container with id 0ca048a47b8b0533565ef238ee959fa942a1567a1b6dc1d71f70b6f1a8917b1e
Jul 28 01:27:15.132043 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:15.132000    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-dm7d9"]
Jul 28 01:27:15.136744 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:27:15.136528    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc7091d_0514_4ace_b06a_5d5553701527.slice/crio-2e27bc76b0ba03f085b6f67ccb3a2363f779727ee9aed34e99f89930cf7116c5 WatchSource:0}: Error finding container 2e27bc76b0ba03f085b6f67ccb3a2363f779727ee9aed34e99f89930cf7116c5: Status 404 returned error can't find the container with id 2e27bc76b0ba03f085b6f67ccb3a2363f779727ee9aed34e99f89930cf7116c5
Jul 28 01:27:15.147424 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:15.147395    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mg49d"]
Jul 28 01:27:15.152488 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:15.152465    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54d68ff985-nmq2c"]
Jul 28 01:27:15.162154 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:27:15.162102    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c22c72_ea97_4178_a43b_b731dd3956b7.slice/crio-4c7d5de9c833e9a85ed294466aeba39bfac4d725dc739efdf2b0fe6ff55051d4 WatchSource:0}: Error finding container 4c7d5de9c833e9a85ed294466aeba39bfac4d725dc739efdf2b0fe6ff55051d4: Status 404 returned error can't find the container with id 4c7d5de9c833e9a85ed294466aeba39bfac4d725dc739efdf2b0fe6ff55051d4
Jul 28 01:27:15.162969 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:27:15.162904    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0895846_cecf_467d_b179_0bc9d9211934.slice/crio-5658f9db74f1c624545948d865f280a85a9da88b44d4eca81bf05c0403133053 WatchSource:0}: Error finding container 5658f9db74f1c624545948d865f280a85a9da88b44d4eca81bf05c0403133053: Status 404 returned error can't find the container with id 5658f9db74f1c624545948d865f280a85a9da88b44d4eca81bf05c0403133053
Jul 28 01:27:15.188457 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:15.188427    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b262s"]
Jul 28 01:27:15.188587 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:15.188497    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lmrxw"]
Jul 28 01:27:15.191110 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:27:15.191075    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78f08e99_cb7b_4f45_9713_9afd7f2fad94.slice/crio-2aa5de6a6adf69ae8aad5c6840f8dee866b1e696a57d76d82b1dd0d0b48982ec WatchSource:0}: Error finding container 2aa5de6a6adf69ae8aad5c6840f8dee866b1e696a57d76d82b1dd0d0b48982ec: Status 404 returned error can't find the container with id 2aa5de6a6adf69ae8aad5c6840f8dee866b1e696a57d76d82b1dd0d0b48982ec
Jul 28 01:27:15.191503 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:27:15.191485    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb94d344e_9357_41ea_a7a7_36490cfe27bd.slice/crio-cd90c635dd3d6aa8a2aeceb6a091bf548f90a2374e0b45440c87b592de96c205 WatchSource:0}: Error finding container cd90c635dd3d6aa8a2aeceb6a091bf548f90a2374e0b45440c87b592de96c205: Status 404 returned error can't find the container with id cd90c635dd3d6aa8a2aeceb6a091bf548f90a2374e0b45440c87b592de96c205
Jul 28 01:27:15.857302 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:15.857254    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjh5h" event={"ID":"01e345cd-8032-4983-9078-5570c9cd1e3c","Type":"ContainerStarted","Data":"a6064afcd46a51f3fc5933cd5151144395fda327ed88b2075b26e91ed3600e67"}
Jul 28 01:27:15.860538 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:15.860453    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lmrxw" event={"ID":"b94d344e-9357-41ea-a7a7-36490cfe27bd","Type":"ContainerStarted","Data":"cd90c635dd3d6aa8a2aeceb6a091bf548f90a2374e0b45440c87b592de96c205"}
Jul 28 01:27:15.863486 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:15.863415    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b262s" event={"ID":"78f08e99-cb7b-4f45-9713-9afd7f2fad94","Type":"ContainerStarted","Data":"2aa5de6a6adf69ae8aad5c6840f8dee866b1e696a57d76d82b1dd0d0b48982ec"}
Jul 28 01:27:15.867306 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:15.867243    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-dm7d9" event={"ID":"4fc7091d-0514-4ace-b06a-5d5553701527","Type":"ContainerStarted","Data":"2e27bc76b0ba03f085b6f67ccb3a2363f779727ee9aed34e99f89930cf7116c5"}
Jul 28 01:27:15.875178 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:15.875069    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mg49d" event={"ID":"78c22c72-ea97-4178-a43b-b731dd3956b7","Type":"ContainerStarted","Data":"4c7d5de9c833e9a85ed294466aeba39bfac4d725dc739efdf2b0fe6ff55051d4"}
Jul 28 01:27:15.882306 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:15.881403    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mjh5h" podStartSLOduration=17.285083009 podStartE2EDuration="28.881384398s" totalImagesPullingTime="11.596301389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:26:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:15.880135464 +0000 UTC m=+68.896834107" watchObservedRunningTime="2026-07-28 01:27:15.881384398 +0000 UTC m=+68.898083041"
Jul 28 01:27:15.883628 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:15.882865    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54d68ff985-nmq2c" event={"ID":"f0895846-cecf-467d-b179-0bc9d9211934","Type":"ContainerStarted","Data":"5bf8cf7870ad9162a1141a6e66edc48c37cac4983b441ff1ee97b46ea0f1f1af"}
Jul 28 01:27:15.883628 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:15.882909    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54d68ff985-nmq2c" event={"ID":"f0895846-cecf-467d-b179-0bc9d9211934","Type":"ContainerStarted","Data":"5658f9db74f1c624545948d865f280a85a9da88b44d4eca81bf05c0403133053"}
Jul 28 01:27:15.883628 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:15.883579    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:15.885003 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:15.884973    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fb67f78-zp9dk" event={"ID":"4d6c95ac-3e81-4d33-b35f-fc881a71f5eb","Type":"ContainerStarted","Data":"0ca048a47b8b0533565ef238ee959fa942a1567a1b6dc1d71f70b6f1a8917b1e"}
Jul 28 01:27:15.906138 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:15.905502    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54d68ff985-nmq2c" podStartSLOduration=2.905485595 podStartE2EDuration="2.905485595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:15.904732569 +0000 UTC m=+68.921431214" watchObservedRunningTime="2026-07-28 01:27:15.905485595 +0000 UTC m=+68.922184239"
Jul 28 01:27:17.121834 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:17.121785    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-45q88"]
Jul 28 01:27:17.138574 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:17.138534    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-45q88"]
Jul 28 01:27:17.138726 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:17.138676    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-45q88"
Jul 28 01:27:17.142918 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:17.142702    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ps8tp\""
Jul 28 01:27:17.142918 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:17.142746    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 28 01:27:17.220515 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:17.220481    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0040b8c9-9c71-4ac7-9bb8-3dff7ad139c6-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-45q88\" (UID: \"0040b8c9-9c71-4ac7-9bb8-3dff7ad139c6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-45q88"
Jul 28 01:27:17.321690 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:17.321649    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0040b8c9-9c71-4ac7-9bb8-3dff7ad139c6-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-45q88\" (UID: \"0040b8c9-9c71-4ac7-9bb8-3dff7ad139c6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-45q88"
Jul 28 01:27:17.325332 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:17.325302    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0040b8c9-9c71-4ac7-9bb8-3dff7ad139c6-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-45q88\" (UID: \"0040b8c9-9c71-4ac7-9bb8-3dff7ad139c6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-45q88"
Jul 28 01:27:17.453455 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:17.453426    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-45q88"
Jul 28 01:27:21.789120 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:21.789088    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-45q88"]
Jul 28 01:27:21.794074 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:27:21.794043    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0040b8c9_9c71_4ac7_9bb8_3dff7ad139c6.slice/crio-b9239b81213e4d176162b755cdd726a3ce18709e7a862a714379ab49516d17f3 WatchSource:0}: Error finding container b9239b81213e4d176162b755cdd726a3ce18709e7a862a714379ab49516d17f3: Status 404 returned error can't find the container with id b9239b81213e4d176162b755cdd726a3ce18709e7a862a714379ab49516d17f3
Jul 28 01:27:21.911911 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:21.911871    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lmrxw" event={"ID":"b94d344e-9357-41ea-a7a7-36490cfe27bd","Type":"ContainerStarted","Data":"d75b73413fff957d7681038a53b0758640914e92d8bb51ab0b1e96f70e23b2a1"}
Jul 28 01:27:21.912074 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:21.911938    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lmrxw" event={"ID":"b94d344e-9357-41ea-a7a7-36490cfe27bd","Type":"ContainerStarted","Data":"a015e91c6d6228759584ce337622840268f610b917d02a3ad22d93eaf29cd4d2"}
Jul 28 01:27:21.913948 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:21.913922    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b262s" event={"ID":"78f08e99-cb7b-4f45-9713-9afd7f2fad94","Type":"ContainerStarted","Data":"093c6ebb1ed686cf3ada73829ed9611eb0e31174198d14e78732a95fbf97657f"}
Jul 28 01:27:21.914346 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:21.914328    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:27:21.916334 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:21.916241    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mg49d" event={"ID":"78c22c72-ea97-4178-a43b-b731dd3956b7","Type":"ContainerStarted","Data":"c6e073443ba2751e1e424d7689e8fba97ce8433c4e3a20bb79024af4967a0983"}
Jul 28 01:27:21.918287 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:21.918244    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fb67f78-zp9dk" event={"ID":"4d6c95ac-3e81-4d33-b35f-fc881a71f5eb","Type":"ContainerStarted","Data":"f06fb3104709505e52b8546c88d9fa08f9aa55f351d313e7b1f5ee4003684b49"}
Jul 28 01:27:21.919475 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:21.919457    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-45q88" event={"ID":"0040b8c9-9c71-4ac7-9bb8-3dff7ad139c6","Type":"ContainerStarted","Data":"b9239b81213e4d176162b755cdd726a3ce18709e7a862a714379ab49516d17f3"}
Jul 28 01:27:21.928267 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:21.928219    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lmrxw" podStartSLOduration=68.495085288 podStartE2EDuration="1m14.928202159s" totalImagesPullingTime="6.433116871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:21.927094316 +0000 UTC m=+74.943792962" watchObservedRunningTime="2026-07-28 01:27:21.928202159 +0000 UTC m=+74.944900804"
Jul 28 01:27:21.943499 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:21.943294    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fb67f78-zp9dk" podStartSLOduration=3.24769137 podStartE2EDuration="9.943277519s" totalImagesPullingTime="6.695586149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:21.942474418 +0000 UTC m=+74.959173056" watchObservedRunningTime="2026-07-28 01:27:21.943277519 +0000 UTC m=+74.959976164"
Jul 28 01:27:21.965282 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:21.964908    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mg49d" podStartSLOduration=68.457269654 podStartE2EDuration="1m14.964896997s" totalImagesPullingTime="6.507627343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:21.964170854 +0000 UTC m=+74.980869498" watchObservedRunningTime="2026-07-28 01:27:21.964896997 +0000 UTC m=+74.981595642"
Jul 28 01:27:21.983780 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:21.983730    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b262s" podStartSLOduration=68.529108213 podStartE2EDuration="1m14.983711478s" totalImagesPullingTime="6.454603265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:21.98296163 +0000 UTC m=+74.999660275" watchObservedRunningTime="2026-07-28 01:27:21.983711478 +0000 UTC m=+75.000410122"
Jul 28 01:27:22.283199 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.283158    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c9ffcc896-fdssk"]
Jul 28 01:27:22.285619 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.285595    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.288366 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.288340    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 01:27:22.288699 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.288677    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 01:27:22.289604 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.289583    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 01:27:22.289681 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.289628    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 01:27:22.289719 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.289582    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x9z89\""
Jul 28 01:27:22.290558 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.290517    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 01:27:22.297384 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.297364    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c9ffcc896-fdssk"]
Jul 28 01:27:22.363150 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.363117    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02dfa4d4-d67e-4ddc-8681-38163a849a7e-console-oauth-config\") pod \"console-5c9ffcc896-fdssk\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") " pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.363305 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.363171    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02dfa4d4-d67e-4ddc-8681-38163a849a7e-console-serving-cert\") pod \"console-5c9ffcc896-fdssk\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") " pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.363305 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.363221    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02dfa4d4-d67e-4ddc-8681-38163a849a7e-service-ca\") pod \"console-5c9ffcc896-fdssk\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") " pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.363305 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.363261    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txrlb\" (UniqueName: \"kubernetes.io/projected/02dfa4d4-d67e-4ddc-8681-38163a849a7e-kube-api-access-txrlb\") pod \"console-5c9ffcc896-fdssk\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") " pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.363305 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.363290    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02dfa4d4-d67e-4ddc-8681-38163a849a7e-oauth-serving-cert\") pod \"console-5c9ffcc896-fdssk\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") " pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.363525 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.363316    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02dfa4d4-d67e-4ddc-8681-38163a849a7e-console-config\") pod \"console-5c9ffcc896-fdssk\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") " pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.464500 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.464459    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02dfa4d4-d67e-4ddc-8681-38163a849a7e-service-ca\") pod \"console-5c9ffcc896-fdssk\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") " pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.464691 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.464523    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txrlb\" (UniqueName: \"kubernetes.io/projected/02dfa4d4-d67e-4ddc-8681-38163a849a7e-kube-api-access-txrlb\") pod \"console-5c9ffcc896-fdssk\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") " pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.464691 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.464566    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02dfa4d4-d67e-4ddc-8681-38163a849a7e-oauth-serving-cert\") pod \"console-5c9ffcc896-fdssk\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") " pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.464691 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.464594    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02dfa4d4-d67e-4ddc-8681-38163a849a7e-console-config\") pod \"console-5c9ffcc896-fdssk\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") " pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.464691 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.464627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02dfa4d4-d67e-4ddc-8681-38163a849a7e-console-oauth-config\") pod \"console-5c9ffcc896-fdssk\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") " pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.464691 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.464653    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02dfa4d4-d67e-4ddc-8681-38163a849a7e-console-serving-cert\") pod \"console-5c9ffcc896-fdssk\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") " pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.465996 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.465970    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02dfa4d4-d67e-4ddc-8681-38163a849a7e-oauth-serving-cert\") pod \"console-5c9ffcc896-fdssk\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") " pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.466123 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.465970    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02dfa4d4-d67e-4ddc-8681-38163a849a7e-console-config\") pod \"console-5c9ffcc896-fdssk\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") " pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.466446 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.466385    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02dfa4d4-d67e-4ddc-8681-38163a849a7e-service-ca\") pod \"console-5c9ffcc896-fdssk\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") " pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.468243 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.467838    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02dfa4d4-d67e-4ddc-8681-38163a849a7e-console-serving-cert\") pod \"console-5c9ffcc896-fdssk\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") " pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.468243 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.468209    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02dfa4d4-d67e-4ddc-8681-38163a849a7e-console-oauth-config\") pod \"console-5c9ffcc896-fdssk\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") " pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.474457 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.474438    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txrlb\" (UniqueName: \"kubernetes.io/projected/02dfa4d4-d67e-4ddc-8681-38163a849a7e-kube-api-access-txrlb\") pod \"console-5c9ffcc896-fdssk\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") " pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.597694 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.597606    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:22.926723 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:22.926699    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:27:23.027720 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:23.027671    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c9ffcc896-fdssk"]
Jul 28 01:27:23.032870 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:27:23.032807    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02dfa4d4_d67e_4ddc_8681_38163a849a7e.slice/crio-724e5e424620ab036b36e3ae17743b65dac5587caeee0e4370f65828393a72fe WatchSource:0}: Error finding container 724e5e424620ab036b36e3ae17743b65dac5587caeee0e4370f65828393a72fe: Status 404 returned error can't find the container with id 724e5e424620ab036b36e3ae17743b65dac5587caeee0e4370f65828393a72fe
Jul 28 01:27:23.931215 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:23.931175    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9ffcc896-fdssk" event={"ID":"02dfa4d4-d67e-4ddc-8681-38163a849a7e","Type":"ContainerStarted","Data":"724e5e424620ab036b36e3ae17743b65dac5587caeee0e4370f65828393a72fe"}
Jul 28 01:27:23.933260 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:23.933222    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-45q88" event={"ID":"0040b8c9-9c71-4ac7-9bb8-3dff7ad139c6","Type":"ContainerStarted","Data":"74abbef48a42ad8369eda5b511f6a0c685f79a3bbc89775af4a1f7d5bc6fb425"}
Jul 28 01:27:24.939241 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:24.939210    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-45q88"
Jul 28 01:27:24.944809 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:24.944596    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-45q88"
Jul 28 01:27:24.968057 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:24.968009    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-45q88" podStartSLOduration=6.865283237 podStartE2EDuration="7.967994295s" totalImagesPullingTime="1.102711058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:23.957743263 +0000 UTC m=+76.974441905" watchObservedRunningTime="2026-07-28 01:27:24.967994295 +0000 UTC m=+77.984692939"
Jul 28 01:27:25.198815 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.198732    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-vr4sw"]
Jul 28 01:27:25.201180 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.201155    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-vr4sw"
Jul 28 01:27:25.205517 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.205378    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 28 01:27:25.205760 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.205742    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 28 01:27:25.207037 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.206669    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 01:27:25.207037 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.206883    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 01:27:25.207037 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.206964    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fzmc2\""
Jul 28 01:27:25.207037 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.206998    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 01:27:25.214954 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.214480    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-vr4sw"]
Jul 28 01:27:25.291865 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.291835    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a02086b1-a514-42d9-84c3-45274a01c732-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-vr4sw\" (UID: \"a02086b1-a514-42d9-84c3-45274a01c732\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vr4sw"
Jul 28 01:27:25.292008 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.291886    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a02086b1-a514-42d9-84c3-45274a01c732-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-vr4sw\" (UID: \"a02086b1-a514-42d9-84c3-45274a01c732\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vr4sw"
Jul 28 01:27:25.292008 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.291931    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqnwd\" (UniqueName: \"kubernetes.io/projected/a02086b1-a514-42d9-84c3-45274a01c732-kube-api-access-zqnwd\") pod \"prometheus-operator-84d69f794d-vr4sw\" (UID: \"a02086b1-a514-42d9-84c3-45274a01c732\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vr4sw"
Jul 28 01:27:25.292008 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.291990    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a02086b1-a514-42d9-84c3-45274a01c732-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-vr4sw\" (UID: \"a02086b1-a514-42d9-84c3-45274a01c732\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vr4sw"
Jul 28 01:27:25.393091 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.392579    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a02086b1-a514-42d9-84c3-45274a01c732-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-vr4sw\" (UID: \"a02086b1-a514-42d9-84c3-45274a01c732\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vr4sw"
Jul 28 01:27:25.393091 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.392662    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a02086b1-a514-42d9-84c3-45274a01c732-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-vr4sw\" (UID: \"a02086b1-a514-42d9-84c3-45274a01c732\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vr4sw"
Jul 28 01:27:25.393091 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.392707    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqnwd\" (UniqueName: \"kubernetes.io/projected/a02086b1-a514-42d9-84c3-45274a01c732-kube-api-access-zqnwd\") pod \"prometheus-operator-84d69f794d-vr4sw\" (UID: \"a02086b1-a514-42d9-84c3-45274a01c732\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vr4sw"
Jul 28 01:27:25.393091 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.392738    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a02086b1-a514-42d9-84c3-45274a01c732-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-vr4sw\" (UID: \"a02086b1-a514-42d9-84c3-45274a01c732\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vr4sw"
Jul 28 01:27:25.393758 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.393649    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a02086b1-a514-42d9-84c3-45274a01c732-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-vr4sw\" (UID: \"a02086b1-a514-42d9-84c3-45274a01c732\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vr4sw"
Jul 28 01:27:25.400237 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.400210    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a02086b1-a514-42d9-84c3-45274a01c732-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-vr4sw\" (UID: \"a02086b1-a514-42d9-84c3-45274a01c732\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vr4sw"
Jul 28 01:27:25.401988 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.401960    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a02086b1-a514-42d9-84c3-45274a01c732-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-vr4sw\" (UID: \"a02086b1-a514-42d9-84c3-45274a01c732\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vr4sw"
Jul 28 01:27:25.403005 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.402981    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqnwd\" (UniqueName: \"kubernetes.io/projected/a02086b1-a514-42d9-84c3-45274a01c732-kube-api-access-zqnwd\") pod \"prometheus-operator-84d69f794d-vr4sw\" (UID: \"a02086b1-a514-42d9-84c3-45274a01c732\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-vr4sw"
Jul 28 01:27:25.515904 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:25.515815    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-vr4sw"
Jul 28 01:27:26.174341 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:26.174188    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-vr4sw"]
Jul 28 01:27:26.176966 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:27:26.176935    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda02086b1_a514_42d9_84c3_45274a01c732.slice/crio-263691c416d18e14920bfc3583a518b7723c1e37050dea4812f742ebf759eb10 WatchSource:0}: Error finding container 263691c416d18e14920bfc3583a518b7723c1e37050dea4812f742ebf759eb10: Status 404 returned error can't find the container with id 263691c416d18e14920bfc3583a518b7723c1e37050dea4812f742ebf759eb10
Jul 28 01:27:26.949289 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:26.949001    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9ffcc896-fdssk" event={"ID":"02dfa4d4-d67e-4ddc-8681-38163a849a7e","Type":"ContainerStarted","Data":"cc5b4ec8caf9c61630a0f0f337df2758b7c60809d19c12d3ab079bc44d0642fe"}
Jul 28 01:27:26.950406 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:26.950372    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-vr4sw" event={"ID":"a02086b1-a514-42d9-84c3-45274a01c732","Type":"ContainerStarted","Data":"263691c416d18e14920bfc3583a518b7723c1e37050dea4812f742ebf759eb10"}
Jul 28 01:27:26.973149 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:26.973097    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c9ffcc896-fdssk" podStartSLOduration=1.950622773 podStartE2EDuration="4.973083652s" totalImagesPullingTime="3.022460879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:26.971506787 +0000 UTC m=+79.988205433" watchObservedRunningTime="2026-07-28 01:27:26.973083652 +0000 UTC m=+79.989782272"
Jul 28 01:27:32.598713 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:32.598569    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:32.598713 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:32.598637    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:32.604246 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:32.604223    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:32.979472 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:32.979439    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:27:34.984107 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:34.984064    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-dm7d9" event={"ID":"4fc7091d-0514-4ace-b06a-5d5553701527","Type":"ContainerStarted","Data":"ed9bafd2a0b959ef8d20fec62a6f62afcbfb066c23072b030d46024eb4af176a"}
Jul 28 01:27:34.984604 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:34.984315    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-dm7d9"
Jul 28 01:27:34.992041 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:34.992009    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-dm7d9"
Jul 28 01:27:35.003564 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:35.003500    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-dm7d9" podStartSLOduration=4.083795155 podStartE2EDuration="23.003484314s" totalImagesPullingTime="18.919689159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:35.001984487 +0000 UTC m=+88.018683130" watchObservedRunningTime="2026-07-28 01:27:35.003484314 +0000 UTC m=+88.020182958"
Jul 28 01:27:35.609084 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:35.609005    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c9ffcc896-fdssk"]
Jul 28 01:27:35.990974 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:35.990934    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-vr4sw" event={"ID":"a02086b1-a514-42d9-84c3-45274a01c732","Type":"ContainerStarted","Data":"9344cd34de2a408a2afb201acb7d8d70e5e47e52b1c33c6199082693caaf0292"}
Jul 28 01:27:35.991461 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:35.991005    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-vr4sw" event={"ID":"a02086b1-a514-42d9-84c3-45274a01c732","Type":"ContainerStarted","Data":"46b20c98a898c7a2b64904c9a08b45e7316237181e35af8d7857143fda725113"}
Jul 28 01:27:36.008830 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:36.008776    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-vr4sw" podStartSLOduration=2.142237746 podStartE2EDuration="11.008753411s" totalImagesPullingTime="8.866515665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:36.007778363 +0000 UTC m=+89.024477007" watchObservedRunningTime="2026-07-28 01:27:36.008753411 +0000 UTC m=+89.025452055"
Jul 28 01:27:37.630458 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.630420    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"]
Jul 28 01:27:37.666194 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.666156    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4wnrx"]
Jul 28 01:27:37.666532 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.666510    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.669622 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.669257    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 28 01:27:37.669622 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.669531    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-b77zq\""
Jul 28 01:27:37.670165 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.669866    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 28 01:27:37.670706 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.670685    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 28 01:27:37.687569 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.686066    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"]
Jul 28 01:27:37.687569 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.686184    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.689012 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.688990    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s548w\""
Jul 28 01:27:37.689331 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.689313    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 01:27:37.689613 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.689334    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 01:27:37.689871 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.689402    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 01:27:37.798874 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.798842    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e7896ed-e4e6-428d-888b-fa0e652718b4-sys\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.799054 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.798917    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e7896ed-e4e6-428d-888b-fa0e652718b4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.799054 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.798951    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b70dc550-2255-480d-9256-c48cbe82a57e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-zpzsb\" (UID: \"b70dc550-2255-480d-9256-c48cbe82a57e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.799054 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.798986    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b70dc550-2255-480d-9256-c48cbe82a57e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-zpzsb\" (UID: \"b70dc550-2255-480d-9256-c48cbe82a57e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.799054 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.799020    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e7896ed-e4e6-428d-888b-fa0e652718b4-node-exporter-tls\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.799054 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.799047    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b70dc550-2255-480d-9256-c48cbe82a57e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-zpzsb\" (UID: \"b70dc550-2255-480d-9256-c48cbe82a57e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.799325 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.799082    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8e7896ed-e4e6-428d-888b-fa0e652718b4-node-exporter-accelerators-collector-config\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.799325 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.799116    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hprc4\" (UniqueName: \"kubernetes.io/projected/8e7896ed-e4e6-428d-888b-fa0e652718b4-kube-api-access-hprc4\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.799325 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.799144    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b70dc550-2255-480d-9256-c48cbe82a57e-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-zpzsb\" (UID: \"b70dc550-2255-480d-9256-c48cbe82a57e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.799325 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.799175    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8e7896ed-e4e6-428d-888b-fa0e652718b4-node-exporter-textfile\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.799325 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.799196    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8e7896ed-e4e6-428d-888b-fa0e652718b4-node-exporter-wtmp\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.799325 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.799219    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e7896ed-e4e6-428d-888b-fa0e652718b4-metrics-client-ca\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.799325 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.799240    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b70dc550-2255-480d-9256-c48cbe82a57e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-zpzsb\" (UID: \"b70dc550-2255-480d-9256-c48cbe82a57e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.799325 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.799263    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6cjq\" (UniqueName: \"kubernetes.io/projected/b70dc550-2255-480d-9256-c48cbe82a57e-kube-api-access-t6cjq\") pod \"kube-state-metrics-56d9f944b4-zpzsb\" (UID: \"b70dc550-2255-480d-9256-c48cbe82a57e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.799325 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.799297    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8e7896ed-e4e6-428d-888b-fa0e652718b4-root\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.899749 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.899664    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e7896ed-e4e6-428d-888b-fa0e652718b4-sys\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.899749 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.899704    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e7896ed-e4e6-428d-888b-fa0e652718b4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.899749 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.899740    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b70dc550-2255-480d-9256-c48cbe82a57e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-zpzsb\" (UID: \"b70dc550-2255-480d-9256-c48cbe82a57e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.900020 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.899774    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b70dc550-2255-480d-9256-c48cbe82a57e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-zpzsb\" (UID: \"b70dc550-2255-480d-9256-c48cbe82a57e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.900020 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.899807    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e7896ed-e4e6-428d-888b-fa0e652718b4-node-exporter-tls\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.900020 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.899837    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b70dc550-2255-480d-9256-c48cbe82a57e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-zpzsb\" (UID: \"b70dc550-2255-480d-9256-c48cbe82a57e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.900020 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.899875    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8e7896ed-e4e6-428d-888b-fa0e652718b4-node-exporter-accelerators-collector-config\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.900020 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.899913    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hprc4\" (UniqueName: \"kubernetes.io/projected/8e7896ed-e4e6-428d-888b-fa0e652718b4-kube-api-access-hprc4\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.900020 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.899944    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b70dc550-2255-480d-9256-c48cbe82a57e-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-zpzsb\" (UID: \"b70dc550-2255-480d-9256-c48cbe82a57e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.900020 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.899979    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8e7896ed-e4e6-428d-888b-fa0e652718b4-node-exporter-textfile\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.900020 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.900000    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8e7896ed-e4e6-428d-888b-fa0e652718b4-node-exporter-wtmp\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.900020 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.900022    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e7896ed-e4e6-428d-888b-fa0e652718b4-metrics-client-ca\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.900455 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.900044    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b70dc550-2255-480d-9256-c48cbe82a57e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-zpzsb\" (UID: \"b70dc550-2255-480d-9256-c48cbe82a57e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.900455 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.900068    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6cjq\" (UniqueName: \"kubernetes.io/projected/b70dc550-2255-480d-9256-c48cbe82a57e-kube-api-access-t6cjq\") pod \"kube-state-metrics-56d9f944b4-zpzsb\" (UID: \"b70dc550-2255-480d-9256-c48cbe82a57e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.900455 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.900103    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8e7896ed-e4e6-428d-888b-fa0e652718b4-root\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.900455 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.900181    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8e7896ed-e4e6-428d-888b-fa0e652718b4-root\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.900756 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.900731    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b70dc550-2255-480d-9256-c48cbe82a57e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-zpzsb\" (UID: \"b70dc550-2255-480d-9256-c48cbe82a57e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.900819 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.900751    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8e7896ed-e4e6-428d-888b-fa0e652718b4-node-exporter-accelerators-collector-config\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.900819 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.900803    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e7896ed-e4e6-428d-888b-fa0e652718b4-sys\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.901255 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.901234    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54d68ff985-nmq2c"
Jul 28 01:27:37.901376 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.901297    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b70dc550-2255-480d-9256-c48cbe82a57e-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-zpzsb\" (UID: \"b70dc550-2255-480d-9256-c48cbe82a57e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.901681 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.901662    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8e7896ed-e4e6-428d-888b-fa0e652718b4-node-exporter-textfile\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.902402 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.901686    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8e7896ed-e4e6-428d-888b-fa0e652718b4-node-exporter-wtmp\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.902566 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.902122    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e7896ed-e4e6-428d-888b-fa0e652718b4-metrics-client-ca\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.902723 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.902355    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b70dc550-2255-480d-9256-c48cbe82a57e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-zpzsb\" (UID: \"b70dc550-2255-480d-9256-c48cbe82a57e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.904997 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.904950    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e7896ed-e4e6-428d-888b-fa0e652718b4-node-exporter-tls\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.905246 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.905225    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b70dc550-2255-480d-9256-c48cbe82a57e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-zpzsb\" (UID: \"b70dc550-2255-480d-9256-c48cbe82a57e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.905395 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.905369    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e7896ed-e4e6-428d-888b-fa0e652718b4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.906863 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.906839    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b70dc550-2255-480d-9256-c48cbe82a57e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-zpzsb\" (UID: \"b70dc550-2255-480d-9256-c48cbe82a57e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.910893 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.910867    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hprc4\" (UniqueName: \"kubernetes.io/projected/8e7896ed-e4e6-428d-888b-fa0e652718b4-kube-api-access-hprc4\") pod \"node-exporter-4wnrx\" (UID: \"8e7896ed-e4e6-428d-888b-fa0e652718b4\") " pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:37.911838 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.911802    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6cjq\" (UniqueName: \"kubernetes.io/projected/b70dc550-2255-480d-9256-c48cbe82a57e-kube-api-access-t6cjq\") pod \"kube-state-metrics-56d9f944b4-zpzsb\" (UID: \"b70dc550-2255-480d-9256-c48cbe82a57e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:37.945281 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.945223    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx" podUID="d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef" containerName="registry" containerID="cri-o://18549806fa41d38e145376311f2712419e47e826cf1913a68324f077c326e597" gracePeriod=30
Jul 28 01:27:37.997238 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.997211    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"
Jul 28 01:27:38.002500 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:37.999286    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4wnrx"
Jul 28 01:27:38.058625 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:27:38.058592    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e7896ed_e4e6_428d_888b_fa0e652718b4.slice/crio-761fb2d4fe1f08aba114b20c2463b6cdf4495d161551191d9a304d1b638983c6 WatchSource:0}: Error finding container 761fb2d4fe1f08aba114b20c2463b6cdf4495d161551191d9a304d1b638983c6: Status 404 returned error can't find the container with id 761fb2d4fe1f08aba114b20c2463b6cdf4495d161551191d9a304d1b638983c6
Jul 28 01:27:38.230939 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.230180    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb"]
Jul 28 01:27:38.322240 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.322204    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:27:38.506192 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.506086    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-image-registry-private-configuration\") pod \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") "
Jul 28 01:27:38.506192 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.506131    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-bound-sa-token\") pod \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") "
Jul 28 01:27:38.506192 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.506166    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls\") pod \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") "
Jul 28 01:27:38.506746 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.506228    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7rpk\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-kube-api-access-v7rpk\") pod \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") "
Jul 28 01:27:38.506746 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.506256    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-ca-trust-extracted\") pod \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") "
Jul 28 01:27:38.506746 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.506290    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-trusted-ca\") pod \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") "
Jul 28 01:27:38.506746 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.506316    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-installation-pull-secrets\") pod \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") "
Jul 28 01:27:38.506746 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.506358    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-certificates\") pod \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\" (UID: \"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef\") "
Jul 28 01:27:38.507759 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.507650    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef" (UID: "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:27:38.508050 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.508013    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef" (UID: "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:27:38.510298 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.510236    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef" (UID: "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:27:38.510501 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.510297    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef" (UID: "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:27:38.510501 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.510439    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef" (UID: "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:27:38.510952 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.510514    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-kube-api-access-v7rpk" (OuterVolumeSpecName: "kube-api-access-v7rpk") pod "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef" (UID: "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef"). InnerVolumeSpecName "kube-api-access-v7rpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:27:38.512159 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.512130    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef" (UID: "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:27:38.519258 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.519222    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef" (UID: "d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:27:38.607370 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.607338    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-image-registry-private-configuration\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:27:38.607370 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.607374    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-bound-sa-token\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:27:38.607610 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.607388    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-tls\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:27:38.607610 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.607401    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7rpk\" (UniqueName: \"kubernetes.io/projected/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-kube-api-access-v7rpk\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:27:38.607610 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.607414    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-ca-trust-extracted\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:27:38.607610 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.607425    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-trusted-ca\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:27:38.607610 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.607432    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-installation-pull-secrets\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:27:38.607610 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:38.607440    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef-registry-certificates\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:27:39.010153 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:39.010112    2558 generic.go:356] "Generic (PLEG): container finished" podID="d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef" containerID="18549806fa41d38e145376311f2712419e47e826cf1913a68324f077c326e597" exitCode=0
Jul 28 01:27:39.010786 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:39.010164    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx" event={"ID":"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef","Type":"ContainerDied","Data":"18549806fa41d38e145376311f2712419e47e826cf1913a68324f077c326e597"}
Jul 28 01:27:39.010786 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:39.010217    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx" event={"ID":"d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef","Type":"ContainerDied","Data":"956f807c8adbaa1a9df8ddcb13d0f62260b691b279debaca86650645d41cb736"}
Jul 28 01:27:39.010786 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:39.010170    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69f8c7f5fd-h56fx"
Jul 28 01:27:39.010786 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:39.010248    2558 scope.go:117] "RemoveContainer" containerID="18549806fa41d38e145376311f2712419e47e826cf1913a68324f077c326e597"
Jul 28 01:27:39.017858 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:39.017825    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4wnrx" event={"ID":"8e7896ed-e4e6-428d-888b-fa0e652718b4","Type":"ContainerStarted","Data":"761fb2d4fe1f08aba114b20c2463b6cdf4495d161551191d9a304d1b638983c6"}
Jul 28 01:27:39.019411 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:39.019389    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb" event={"ID":"b70dc550-2255-480d-9256-c48cbe82a57e","Type":"ContainerStarted","Data":"199e2cb34e4adb772d885e9d40da389b4ea39f9d5609bde80adaa3fce41c0775"}
Jul 28 01:27:39.041770 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:39.041742    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69f8c7f5fd-h56fx"]
Jul 28 01:27:39.046120 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:39.046088    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-69f8c7f5fd-h56fx"]
Jul 28 01:27:39.272135 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:39.272111    2558 scope.go:117] "RemoveContainer" containerID="18549806fa41d38e145376311f2712419e47e826cf1913a68324f077c326e597"
Jul 28 01:27:39.272593 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:27:39.272523    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18549806fa41d38e145376311f2712419e47e826cf1913a68324f077c326e597\": container with ID starting with 18549806fa41d38e145376311f2712419e47e826cf1913a68324f077c326e597 not found: ID does not exist" containerID="18549806fa41d38e145376311f2712419e47e826cf1913a68324f077c326e597"
Jul 28 01:27:39.272688 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:39.272610    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18549806fa41d38e145376311f2712419e47e826cf1913a68324f077c326e597"} err="failed to get container status \"18549806fa41d38e145376311f2712419e47e826cf1913a68324f077c326e597\": rpc error: code = NotFound desc = could not find container \"18549806fa41d38e145376311f2712419e47e826cf1913a68324f077c326e597\": container with ID starting with 18549806fa41d38e145376311f2712419e47e826cf1913a68324f077c326e597 not found: ID does not exist"
Jul 28 01:27:39.551493 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:39.551414    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef" path="/var/lib/kubelet/pods/d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef/volumes"
Jul 28 01:27:41.031267 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:41.031231    2558 generic.go:356] "Generic (PLEG): container finished" podID="8e7896ed-e4e6-428d-888b-fa0e652718b4" containerID="5f788e3899a284243c62701ceb74ec95f46520fd9ef686ab0649c12fcbae8ddb" exitCode=0
Jul 28 01:27:41.031774 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:41.031308    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4wnrx" event={"ID":"8e7896ed-e4e6-428d-888b-fa0e652718b4","Type":"ContainerDied","Data":"5f788e3899a284243c62701ceb74ec95f46520fd9ef686ab0649c12fcbae8ddb"}
Jul 28 01:27:41.033843 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:41.033815    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb" event={"ID":"b70dc550-2255-480d-9256-c48cbe82a57e","Type":"ContainerStarted","Data":"3e4b298231cf1430788032423bcaf56a5cfd2cdda0fbdd1ade4cdd5fd2eec92e"}
Jul 28 01:27:41.033990 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:41.033874    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb" event={"ID":"b70dc550-2255-480d-9256-c48cbe82a57e","Type":"ContainerStarted","Data":"c62f28fd149c64f34c7f76432c67da13051f002fea55fa7d69bf73c63b295451"}
Jul 28 01:27:41.033990 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:41.033902    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb" event={"ID":"b70dc550-2255-480d-9256-c48cbe82a57e","Type":"ContainerStarted","Data":"f805068711eaf5b5708da183b723f4bf7d5f456d4da2be8a91121140b91731da"}
Jul 28 01:27:41.071433 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:41.071373    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-zpzsb" podStartSLOduration=2.181100382 podStartE2EDuration="4.071355636s" totalImagesPullingTime="1.890255254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:41.071253989 +0000 UTC m=+94.087952634" watchObservedRunningTime="2026-07-28 01:27:41.071355636 +0000 UTC m=+94.088054278"
Jul 28 01:27:42.027309 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.027270    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-75b6d4b985-6hl77"]
Jul 28 01:27:42.027629 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.027612    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef" containerName="registry"
Jul 28 01:27:42.027703 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.027632    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef" containerName="registry"
Jul 28 01:27:42.027703 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.027686    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2c4276b-9f6f-4a9a-b3e0-7804bc4f35ef" containerName="registry"
Jul 28 01:27:42.051270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.051241    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75b6d4b985-6hl77"]
Jul 28 01:27:42.051732 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.051280    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4wnrx" event={"ID":"8e7896ed-e4e6-428d-888b-fa0e652718b4","Type":"ContainerStarted","Data":"382cf6f203c4ca7184b921d5bc3638ae9f2194e872d884f7b19bdd35de1b3661"}
Jul 28 01:27:42.051732 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.051311    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4wnrx" event={"ID":"8e7896ed-e4e6-428d-888b-fa0e652718b4","Type":"ContainerStarted","Data":"5634d9264e275a1c5398c81817afa9b870b040e7c88d783908c941c65e3e2a2b"}
Jul 28 01:27:42.051732 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.051399    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.054213 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.054190    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 28 01:27:42.054365 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.054257    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 28 01:27:42.054694 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.054671    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dtba1hk7rhej2\""
Jul 28 01:27:42.054820 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.054788    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 28 01:27:42.054894 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.054868    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 28 01:27:42.055095 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.055072    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5n6ml\""
Jul 28 01:27:42.061732 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.061686    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4wnrx" podStartSLOduration=2.8414567269999997 podStartE2EDuration="5.061668883s" totalImagesPullingTime="2.063679544s" totalInitContainerRuntime="156.532612ms" isStatefulPod=true podCreationTimestamp="2026-07-28 01:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:42.061306127 +0000 UTC m=+95.078004782" watchObservedRunningTime="2026-07-28 01:27:42.061668883 +0000 UTC m=+95.078367527"
Jul 28 01:27:42.242878 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.242843    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56ffv\" (UniqueName: \"kubernetes.io/projected/de12bd8b-f020-47c7-b5a3-5d2b6753a893-kube-api-access-56ffv\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.242878 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.242890    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/de12bd8b-f020-47c7-b5a3-5d2b6753a893-secret-metrics-server-client-certs\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.243138 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.242911    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/de12bd8b-f020-47c7-b5a3-5d2b6753a893-metrics-server-audit-profiles\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.243138 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.242999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de12bd8b-f020-47c7-b5a3-5d2b6753a893-client-ca-bundle\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.243138 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.243087    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de12bd8b-f020-47c7-b5a3-5d2b6753a893-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.243138 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.243130    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/de12bd8b-f020-47c7-b5a3-5d2b6753a893-secret-metrics-server-tls\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.243335 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.243163    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/de12bd8b-f020-47c7-b5a3-5d2b6753a893-audit-log\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.345152 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.344381    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de12bd8b-f020-47c7-b5a3-5d2b6753a893-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.345152 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.344431    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/de12bd8b-f020-47c7-b5a3-5d2b6753a893-secret-metrics-server-tls\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.345152 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.344465    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/de12bd8b-f020-47c7-b5a3-5d2b6753a893-audit-log\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.345152 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.344526    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56ffv\" (UniqueName: \"kubernetes.io/projected/de12bd8b-f020-47c7-b5a3-5d2b6753a893-kube-api-access-56ffv\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.345152 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.344589    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/de12bd8b-f020-47c7-b5a3-5d2b6753a893-secret-metrics-server-client-certs\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.345152 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.344617    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/de12bd8b-f020-47c7-b5a3-5d2b6753a893-metrics-server-audit-profiles\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.345152 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.344652    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de12bd8b-f020-47c7-b5a3-5d2b6753a893-client-ca-bundle\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.345664 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.345426    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/de12bd8b-f020-47c7-b5a3-5d2b6753a893-audit-log\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.346198 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.346024    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de12bd8b-f020-47c7-b5a3-5d2b6753a893-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.346934 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.346903    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/de12bd8b-f020-47c7-b5a3-5d2b6753a893-metrics-server-audit-profiles\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.349145 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.349122    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/de12bd8b-f020-47c7-b5a3-5d2b6753a893-secret-metrics-server-tls\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.350228 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.350186    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de12bd8b-f020-47c7-b5a3-5d2b6753a893-client-ca-bundle\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.350323 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.350283    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/de12bd8b-f020-47c7-b5a3-5d2b6753a893-secret-metrics-server-client-certs\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.355916 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.355889    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56ffv\" (UniqueName: \"kubernetes.io/projected/de12bd8b-f020-47c7-b5a3-5d2b6753a893-kube-api-access-56ffv\") pod \"metrics-server-75b6d4b985-6hl77\" (UID: \"de12bd8b-f020-47c7-b5a3-5d2b6753a893\") " pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.362648 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.362626    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:27:42.564498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.564459    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75b6d4b985-6hl77"]
Jul 28 01:27:42.569153 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:27:42.569121    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde12bd8b_f020_47c7_b5a3_5d2b6753a893.slice/crio-8de90e19a02060eadf8b78a6f9029ace4b18db5c5df30063724039b53fa6166a WatchSource:0}: Error finding container 8de90e19a02060eadf8b78a6f9029ace4b18db5c5df30063724039b53fa6166a: Status 404 returned error can't find the container with id 8de90e19a02060eadf8b78a6f9029ace4b18db5c5df30063724039b53fa6166a
Jul 28 01:27:42.834616 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.834579    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"]
Jul 28 01:27:42.878689 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.878657    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"]
Jul 28 01:27:42.878852 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.878784    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:42.882099 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.882073    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 28 01:27:42.882245 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.882112    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 28 01:27:42.882245 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.882177    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 28 01:27:42.882342 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.882264    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 28 01:27:42.882796 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.882775    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-lkvwr\""
Jul 28 01:27:42.882903 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.882830    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 28 01:27:42.887973 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:42.887779    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 28 01:27:43.050485 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.050413    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77" event={"ID":"de12bd8b-f020-47c7-b5a3-5d2b6753a893","Type":"ContainerStarted","Data":"8de90e19a02060eadf8b78a6f9029ace4b18db5c5df30063724039b53fa6166a"}
Jul 28 01:27:43.050685 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.050649    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ffb868fc-b114-4f7d-b59c-7954277113da-federate-client-tls\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.050756 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.050689    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffb868fc-b114-4f7d-b59c-7954277113da-metrics-client-ca\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.050756 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.050720    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb868fc-b114-4f7d-b59c-7954277113da-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.050859 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.050831    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ffb868fc-b114-4f7d-b59c-7954277113da-secret-telemeter-client\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.050945 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.050920    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ffb868fc-b114-4f7d-b59c-7954277113da-telemeter-client-tls\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.051048 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.051024    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffb868fc-b114-4f7d-b59c-7954277113da-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.051115 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.051083    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvq56\" (UniqueName: \"kubernetes.io/projected/ffb868fc-b114-4f7d-b59c-7954277113da-kube-api-access-hvq56\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.051168 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.051112    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb868fc-b114-4f7d-b59c-7954277113da-serving-certs-ca-bundle\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.154030 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.152492    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffb868fc-b114-4f7d-b59c-7954277113da-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.154030 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.152595    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvq56\" (UniqueName: \"kubernetes.io/projected/ffb868fc-b114-4f7d-b59c-7954277113da-kube-api-access-hvq56\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.154030 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.152642    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb868fc-b114-4f7d-b59c-7954277113da-serving-certs-ca-bundle\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.154030 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.152720    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ffb868fc-b114-4f7d-b59c-7954277113da-federate-client-tls\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.154030 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.152748    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffb868fc-b114-4f7d-b59c-7954277113da-metrics-client-ca\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.154030 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.152780    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb868fc-b114-4f7d-b59c-7954277113da-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.154030 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.152817    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ffb868fc-b114-4f7d-b59c-7954277113da-secret-telemeter-client\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.154030 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.152866    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ffb868fc-b114-4f7d-b59c-7954277113da-telemeter-client-tls\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.154030 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.153851    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb868fc-b114-4f7d-b59c-7954277113da-serving-certs-ca-bundle\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.154030 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.153872    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb868fc-b114-4f7d-b59c-7954277113da-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.156409 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.155129    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffb868fc-b114-4f7d-b59c-7954277113da-metrics-client-ca\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.157268 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.157223    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ffb868fc-b114-4f7d-b59c-7954277113da-telemeter-client-tls\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.158045 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.158019    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffb868fc-b114-4f7d-b59c-7954277113da-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.159231 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.159057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ffb868fc-b114-4f7d-b59c-7954277113da-federate-client-tls\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.159614 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.159589    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ffb868fc-b114-4f7d-b59c-7954277113da-secret-telemeter-client\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.162878 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.162853    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvq56\" (UniqueName: \"kubernetes.io/projected/ffb868fc-b114-4f7d-b59c-7954277113da-kube-api-access-hvq56\") pod \"telemeter-client-77cb5947b7-rrx9x\" (UID: \"ffb868fc-b114-4f7d-b59c-7954277113da\") " pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.191529 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.191499    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"
Jul 28 01:27:43.435469 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.435445    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-77cb5947b7-rrx9x"]
Jul 28 01:27:43.675795 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.675761    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fd955cdb7-6qhwc"]
Jul 28 01:27:43.701637 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.701490    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fd955cdb7-6qhwc"]
Jul 28 01:27:43.701806 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.701648    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.709795 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.709770    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 28 01:27:43.766486 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.764519    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5131f17a-4c78-4eab-a640-37e0ff1853b6-console-oauth-config\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.766486 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.764601    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5131f17a-4c78-4eab-a640-37e0ff1853b6-console-serving-cert\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.766486 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.764728    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-service-ca\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.766486 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.764775    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-oauth-serving-cert\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.766486 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.764816    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-console-config\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.766486 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.764837    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-trusted-ca-bundle\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.766486 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.764863    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpzct\" (UniqueName: \"kubernetes.io/projected/5131f17a-4c78-4eab-a640-37e0ff1853b6-kube-api-access-wpzct\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.851483 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.851447    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:27:43.865723 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.865693    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-service-ca\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.865898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.865733    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-oauth-serving-cert\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.865898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.865762    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-console-config\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.865898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.865783    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-trusted-ca-bundle\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.865898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.865808    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpzct\" (UniqueName: \"kubernetes.io/projected/5131f17a-4c78-4eab-a640-37e0ff1853b6-kube-api-access-wpzct\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.865898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.865873    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5131f17a-4c78-4eab-a640-37e0ff1853b6-console-oauth-config\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.866136 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.865907    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5131f17a-4c78-4eab-a640-37e0ff1853b6-console-serving-cert\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.867522 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.867203    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-oauth-serving-cert\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.867522 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.867276    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-console-config\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.867522 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.867293    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-service-ca\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.867940 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.867694    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:27:43.868002 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.867962    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.870373 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.869733    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-trusted-ca-bundle\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.870373 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.869742    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5131f17a-4c78-4eab-a640-37e0ff1853b6-console-serving-cert\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.870675 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.870651    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cdssvqfa1l8pu\""
Jul 28 01:27:43.872154 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.872113    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5131f17a-4c78-4eab-a640-37e0ff1853b6-console-oauth-config\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.872681 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.872659    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 28 01:27:43.872783 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.872659    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 28 01:27:43.872841 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.872734    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 28 01:27:43.873172 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.873154    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 28 01:27:43.873172 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.873166    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 28 01:27:43.874213 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.873443    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 28 01:27:43.874213 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.873464    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 28 01:27:43.874213 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.873856    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vmdvq\""
Jul 28 01:27:43.874485 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.874301    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 28 01:27:43.876630 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.874874    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 28 01:27:43.876630 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.875171    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 28 01:27:43.876630 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.875202    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 28 01:27:43.876630 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.875308    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 28 01:27:43.876630 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.875630    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 28 01:27:43.876630 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.876607    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 28 01:27:43.877497 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.877450    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpzct\" (UniqueName: \"kubernetes.io/projected/5131f17a-4c78-4eab-a640-37e0ff1853b6-kube-api-access-wpzct\") pod \"console-7fd955cdb7-6qhwc\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") " pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:43.968574 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.967707    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.968574 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.967749    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.968574 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.967782    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.968574 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.967808    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.968574 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.967831    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llpc7\" (UniqueName: \"kubernetes.io/projected/95c8b2ee-2303-4549-b334-eea452242db9-kube-api-access-llpc7\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.968574 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.967858    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95c8b2ee-2303-4549-b334-eea452242db9-config-out\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.968574 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.967882    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.968574 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.967914    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.968574 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.967940    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.968574 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.967995    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95c8b2ee-2303-4549-b334-eea452242db9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.968574 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.968018    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.968574 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.968049    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.968574 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.968077    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-config\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.968574 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.968106    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.968574 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.968150    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.968574 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.968198    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.969375 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.968230    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.969375 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.968266    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.969375 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.968291    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-web-config\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:43.969375 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:43.968310    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.019664 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.019625    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:44.065346 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.065308    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x" event={"ID":"ffb868fc-b114-4f7d-b59c-7954277113da","Type":"ContainerStarted","Data":"9553f2ecd6849e6791ff1b1e5a72d4792e06078272f4af4eaaf20397c26f61a0"}
Jul 28 01:27:44.069092 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069060    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95c8b2ee-2303-4549-b334-eea452242db9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069250 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069102    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069250 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069233    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069369 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069276    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-config\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069369 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069300    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069367    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069428    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069476 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069461    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069652 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069501    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069652 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069572    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-web-config\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069652 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069596    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069652 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069652 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069650    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069888 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069684    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069888 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069708    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069888 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069735    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llpc7\" (UniqueName: \"kubernetes.io/projected/95c8b2ee-2303-4549-b334-eea452242db9-kube-api-access-llpc7\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069888 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95c8b2ee-2303-4549-b334-eea452242db9-config-out\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069888 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069888 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069813    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.069888 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.069837    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.075666 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.070403    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.075666 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.070580    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.075666 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.071179    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.075666 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.071914    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.075666 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.072281    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.075666 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.073810    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.075666 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.074146    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95c8b2ee-2303-4549-b334-eea452242db9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.075666 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.074255    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-config\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.075666 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.074481    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.075666 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.074858    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-web-config\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.075666 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.075009    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.077356 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.077302    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.077490 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.077466    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.078131 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.078079    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.078398 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.078375    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.078686 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.078666    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.079082 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.079066    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.079165 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.079129    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95c8b2ee-2303-4549-b334-eea452242db9-config-out\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.080834 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.080811    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.082402 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.082378    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llpc7\" (UniqueName: \"kubernetes.io/projected/95c8b2ee-2303-4549-b334-eea452242db9-kube-api-access-llpc7\") pod \"prometheus-k8s-0\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.202700 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.202672    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:27:44.369237 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.369202    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fd955cdb7-6qhwc"]
Jul 28 01:27:44.372472 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:27:44.372439    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5131f17a_4c78_4eab_a640_37e0ff1853b6.slice/crio-3f1f00d0dcf1441aabec56a5397cb3384421af4733f6799088a371434369462a WatchSource:0}: Error finding container 3f1f00d0dcf1441aabec56a5397cb3384421af4733f6799088a371434369462a: Status 404 returned error can't find the container with id 3f1f00d0dcf1441aabec56a5397cb3384421af4733f6799088a371434369462a
Jul 28 01:27:44.406122 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:44.406095    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:27:44.409153 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:27:44.409124    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c8b2ee_2303_4549_b334_eea452242db9.slice/crio-821df1b6058927a7812507c4ed42ed07572322ce73cc938e4af2a6159698c3e3 WatchSource:0}: Error finding container 821df1b6058927a7812507c4ed42ed07572322ce73cc938e4af2a6159698c3e3: Status 404 returned error can't find the container with id 821df1b6058927a7812507c4ed42ed07572322ce73cc938e4af2a6159698c3e3
Jul 28 01:27:45.073335 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:45.073255    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd955cdb7-6qhwc" event={"ID":"5131f17a-4c78-4eab-a640-37e0ff1853b6","Type":"ContainerStarted","Data":"cff8fea4f382dc4ad1d8b6f37b8a328213a1fccfe875172c71c9de667c7f10de"}
Jul 28 01:27:45.073335 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:45.073320    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd955cdb7-6qhwc" event={"ID":"5131f17a-4c78-4eab-a640-37e0ff1853b6","Type":"ContainerStarted","Data":"3f1f00d0dcf1441aabec56a5397cb3384421af4733f6799088a371434369462a"}
Jul 28 01:27:45.075572 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:45.075529    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c8b2ee-2303-4549-b334-eea452242db9","Type":"ContainerStarted","Data":"821df1b6058927a7812507c4ed42ed07572322ce73cc938e4af2a6159698c3e3"}
Jul 28 01:27:45.077812 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:45.077788    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77" event={"ID":"de12bd8b-f020-47c7-b5a3-5d2b6753a893","Type":"ContainerStarted","Data":"12ef714638db75e11795d8d7dd3ffbc2561f6589bf431f2f03093633bbd5174c"}
Jul 28 01:27:45.091873 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:45.091702    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fd955cdb7-6qhwc" podStartSLOduration=2.09168362 podStartE2EDuration="2.09168362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:45.090377657 +0000 UTC m=+98.107076302" watchObservedRunningTime="2026-07-28 01:27:45.09168362 +0000 UTC m=+98.108382266"
Jul 28 01:27:47.090404 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:47.090356    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x" event={"ID":"ffb868fc-b114-4f7d-b59c-7954277113da","Type":"ContainerStarted","Data":"d397a88dca83273174ec955e6b38a01f69caf5e990fb8df3221f091f06695316"}
Jul 28 01:27:47.090890 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:47.090464    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x" event={"ID":"ffb868fc-b114-4f7d-b59c-7954277113da","Type":"ContainerStarted","Data":"f1454f1f2657b77914a00713bbf1f13f23d74ef99c36ea0eeef4d52d3ab61819"}
Jul 28 01:27:47.090890 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:47.090495    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x" event={"ID":"ffb868fc-b114-4f7d-b59c-7954277113da","Type":"ContainerStarted","Data":"71bbc7a732ac4b7aefd144716db610e652697c33f303fa4fc1a8cebfd47594e7"}
Jul 28 01:27:47.091897 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:47.091873    2558 generic.go:356] "Generic (PLEG): container finished" podID="95c8b2ee-2303-4549-b334-eea452242db9" containerID="417ff57846653fba3d44d1d8022d750efdaaa499ac730b2324f3e5982cfe0ceb" exitCode=0
Jul 28 01:27:47.092022 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:47.091965    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c8b2ee-2303-4549-b334-eea452242db9","Type":"ContainerDied","Data":"417ff57846653fba3d44d1d8022d750efdaaa499ac730b2324f3e5982cfe0ceb"}
Jul 28 01:27:47.115713 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:47.115668    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-77cb5947b7-rrx9x" podStartSLOduration=2.1273510509999998 podStartE2EDuration="5.115650829s" totalImagesPullingTime="2.988299778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:47.114429088 +0000 UTC m=+100.131127725" watchObservedRunningTime="2026-07-28 01:27:47.115650829 +0000 UTC m=+100.132349473"
Jul 28 01:27:47.116685 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:47.116651    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77" podStartSLOduration=3.047439031 podStartE2EDuration="5.116641194s" totalImagesPullingTime="2.069202163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:45.107702989 +0000 UTC m=+98.124401629" watchObservedRunningTime="2026-07-28 01:27:47.116641194 +0000 UTC m=+100.133339838"
Jul 28 01:27:51.113797 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:51.113710    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c8b2ee-2303-4549-b334-eea452242db9","Type":"ContainerStarted","Data":"e3ffc174600bbb497a6a68bdbb469e488a37fffcc55c633a5515b8059810fad7"}
Jul 28 01:27:51.113797 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:51.113780    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c8b2ee-2303-4549-b334-eea452242db9","Type":"ContainerStarted","Data":"efad6ef1f481a59bd287902d832cd283bf00f3f75a2ef6ac5273a8557d3dc753"}
Jul 28 01:27:52.989595 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:52.986819    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fd955cdb7-6qhwc"]
Jul 28 01:27:53.935642 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:53.935620    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b262s"
Jul 28 01:27:54.019753 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:54.019726    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:27:54.131931 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:54.131903    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c8b2ee-2303-4549-b334-eea452242db9","Type":"ContainerStarted","Data":"a605a76134c14bd9b4b0304acb29200bef50862f5b6bf14d3bffa173a2af69f2"}
Jul 28 01:27:54.132075 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:54.131964    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c8b2ee-2303-4549-b334-eea452242db9","Type":"ContainerStarted","Data":"09129e3a9479fad148cc5959aeb3fdeb2c427cf93e079312d59ad952dd8e1363"}
Jul 28 01:27:54.132075 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:54.131991    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c8b2ee-2303-4549-b334-eea452242db9","Type":"ContainerStarted","Data":"9d84a4fff7e40f2934f10965ba3a6038ff50957f6b2a5873070027da2bf74077"}
Jul 28 01:27:54.132075 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:54.132017    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c8b2ee-2303-4549-b334-eea452242db9","Type":"ContainerStarted","Data":"6c54ef08bdee63e76b0a2b3ba4dab9f7c8cdc97c4d7ca5b2dc764044f9406f2b"}
Jul 28 01:27:54.162253 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:54.162205    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.445231351 podStartE2EDuration="11.162189183s" totalImagesPullingTime="7.697813075s" totalInitContainerRuntime="19.144757ms" isStatefulPod=false podCreationTimestamp="2026-07-28 01:27:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:27:54.159018082 +0000 UTC m=+107.175716725" watchObservedRunningTime="2026-07-28 01:27:54.162189183 +0000 UTC m=+107.178887826"
Jul 28 01:27:54.203448 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:27:54.203393    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:28:00.632830 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:00.632790    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c9ffcc896-fdssk" podUID="02dfa4d4-d67e-4ddc-8681-38163a849a7e" containerName="console" containerID="cri-o://cc5b4ec8caf9c61630a0f0f337df2758b7c60809d19c12d3ab079bc44d0642fe" gracePeriod=15
Jul 28 01:28:00.914694 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:00.914633    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:28:01.009215 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.009189    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02dfa4d4-d67e-4ddc-8681-38163a849a7e-console-oauth-config\") pod \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") "
Jul 28 01:28:01.009398 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.009223    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02dfa4d4-d67e-4ddc-8681-38163a849a7e-oauth-serving-cert\") pod \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") "
Jul 28 01:28:01.009398 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.009243    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02dfa4d4-d67e-4ddc-8681-38163a849a7e-console-serving-cert\") pod \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") "
Jul 28 01:28:01.009398 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.009278    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02dfa4d4-d67e-4ddc-8681-38163a849a7e-service-ca\") pod \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") "
Jul 28 01:28:01.009398 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.009296    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txrlb\" (UniqueName: \"kubernetes.io/projected/02dfa4d4-d67e-4ddc-8681-38163a849a7e-kube-api-access-txrlb\") pod \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") "
Jul 28 01:28:01.009398 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.009355    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02dfa4d4-d67e-4ddc-8681-38163a849a7e-console-config\") pod \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\" (UID: \"02dfa4d4-d67e-4ddc-8681-38163a849a7e\") "
Jul 28 01:28:01.009775 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.009744    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02dfa4d4-d67e-4ddc-8681-38163a849a7e-service-ca" (OuterVolumeSpecName: "service-ca") pod "02dfa4d4-d67e-4ddc-8681-38163a849a7e" (UID: "02dfa4d4-d67e-4ddc-8681-38163a849a7e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:28:01.009891 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.009768    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02dfa4d4-d67e-4ddc-8681-38163a849a7e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "02dfa4d4-d67e-4ddc-8681-38163a849a7e" (UID: "02dfa4d4-d67e-4ddc-8681-38163a849a7e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:28:01.009891 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.009815    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02dfa4d4-d67e-4ddc-8681-38163a849a7e-console-config" (OuterVolumeSpecName: "console-config") pod "02dfa4d4-d67e-4ddc-8681-38163a849a7e" (UID: "02dfa4d4-d67e-4ddc-8681-38163a849a7e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:28:01.011749 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.011723    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02dfa4d4-d67e-4ddc-8681-38163a849a7e-kube-api-access-txrlb" (OuterVolumeSpecName: "kube-api-access-txrlb") pod "02dfa4d4-d67e-4ddc-8681-38163a849a7e" (UID: "02dfa4d4-d67e-4ddc-8681-38163a849a7e"). InnerVolumeSpecName "kube-api-access-txrlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:28:01.011749 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.011744    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02dfa4d4-d67e-4ddc-8681-38163a849a7e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "02dfa4d4-d67e-4ddc-8681-38163a849a7e" (UID: "02dfa4d4-d67e-4ddc-8681-38163a849a7e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:28:01.011868 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.011815    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02dfa4d4-d67e-4ddc-8681-38163a849a7e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "02dfa4d4-d67e-4ddc-8681-38163a849a7e" (UID: "02dfa4d4-d67e-4ddc-8681-38163a849a7e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:28:01.110415 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.110369    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02dfa4d4-d67e-4ddc-8681-38163a849a7e-console-config\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:28:01.110415 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.110408    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02dfa4d4-d67e-4ddc-8681-38163a849a7e-console-oauth-config\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:28:01.110415 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.110419    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02dfa4d4-d67e-4ddc-8681-38163a849a7e-oauth-serving-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:28:01.110652 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.110427    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02dfa4d4-d67e-4ddc-8681-38163a849a7e-console-serving-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:28:01.110652 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.110436    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02dfa4d4-d67e-4ddc-8681-38163a849a7e-service-ca\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:28:01.110652 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.110444    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txrlb\" (UniqueName: \"kubernetes.io/projected/02dfa4d4-d67e-4ddc-8681-38163a849a7e-kube-api-access-txrlb\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:28:01.161038 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.160990    2558 generic.go:356] "Generic (PLEG): container finished" podID="02dfa4d4-d67e-4ddc-8681-38163a849a7e" containerID="cc5b4ec8caf9c61630a0f0f337df2758b7c60809d19c12d3ab079bc44d0642fe" exitCode=0
Jul 28 01:28:01.161038 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.161032    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9ffcc896-fdssk"
Jul 28 01:28:01.161212 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.161043    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9ffcc896-fdssk" event={"ID":"02dfa4d4-d67e-4ddc-8681-38163a849a7e","Type":"ContainerDied","Data":"cc5b4ec8caf9c61630a0f0f337df2758b7c60809d19c12d3ab079bc44d0642fe"}
Jul 28 01:28:01.161212 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.161129    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9ffcc896-fdssk" event={"ID":"02dfa4d4-d67e-4ddc-8681-38163a849a7e","Type":"ContainerDied","Data":"724e5e424620ab036b36e3ae17743b65dac5587caeee0e4370f65828393a72fe"}
Jul 28 01:28:01.161212 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.161151    2558 scope.go:117] "RemoveContainer" containerID="cc5b4ec8caf9c61630a0f0f337df2758b7c60809d19c12d3ab079bc44d0642fe"
Jul 28 01:28:01.169671 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.169652    2558 scope.go:117] "RemoveContainer" containerID="cc5b4ec8caf9c61630a0f0f337df2758b7c60809d19c12d3ab079bc44d0642fe"
Jul 28 01:28:01.169925 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:28:01.169907    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc5b4ec8caf9c61630a0f0f337df2758b7c60809d19c12d3ab079bc44d0642fe\": container with ID starting with cc5b4ec8caf9c61630a0f0f337df2758b7c60809d19c12d3ab079bc44d0642fe not found: ID does not exist" containerID="cc5b4ec8caf9c61630a0f0f337df2758b7c60809d19c12d3ab079bc44d0642fe"
Jul 28 01:28:01.169971 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.169933    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc5b4ec8caf9c61630a0f0f337df2758b7c60809d19c12d3ab079bc44d0642fe"} err="failed to get container status \"cc5b4ec8caf9c61630a0f0f337df2758b7c60809d19c12d3ab079bc44d0642fe\": rpc error: code = NotFound desc = could not find container \"cc5b4ec8caf9c61630a0f0f337df2758b7c60809d19c12d3ab079bc44d0642fe\": container with ID starting with cc5b4ec8caf9c61630a0f0f337df2758b7c60809d19c12d3ab079bc44d0642fe not found: ID does not exist"
Jul 28 01:28:01.182199 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.182174    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c9ffcc896-fdssk"]
Jul 28 01:28:01.187754 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.187734    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c9ffcc896-fdssk"]
Jul 28 01:28:01.550020 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:01.549989    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02dfa4d4-d67e-4ddc-8681-38163a849a7e" path="/var/lib/kubelet/pods/02dfa4d4-d67e-4ddc-8681-38163a849a7e/volumes"
Jul 28 01:28:02.363652 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:02.363624    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:28:02.364097 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:02.363679    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:28:18.009653 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.009590    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7fd955cdb7-6qhwc" podUID="5131f17a-4c78-4eab-a640-37e0ff1853b6" containerName="console" containerID="cri-o://cff8fea4f382dc4ad1d8b6f37b8a328213a1fccfe875172c71c9de667c7f10de" gracePeriod=15
Jul 28 01:28:18.229801 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.229769    2558 generic.go:356] "Generic (PLEG): container finished" podID="5131f17a-4c78-4eab-a640-37e0ff1853b6" containerID="cff8fea4f382dc4ad1d8b6f37b8a328213a1fccfe875172c71c9de667c7f10de" exitCode=0
Jul 28 01:28:18.229942 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.229844    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd955cdb7-6qhwc" event={"ID":"5131f17a-4c78-4eab-a640-37e0ff1853b6","Type":"ContainerDied","Data":"cff8fea4f382dc4ad1d8b6f37b8a328213a1fccfe875172c71c9de667c7f10de"}
Jul 28 01:28:18.295662 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.293710    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:28:18.451713 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.451685    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5131f17a-4c78-4eab-a640-37e0ff1853b6-console-serving-cert\") pod \"5131f17a-4c78-4eab-a640-37e0ff1853b6\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") "
Jul 28 01:28:18.451713 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.451715    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpzct\" (UniqueName: \"kubernetes.io/projected/5131f17a-4c78-4eab-a640-37e0ff1853b6-kube-api-access-wpzct\") pod \"5131f17a-4c78-4eab-a640-37e0ff1853b6\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") "
Jul 28 01:28:18.451906 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.451744    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-oauth-serving-cert\") pod \"5131f17a-4c78-4eab-a640-37e0ff1853b6\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") "
Jul 28 01:28:18.451906 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.451876    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-console-config\") pod \"5131f17a-4c78-4eab-a640-37e0ff1853b6\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") "
Jul 28 01:28:18.452004 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.451929    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-trusted-ca-bundle\") pod \"5131f17a-4c78-4eab-a640-37e0ff1853b6\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") "
Jul 28 01:28:18.452004 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.451966    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5131f17a-4c78-4eab-a640-37e0ff1853b6-console-oauth-config\") pod \"5131f17a-4c78-4eab-a640-37e0ff1853b6\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") "
Jul 28 01:28:18.452004 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.451990    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-service-ca\") pod \"5131f17a-4c78-4eab-a640-37e0ff1853b6\" (UID: \"5131f17a-4c78-4eab-a640-37e0ff1853b6\") "
Jul 28 01:28:18.452204 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.452066    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5131f17a-4c78-4eab-a640-37e0ff1853b6" (UID: "5131f17a-4c78-4eab-a640-37e0ff1853b6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:28:18.452284 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.452264    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-oauth-serving-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:28:18.452349 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.452322    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-console-config" (OuterVolumeSpecName: "console-config") pod "5131f17a-4c78-4eab-a640-37e0ff1853b6" (UID: "5131f17a-4c78-4eab-a640-37e0ff1853b6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:28:18.452591 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.452540    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-service-ca" (OuterVolumeSpecName: "service-ca") pod "5131f17a-4c78-4eab-a640-37e0ff1853b6" (UID: "5131f17a-4c78-4eab-a640-37e0ff1853b6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:28:18.452767 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.452744    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5131f17a-4c78-4eab-a640-37e0ff1853b6" (UID: "5131f17a-4c78-4eab-a640-37e0ff1853b6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:28:18.454001 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.453976    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5131f17a-4c78-4eab-a640-37e0ff1853b6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5131f17a-4c78-4eab-a640-37e0ff1853b6" (UID: "5131f17a-4c78-4eab-a640-37e0ff1853b6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:28:18.454085 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.453997    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5131f17a-4c78-4eab-a640-37e0ff1853b6-kube-api-access-wpzct" (OuterVolumeSpecName: "kube-api-access-wpzct") pod "5131f17a-4c78-4eab-a640-37e0ff1853b6" (UID: "5131f17a-4c78-4eab-a640-37e0ff1853b6"). InnerVolumeSpecName "kube-api-access-wpzct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:28:18.454085 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.454026    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5131f17a-4c78-4eab-a640-37e0ff1853b6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5131f17a-4c78-4eab-a640-37e0ff1853b6" (UID: "5131f17a-4c78-4eab-a640-37e0ff1853b6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:28:18.553321 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.553260    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5131f17a-4c78-4eab-a640-37e0ff1853b6-console-serving-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:28:18.553321 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.553283    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpzct\" (UniqueName: \"kubernetes.io/projected/5131f17a-4c78-4eab-a640-37e0ff1853b6-kube-api-access-wpzct\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:28:18.553321 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.553294    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-console-config\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:28:18.553321 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.553303    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-trusted-ca-bundle\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:28:18.553321 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.553312    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5131f17a-4c78-4eab-a640-37e0ff1853b6-console-oauth-config\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:28:18.553321 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:18.553319    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5131f17a-4c78-4eab-a640-37e0ff1853b6-service-ca\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:28:19.235179 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:19.235146    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd955cdb7-6qhwc"
Jul 28 01:28:19.235179 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:19.235167    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd955cdb7-6qhwc" event={"ID":"5131f17a-4c78-4eab-a640-37e0ff1853b6","Type":"ContainerDied","Data":"3f1f00d0dcf1441aabec56a5397cb3384421af4733f6799088a371434369462a"}
Jul 28 01:28:19.235672 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:19.235226    2558 scope.go:117] "RemoveContainer" containerID="cff8fea4f382dc4ad1d8b6f37b8a328213a1fccfe875172c71c9de667c7f10de"
Jul 28 01:28:19.255070 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:19.255044    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fd955cdb7-6qhwc"]
Jul 28 01:28:19.258432 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:19.258403    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fd955cdb7-6qhwc"]
Jul 28 01:28:19.550116 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:19.550038    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5131f17a-4c78-4eab-a640-37e0ff1853b6" path="/var/lib/kubelet/pods/5131f17a-4c78-4eab-a640-37e0ff1853b6/volumes"
Jul 28 01:28:22.368300 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:22.368269    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:28:22.372083 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:22.372061    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-75b6d4b985-6hl77"
Jul 28 01:28:44.203280 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:44.203230    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:28:44.222888 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:44.222864    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:28:44.345658 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:28:44.345633    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:02.237305 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.237216    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:29:02.237846 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.237539    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="prometheus" containerID="cri-o://efad6ef1f481a59bd287902d832cd283bf00f3f75a2ef6ac5273a8557d3dc753" gracePeriod=600
Jul 28 01:29:02.237846 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.237612    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="kube-rbac-proxy-web" containerID="cri-o://9d84a4fff7e40f2934f10965ba3a6038ff50957f6b2a5873070027da2bf74077" gracePeriod=600
Jul 28 01:29:02.237846 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.237610    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a605a76134c14bd9b4b0304acb29200bef50862f5b6bf14d3bffa173a2af69f2" gracePeriod=600
Jul 28 01:29:02.238037 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.237600    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="kube-rbac-proxy" containerID="cri-o://09129e3a9479fad148cc5959aeb3fdeb2c427cf93e079312d59ad952dd8e1363" gracePeriod=600
Jul 28 01:29:02.238037 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.237643    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="config-reloader" containerID="cri-o://e3ffc174600bbb497a6a68bdbb469e488a37fffcc55c633a5515b8059810fad7" gracePeriod=600
Jul 28 01:29:02.238127 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.237633    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="thanos-sidecar" containerID="cri-o://6c54ef08bdee63e76b0a2b3ba4dab9f7c8cdc97c4d7ca5b2dc764044f9406f2b" gracePeriod=600
Jul 28 01:29:02.403481 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.403448    2558 generic.go:356] "Generic (PLEG): container finished" podID="95c8b2ee-2303-4549-b334-eea452242db9" containerID="a605a76134c14bd9b4b0304acb29200bef50862f5b6bf14d3bffa173a2af69f2" exitCode=0
Jul 28 01:29:02.403481 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.403475    2558 generic.go:356] "Generic (PLEG): container finished" podID="95c8b2ee-2303-4549-b334-eea452242db9" containerID="09129e3a9479fad148cc5959aeb3fdeb2c427cf93e079312d59ad952dd8e1363" exitCode=0
Jul 28 01:29:02.403481 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.403483    2558 generic.go:356] "Generic (PLEG): container finished" podID="95c8b2ee-2303-4549-b334-eea452242db9" containerID="9d84a4fff7e40f2934f10965ba3a6038ff50957f6b2a5873070027da2bf74077" exitCode=0
Jul 28 01:29:02.403481 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.403493    2558 generic.go:356] "Generic (PLEG): container finished" podID="95c8b2ee-2303-4549-b334-eea452242db9" containerID="6c54ef08bdee63e76b0a2b3ba4dab9f7c8cdc97c4d7ca5b2dc764044f9406f2b" exitCode=0
Jul 28 01:29:02.403481 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.403501    2558 generic.go:356] "Generic (PLEG): container finished" podID="95c8b2ee-2303-4549-b334-eea452242db9" containerID="e3ffc174600bbb497a6a68bdbb469e488a37fffcc55c633a5515b8059810fad7" exitCode=0
Jul 28 01:29:02.403788 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.403508    2558 generic.go:356] "Generic (PLEG): container finished" podID="95c8b2ee-2303-4549-b334-eea452242db9" containerID="efad6ef1f481a59bd287902d832cd283bf00f3f75a2ef6ac5273a8557d3dc753" exitCode=0
Jul 28 01:29:02.403788 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.403533    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c8b2ee-2303-4549-b334-eea452242db9","Type":"ContainerDied","Data":"a605a76134c14bd9b4b0304acb29200bef50862f5b6bf14d3bffa173a2af69f2"}
Jul 28 01:29:02.403788 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.403648    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c8b2ee-2303-4549-b334-eea452242db9","Type":"ContainerDied","Data":"09129e3a9479fad148cc5959aeb3fdeb2c427cf93e079312d59ad952dd8e1363"}
Jul 28 01:29:02.403788 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.403678    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c8b2ee-2303-4549-b334-eea452242db9","Type":"ContainerDied","Data":"9d84a4fff7e40f2934f10965ba3a6038ff50957f6b2a5873070027da2bf74077"}
Jul 28 01:29:02.403788 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.403702    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c8b2ee-2303-4549-b334-eea452242db9","Type":"ContainerDied","Data":"6c54ef08bdee63e76b0a2b3ba4dab9f7c8cdc97c4d7ca5b2dc764044f9406f2b"}
Jul 28 01:29:02.403788 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.403727    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c8b2ee-2303-4549-b334-eea452242db9","Type":"ContainerDied","Data":"e3ffc174600bbb497a6a68bdbb469e488a37fffcc55c633a5515b8059810fad7"}
Jul 28 01:29:02.403788 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.403749    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c8b2ee-2303-4549-b334-eea452242db9","Type":"ContainerDied","Data":"efad6ef1f481a59bd287902d832cd283bf00f3f75a2ef6ac5273a8557d3dc753"}
Jul 28 01:29:02.489771 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.489701    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:02.590399 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.590362    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-config\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.590620 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.590410    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-web-config\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.590620 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.590465    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-configmap-serving-certs-ca-bundle\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.590620 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.590511    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-configmap-kubelet-serving-ca-bundle\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.591198 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.590844    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-configmap-metrics-client-ca\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.591198 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.590900    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-prometheus-k8s-tls\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.591198 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.590901    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:29:02.591198 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.590927    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.591198 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.591148    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-rulefiles-2\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.591198 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.591158    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:29:02.591198 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.591180    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-metrics-client-certs\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.591635 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.591212    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-thanos-prometheus-http-client-file\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.591635 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.591246    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llpc7\" (UniqueName: \"kubernetes.io/projected/95c8b2ee-2303-4549-b334-eea452242db9-kube-api-access-llpc7\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.591635 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.591270    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-grpc-tls\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.591635 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.591305    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95c8b2ee-2303-4549-b334-eea452242db9-tls-assets\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.591635 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.591331    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-db\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.591635 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.591369    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-rulefiles-1\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.591635 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.591388    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:29:02.591635 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.591394    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-rulefiles-0\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.591635 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.591453    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95c8b2ee-2303-4549-b334-eea452242db9-config-out\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.591635 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.591484    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-kube-rbac-proxy\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.591635 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.591512    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-trusted-ca-bundle\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.591635 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.591541    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"95c8b2ee-2303-4549-b334-eea452242db9\" (UID: \"95c8b2ee-2303-4549-b334-eea452242db9\") "
Jul 28 01:29:02.592203 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.591908    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:29:02.592203 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.591949    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.592312 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.592205    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:29:02.594115 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.593018    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-configmap-metrics-client-ca\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.594115 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.593042    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.594760 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.594289    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:29:02.594760 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.594344    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:29:02.596604 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.596569    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:29:02.597328 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.597297    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:29:02.597414 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.597387    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:29:02.597414 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.597401    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-config" (OuterVolumeSpecName: "config") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:29:02.597789 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.597739    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:29:02.598008 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.597956    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:29:02.598112 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.598012    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95c8b2ee-2303-4549-b334-eea452242db9-config-out" (OuterVolumeSpecName: "config-out") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:29:02.598112 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.598012    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:29:02.598690 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.598649    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:29:02.599263 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.599238    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95c8b2ee-2303-4549-b334-eea452242db9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:29:02.599769 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.599750    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95c8b2ee-2303-4549-b334-eea452242db9-kube-api-access-llpc7" (OuterVolumeSpecName: "kube-api-access-llpc7") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "kube-api-access-llpc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:29:02.599945 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.599932    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:29:02.606733 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.606710    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-web-config" (OuterVolumeSpecName: "web-config") pod "95c8b2ee-2303-4549-b334-eea452242db9" (UID: "95c8b2ee-2303-4549-b334-eea452242db9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:29:02.694265 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.694229    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.694265 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.694259    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.694265 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.694270    2558 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-metrics-client-certs\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.694498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.694279    2558 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.694498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.694288    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llpc7\" (UniqueName: \"kubernetes.io/projected/95c8b2ee-2303-4549-b334-eea452242db9-kube-api-access-llpc7\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.694498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.694298    2558 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-grpc-tls\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.694498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.694306    2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95c8b2ee-2303-4549-b334-eea452242db9-tls-assets\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.694498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.694314    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-db\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.694498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.694322    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.694498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.694330    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.694498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.694339    2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95c8b2ee-2303-4549-b334-eea452242db9-config-out\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.694498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.694347    2558 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-kube-rbac-proxy\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.694498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.694354    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.694498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.694363    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.694498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.694371    2558 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-config\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.694498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.694378    2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95c8b2ee-2303-4549-b334-eea452242db9-web-config\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:02.694498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:02.694387    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c8b2ee-2303-4549-b334-eea452242db9-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:29:03.410142 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.410108    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c8b2ee-2303-4549-b334-eea452242db9","Type":"ContainerDied","Data":"821df1b6058927a7812507c4ed42ed07572322ce73cc938e4af2a6159698c3e3"}
Jul 28 01:29:03.410592 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.410155    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.410592 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.410184    2558 scope.go:117] "RemoveContainer" containerID="a605a76134c14bd9b4b0304acb29200bef50862f5b6bf14d3bffa173a2af69f2"
Jul 28 01:29:03.419134 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.419116    2558 scope.go:117] "RemoveContainer" containerID="09129e3a9479fad148cc5959aeb3fdeb2c427cf93e079312d59ad952dd8e1363"
Jul 28 01:29:03.426636 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.426619    2558 scope.go:117] "RemoveContainer" containerID="9d84a4fff7e40f2934f10965ba3a6038ff50957f6b2a5873070027da2bf74077"
Jul 28 01:29:03.433601 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.433539    2558 scope.go:117] "RemoveContainer" containerID="6c54ef08bdee63e76b0a2b3ba4dab9f7c8cdc97c4d7ca5b2dc764044f9406f2b"
Jul 28 01:29:03.434638 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.434566    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:29:03.439995 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.439975    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:29:03.441690 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.441667    2558 scope.go:117] "RemoveContainer" containerID="e3ffc174600bbb497a6a68bdbb469e488a37fffcc55c633a5515b8059810fad7"
Jul 28 01:29:03.448283 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.448265    2558 scope.go:117] "RemoveContainer" containerID="efad6ef1f481a59bd287902d832cd283bf00f3f75a2ef6ac5273a8557d3dc753"
Jul 28 01:29:03.455114 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.455089    2558 scope.go:117] "RemoveContainer" containerID="417ff57846653fba3d44d1d8022d750efdaaa499ac730b2324f3e5982cfe0ceb"
Jul 28 01:29:03.467255 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467236    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:29:03.467561 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467529    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="config-reloader"
Jul 28 01:29:03.467643 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467566    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="config-reloader"
Jul 28 01:29:03.467643 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467584    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5131f17a-4c78-4eab-a640-37e0ff1853b6" containerName="console"
Jul 28 01:29:03.467643 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467593    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5131f17a-4c78-4eab-a640-37e0ff1853b6" containerName="console"
Jul 28 01:29:03.467643 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467602    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="thanos-sidecar"
Jul 28 01:29:03.467643 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467611    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="thanos-sidecar"
Jul 28 01:29:03.467643 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467621    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="kube-rbac-proxy-web"
Jul 28 01:29:03.467643 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467629    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="kube-rbac-proxy-web"
Jul 28 01:29:03.467643 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467643    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="kube-rbac-proxy-thanos"
Jul 28 01:29:03.468011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467652    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="kube-rbac-proxy-thanos"
Jul 28 01:29:03.468011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467669    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="prometheus"
Jul 28 01:29:03.468011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467677    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="prometheus"
Jul 28 01:29:03.468011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467685    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="kube-rbac-proxy"
Jul 28 01:29:03.468011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467693    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="kube-rbac-proxy"
Jul 28 01:29:03.468011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467704    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02dfa4d4-d67e-4ddc-8681-38163a849a7e" containerName="console"
Jul 28 01:29:03.468011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467712    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="02dfa4d4-d67e-4ddc-8681-38163a849a7e" containerName="console"
Jul 28 01:29:03.468011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467725    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="init-config-reloader"
Jul 28 01:29:03.468011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467733    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="init-config-reloader"
Jul 28 01:29:03.468011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467804    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="02dfa4d4-d67e-4ddc-8681-38163a849a7e" containerName="console"
Jul 28 01:29:03.468011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467818    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="prometheus"
Jul 28 01:29:03.468011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467828    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="kube-rbac-proxy-thanos"
Jul 28 01:29:03.468011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467835    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5131f17a-4c78-4eab-a640-37e0ff1853b6" containerName="console"
Jul 28 01:29:03.468011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467843    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="kube-rbac-proxy-web"
Jul 28 01:29:03.468011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467852    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="thanos-sidecar"
Jul 28 01:29:03.468011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467863    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="config-reloader"
Jul 28 01:29:03.468011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.467872    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="95c8b2ee-2303-4549-b334-eea452242db9" containerName="kube-rbac-proxy"
Jul 28 01:29:03.471861 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.471843    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.474671 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.474646    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 28 01:29:03.474776 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.474759    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vmdvq\""
Jul 28 01:29:03.474845 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.474796    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 28 01:29:03.474903 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.474892    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 28 01:29:03.474951 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.474908    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 28 01:29:03.475134 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.475118    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 28 01:29:03.475186 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.475156    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 28 01:29:03.475342 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.475329    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cdssvqfa1l8pu\""
Jul 28 01:29:03.475457 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.475442    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 28 01:29:03.475498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.475452    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 28 01:29:03.475530 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.475495    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 28 01:29:03.475600 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.475531    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 28 01:29:03.475600 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.475539    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 28 01:29:03.476207 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.476190    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 28 01:29:03.480243 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.480083    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 28 01:29:03.482262 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.482245    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 28 01:29:03.489194 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.489166    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:29:03.500800 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.500771    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-web-config\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.500898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.500815    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.500898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.500840    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.500898 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.500889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.501003 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.500934    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.501003 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.500965    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.501003 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.500982    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.501095 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.501006    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06c550f8-b334-47c3-b92c-ede8b7e52bcf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.501095 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.501081    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.501156 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.501112    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.501156 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.501130    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.501156 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.501145    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-config\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.501246 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.501157    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06c550f8-b334-47c3-b92c-ede8b7e52bcf-config-out\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.501246 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.501174    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.501246 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.501213    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.501363 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.501247    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.501363 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.501263    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.501363 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.501289    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.501363 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.501303    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06c550f8-b334-47c3-b92c-ede8b7e52bcf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.501363 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.501319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k76n\" (UniqueName: \"kubernetes.io/projected/06c550f8-b334-47c3-b92c-ede8b7e52bcf-kube-api-access-5k76n\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.549940 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.549859    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95c8b2ee-2303-4549-b334-eea452242db9" path="/var/lib/kubelet/pods/95c8b2ee-2303-4549-b334-eea452242db9/volumes"
Jul 28 01:29:03.601974 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.601940    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06c550f8-b334-47c3-b92c-ede8b7e52bcf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602123 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.601990    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602123 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602030    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602123 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602123 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602080    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-config\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602314 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602203    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06c550f8-b334-47c3-b92c-ede8b7e52bcf-config-out\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602314 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602236    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602314 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602272    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602314 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602303    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602513 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602343    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602513 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602369    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602513 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602393    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06c550f8-b334-47c3-b92c-ede8b7e52bcf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602513 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602418    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k76n\" (UniqueName: \"kubernetes.io/projected/06c550f8-b334-47c3-b92c-ede8b7e52bcf-kube-api-access-5k76n\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602513 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602450    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-web-config\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602513 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602493    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602833 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602516    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602833 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602562    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602833 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602591    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602833 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602630    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.602833 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602653    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.603253 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602924    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.603253 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.602958    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.603253 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.603101    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.604973 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.604941    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.605304 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.605276    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.605649 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.605565    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.605821 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.605708    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-config\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.605988 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.605961    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06c550f8-b334-47c3-b92c-ede8b7e52bcf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.606402 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.606357    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.606864 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.606804    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.606864 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.606808    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06c550f8-b334-47c3-b92c-ede8b7e52bcf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.607069 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.606947    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06c550f8-b334-47c3-b92c-ede8b7e52bcf-config-out\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.607740 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.607714    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.607882 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.607848    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.608350 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.608326    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.608421 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.608360    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.608522 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.608503    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-web-config\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.608770 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.608752    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06c550f8-b334-47c3-b92c-ede8b7e52bcf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.608873 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.608855    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06c550f8-b334-47c3-b92c-ede8b7e52bcf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.611076 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.611058    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k76n\" (UniqueName: \"kubernetes.io/projected/06c550f8-b334-47c3-b92c-ede8b7e52bcf-kube-api-access-5k76n\") pod \"prometheus-k8s-0\" (UID: \"06c550f8-b334-47c3-b92c-ede8b7e52bcf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.782940 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.782908    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:29:03.919015 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:03.918978    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 01:29:03.925854 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:29:03.925803    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06c550f8_b334_47c3_b92c_ede8b7e52bcf.slice/crio-6ed147adcde925d425ec35733313eb4214960892345492ca5e929367652a8039 WatchSource:0}: Error finding container 6ed147adcde925d425ec35733313eb4214960892345492ca5e929367652a8039: Status 404 returned error can't find the container with id 6ed147adcde925d425ec35733313eb4214960892345492ca5e929367652a8039
Jul 28 01:29:04.415638 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:04.415600    2558 generic.go:356] "Generic (PLEG): container finished" podID="06c550f8-b334-47c3-b92c-ede8b7e52bcf" containerID="7b9893bb339d6472e33518a27c247cf16b6dacd6d49e0fc0a8fa6c4e12f5d393" exitCode=0
Jul 28 01:29:04.416105 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:04.415705    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06c550f8-b334-47c3-b92c-ede8b7e52bcf","Type":"ContainerDied","Data":"7b9893bb339d6472e33518a27c247cf16b6dacd6d49e0fc0a8fa6c4e12f5d393"}
Jul 28 01:29:04.416105 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:04.415787    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06c550f8-b334-47c3-b92c-ede8b7e52bcf","Type":"ContainerStarted","Data":"6ed147adcde925d425ec35733313eb4214960892345492ca5e929367652a8039"}
Jul 28 01:29:05.423477 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:05.423445    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06c550f8-b334-47c3-b92c-ede8b7e52bcf","Type":"ContainerStarted","Data":"a0bd88692de5fcec29b08ec368bc01716e98a2a9b512b1805e698b4ce15dbee4"}
Jul 28 01:29:05.423865 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:05.423509    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06c550f8-b334-47c3-b92c-ede8b7e52bcf","Type":"ContainerStarted","Data":"dc8f3206851fd5ed4708d62814e9746ca5d9c0aa2514d118cf7d4ab522fbffd5"}
Jul 28 01:29:05.423865 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:05.423535    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06c550f8-b334-47c3-b92c-ede8b7e52bcf","Type":"ContainerStarted","Data":"3328503b8f3eeeb062f504922357ca30215e4b95b254250eab14236aaca52b55"}
Jul 28 01:29:05.423865 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:05.423591    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06c550f8-b334-47c3-b92c-ede8b7e52bcf","Type":"ContainerStarted","Data":"31ad2d78ee861a4fa67b49bb74ea70bf1e685499a2b13726645c9464cd3aaa45"}
Jul 28 01:29:05.423865 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:05.423618    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06c550f8-b334-47c3-b92c-ede8b7e52bcf","Type":"ContainerStarted","Data":"2435a524133f23e2f2d2faae458d6524f1a34c8335bd1a85db36a5feea9d0f9f"}
Jul 28 01:29:05.423865 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:05.423641    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06c550f8-b334-47c3-b92c-ede8b7e52bcf","Type":"ContainerStarted","Data":"115e30b09c55659dc6ca8fdfa04034b5118791e667f51352f6b0b11cd96213b1"}
Jul 28 01:29:05.452352 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:05.452294    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.4415641900000002 podStartE2EDuration="2.452271392s" totalImagesPullingTime="0s" totalInitContainerRuntime="10.707202ms" isStatefulPod=false podCreationTimestamp="2026-07-28 01:29:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:29:05.451122982 +0000 UTC m=+178.467821629" watchObservedRunningTime="2026-07-28 01:29:05.452271392 +0000 UTC m=+178.468970035"
Jul 28 01:29:08.783606 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:29:08.783574    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:30:03.783773 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:30:03.783723    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:30:03.799749 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:30:03.799722    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:30:04.657766 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:30:04.657710    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 01:31:07.365220 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:31:07.365191    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 01:31:07.371011 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:31:07.370990    2558 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 01:31:07.372289 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:31:07.372269    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 01:34:35.252768 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:35.252736    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-xb7np"]
Jul 28 01:34:35.254919 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:35.254903    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-xb7np"
Jul 28 01:34:35.257878 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:35.257856    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 28 01:34:35.257991 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:35.257862    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 28 01:34:35.258894 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:35.258876    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-spmss\""
Jul 28 01:34:35.258982 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:35.258907    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 28 01:34:35.264506 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:35.264488    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-xb7np"]
Jul 28 01:34:35.404397 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:35.404362    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ebfecde-6946-4564-acc0-ee474dd45769-model-cache\") pod \"s3-init-xb7np\" (UID: \"3ebfecde-6946-4564-acc0-ee474dd45769\") " pod="kserve/s3-init-xb7np"
Jul 28 01:34:35.404570 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:35.404473    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-225kp\" (UniqueName: \"kubernetes.io/projected/3ebfecde-6946-4564-acc0-ee474dd45769-kube-api-access-225kp\") pod \"s3-init-xb7np\" (UID: \"3ebfecde-6946-4564-acc0-ee474dd45769\") " pod="kserve/s3-init-xb7np"
Jul 28 01:34:35.505134 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:35.505069    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ebfecde-6946-4564-acc0-ee474dd45769-model-cache\") pod \"s3-init-xb7np\" (UID: \"3ebfecde-6946-4564-acc0-ee474dd45769\") " pod="kserve/s3-init-xb7np"
Jul 28 01:34:35.505255 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:35.505140    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-225kp\" (UniqueName: \"kubernetes.io/projected/3ebfecde-6946-4564-acc0-ee474dd45769-kube-api-access-225kp\") pod \"s3-init-xb7np\" (UID: \"3ebfecde-6946-4564-acc0-ee474dd45769\") " pod="kserve/s3-init-xb7np"
Jul 28 01:34:35.505490 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:35.505473    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ebfecde-6946-4564-acc0-ee474dd45769-model-cache\") pod \"s3-init-xb7np\" (UID: \"3ebfecde-6946-4564-acc0-ee474dd45769\") " pod="kserve/s3-init-xb7np"
Jul 28 01:34:35.514443 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:35.514416    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-225kp\" (UniqueName: \"kubernetes.io/projected/3ebfecde-6946-4564-acc0-ee474dd45769-kube-api-access-225kp\") pod \"s3-init-xb7np\" (UID: \"3ebfecde-6946-4564-acc0-ee474dd45769\") " pod="kserve/s3-init-xb7np"
Jul 28 01:34:35.563510 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:35.563490    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-xb7np"
Jul 28 01:34:35.691861 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:35.690541    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-xb7np"]
Jul 28 01:34:35.693972 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:34:35.693928    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ebfecde_6946_4564_acc0_ee474dd45769.slice/crio-7abeb8a23cbf7c85c690ef9f12eb2a11c93224c3721b73fb1c61db0e6100356a WatchSource:0}: Error finding container 7abeb8a23cbf7c85c690ef9f12eb2a11c93224c3721b73fb1c61db0e6100356a: Status 404 returned error can't find the container with id 7abeb8a23cbf7c85c690ef9f12eb2a11c93224c3721b73fb1c61db0e6100356a
Jul 28 01:34:35.695935 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:35.695919    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 01:34:36.635880 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:36.635844    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-xb7np" event={"ID":"3ebfecde-6946-4564-acc0-ee474dd45769","Type":"ContainerStarted","Data":"7abeb8a23cbf7c85c690ef9f12eb2a11c93224c3721b73fb1c61db0e6100356a"}
Jul 28 01:34:39.649634 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:39.649602    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-xb7np" event={"ID":"3ebfecde-6946-4564-acc0-ee474dd45769","Type":"ContainerStarted","Data":"7fd854ddd765b0bf84cebccc90c8d3c8de363518fef4f0d17d2487507a92ed83"}
Jul 28 01:34:41.658405 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:41.658361    2558 generic.go:356] "Generic (PLEG): container finished" podID="3ebfecde-6946-4564-acc0-ee474dd45769" containerID="7fd854ddd765b0bf84cebccc90c8d3c8de363518fef4f0d17d2487507a92ed83" exitCode=0
Jul 28 01:34:41.658787 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:41.658434    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-xb7np" event={"ID":"3ebfecde-6946-4564-acc0-ee474dd45769","Type":"ContainerDied","Data":"7fd854ddd765b0bf84cebccc90c8d3c8de363518fef4f0d17d2487507a92ed83"}
Jul 28 01:34:46.684030 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:46.683999    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-xb7np" event={"ID":"3ebfecde-6946-4564-acc0-ee474dd45769","Type":"ContainerStarted","Data":"15c1be03f82bf9c04fc1335ed43f26cc86d04b32704b5635ec5ec78b5dd9c232"}
Jul 28 01:34:46.703013 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:34:46.702960    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-xb7np" podStartSLOduration=2.290849082 podStartE2EDuration="11.702944017s" totalImagesPullingTime="7.529969305s" totalInitContainerRuntime="1.88212563s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:34:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:34:46.701244282 +0000 UTC m=+519.717942926" watchObservedRunningTime="2026-07-28 01:34:46.702944017 +0000 UTC m=+519.719642659"
Jul 28 01:35:51.934743 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:35:51.934702    2558 generic.go:356] "Generic (PLEG): container finished" podID="3ebfecde-6946-4564-acc0-ee474dd45769" containerID="15c1be03f82bf9c04fc1335ed43f26cc86d04b32704b5635ec5ec78b5dd9c232" exitCode=0
Jul 28 01:35:51.935145 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:35:51.934774    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-xb7np" event={"ID":"3ebfecde-6946-4564-acc0-ee474dd45769","Type":"ContainerDied","Data":"15c1be03f82bf9c04fc1335ed43f26cc86d04b32704b5635ec5ec78b5dd9c232"}
Jul 28 01:35:53.062930 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:35:53.062907    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-xb7np"
Jul 28 01:35:53.215383 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:35:53.215282    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ebfecde-6946-4564-acc0-ee474dd45769-model-cache\") pod \"3ebfecde-6946-4564-acc0-ee474dd45769\" (UID: \"3ebfecde-6946-4564-acc0-ee474dd45769\") "
Jul 28 01:35:53.215540 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:35:53.215427    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-225kp\" (UniqueName: \"kubernetes.io/projected/3ebfecde-6946-4564-acc0-ee474dd45769-kube-api-access-225kp\") pod \"3ebfecde-6946-4564-acc0-ee474dd45769\" (UID: \"3ebfecde-6946-4564-acc0-ee474dd45769\") "
Jul 28 01:35:53.217999 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:35:53.217972    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ebfecde-6946-4564-acc0-ee474dd45769-kube-api-access-225kp" (OuterVolumeSpecName: "kube-api-access-225kp") pod "3ebfecde-6946-4564-acc0-ee474dd45769" (UID: "3ebfecde-6946-4564-acc0-ee474dd45769"). InnerVolumeSpecName "kube-api-access-225kp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:35:53.235399 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:35:53.235376    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ebfecde-6946-4564-acc0-ee474dd45769-model-cache" (OuterVolumeSpecName: "model-cache") pod "3ebfecde-6946-4564-acc0-ee474dd45769" (UID: "3ebfecde-6946-4564-acc0-ee474dd45769"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:35:53.316855 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:35:53.316827    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-225kp\" (UniqueName: \"kubernetes.io/projected/3ebfecde-6946-4564-acc0-ee474dd45769-kube-api-access-225kp\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:35:53.316855 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:35:53.316852    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ebfecde-6946-4564-acc0-ee474dd45769-model-cache\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:35:53.943985 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:35:53.943962    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-xb7np"
Jul 28 01:35:53.944130 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:35:53.943954    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-xb7np" event={"ID":"3ebfecde-6946-4564-acc0-ee474dd45769","Type":"ContainerDied","Data":"7abeb8a23cbf7c85c690ef9f12eb2a11c93224c3721b73fb1c61db0e6100356a"}
Jul 28 01:35:53.944130 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:35:53.944081    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7abeb8a23cbf7c85c690ef9f12eb2a11c93224c3721b73fb1c61db0e6100356a"
Jul 28 01:36:07.389484 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:36:07.389446    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 01:36:07.394973 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:36:07.394954    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 01:41:07.413677 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:41:07.413599    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 01:41:07.417795 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:41:07.417764    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 01:46:07.441082 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:46:07.441056    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 01:46:07.443279 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:46:07.443262    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 01:49:08.555855 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.555817    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"]
Jul 28 01:49:08.556343 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.556111    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ebfecde-6946-4564-acc0-ee474dd45769" containerName="s3-init"
Jul 28 01:49:08.556343 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.556121    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ebfecde-6946-4564-acc0-ee474dd45769" containerName="s3-init"
Jul 28 01:49:08.556343 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.556133    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ebfecde-6946-4564-acc0-ee474dd45769" containerName="download-hf-model"
Jul 28 01:49:08.556343 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.556138    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ebfecde-6946-4564-acc0-ee474dd45769" containerName="download-hf-model"
Jul 28 01:49:08.556343 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.556183    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ebfecde-6946-4564-acc0-ee474dd45769" containerName="s3-init"
Jul 28 01:49:08.558986 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.558964    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:08.562927 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.562893    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 01:49:08.563217 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.563202    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 28 01:49:08.563279 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.563219    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-cl94s\""
Jul 28 01:49:08.563512 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.563495    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\""
Jul 28 01:49:08.563992 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.563975    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 28 01:49:08.564272 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.564256    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-v2-predictor-serving-cert\""
Jul 28 01:49:08.567014 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.566999    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 28 01:49:08.583865 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.583844    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"]
Jul 28 01:49:08.681220 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.681190    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-86766c4958-br2tz\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:08.681349 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.681223    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-86766c4958-br2tz\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:08.681349 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.681249    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-86766c4958-br2tz\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:08.681349 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.681275    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqfm2\" (UniqueName: \"kubernetes.io/projected/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-kube-api-access-gqfm2\") pod \"isvc-canary-promote-v2-predictor-86766c4958-br2tz\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:08.681349 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.681330    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-86766c4958-br2tz\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:08.782467 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.782436    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-86766c4958-br2tz\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:08.782467 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.782471    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-86766c4958-br2tz\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:08.782717 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.782495    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-86766c4958-br2tz\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:08.782717 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.782524    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqfm2\" (UniqueName: \"kubernetes.io/projected/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-kube-api-access-gqfm2\") pod \"isvc-canary-promote-v2-predictor-86766c4958-br2tz\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:08.782717 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.782622    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-86766c4958-br2tz\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:08.782974 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.782954    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-86766c4958-br2tz\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:08.783326 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.783275    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-86766c4958-br2tz\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:08.783326 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.783280    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-86766c4958-br2tz\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:08.785226 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.785208    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-86766c4958-br2tz\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:08.791118 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.791095    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqfm2\" (UniqueName: \"kubernetes.io/projected/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-kube-api-access-gqfm2\") pod \"isvc-canary-promote-v2-predictor-86766c4958-br2tz\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:08.869605 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.869524    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:08.996329 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:08.996307    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"]
Jul 28 01:49:08.998829 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:49:08.998803    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2582450_c9e1_4dbf_b3b3_87ac9dd9cdb0.slice/crio-3ed726bfe2ce692815f5379a9c9c238845a6ec1c9e4cc513a3ccbf428d534c22 WatchSource:0}: Error finding container 3ed726bfe2ce692815f5379a9c9c238845a6ec1c9e4cc513a3ccbf428d534c22: Status 404 returned error can't find the container with id 3ed726bfe2ce692815f5379a9c9c238845a6ec1c9e4cc513a3ccbf428d534c22
Jul 28 01:49:09.896568 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:09.896516    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" event={"ID":"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0","Type":"ContainerStarted","Data":"6435e3386a7e570ff8c63811d1abb105b041edeac75fd26e6012171aed32b6c5"}
Jul 28 01:49:09.896911 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:09.896605    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" event={"ID":"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0","Type":"ContainerStarted","Data":"3ed726bfe2ce692815f5379a9c9c238845a6ec1c9e4cc513a3ccbf428d534c22"}
Jul 28 01:49:12.910313 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:12.910282    2558 generic.go:356] "Generic (PLEG): container finished" podID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerID="6435e3386a7e570ff8c63811d1abb105b041edeac75fd26e6012171aed32b6c5" exitCode=0
Jul 28 01:49:12.910684 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:12.910344    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" event={"ID":"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0","Type":"ContainerDied","Data":"6435e3386a7e570ff8c63811d1abb105b041edeac75fd26e6012171aed32b6c5"}
Jul 28 01:49:12.911593 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:12.911578    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 01:49:27.981619 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:27.981580    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" event={"ID":"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0","Type":"ContainerStarted","Data":"f2358e53c1b97142b2b463423d5a3c1b7feac564afbb61215f94aff21832f55f"}
Jul 28 01:49:29.991237 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:29.991201    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" event={"ID":"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0","Type":"ContainerStarted","Data":"50f45147259b51fc6bc93cea6721178dbbb98762bb1e15dc0de60bb657bbfbd4"}
Jul 28 01:49:29.991603 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:29.991310    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:30.019284 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:30.019235    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" podStartSLOduration=1.742592801 podStartE2EDuration="22.019219636s" totalImagesPullingTime="16.504420604s" totalInitContainerRuntime="3.772206231s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:49:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:49:30.016672862 +0000 UTC m=+1403.033371506" watchObservedRunningTime="2026-07-28 01:49:30.019219636 +0000 UTC m=+1403.035918278"
Jul 28 01:49:30.995610 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:30.995570    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:30.996484 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:30.996449    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Jul 28 01:49:32.000852 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:32.000808    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Jul 28 01:49:37.005153 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:37.005126    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:49:37.005654 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:37.005626    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Jul 28 01:49:47.005589 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:47.005532    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Jul 28 01:49:57.005807 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:49:57.005766    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Jul 28 01:50:07.005682 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:07.005596    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Jul 28 01:50:17.006520 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:17.006482    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Jul 28 01:50:27.005761 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:27.005717    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Jul 28 01:50:37.005653 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:37.005611    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Jul 28 01:50:40.546736 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:40.546704    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:50:48.681597 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:48.681564    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"]
Jul 28 01:50:48.682023 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:48.681788    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kserve-container" containerID="cri-o://f2358e53c1b97142b2b463423d5a3c1b7feac564afbb61215f94aff21832f55f" gracePeriod=30
Jul 28 01:50:48.682023 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:48.681829    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kube-rbac-proxy" containerID="cri-o://50f45147259b51fc6bc93cea6721178dbbb98762bb1e15dc0de60bb657bbfbd4" gracePeriod=30
Jul 28 01:50:49.301036 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:49.300996    2558 generic.go:356] "Generic (PLEG): container finished" podID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerID="50f45147259b51fc6bc93cea6721178dbbb98762bb1e15dc0de60bb657bbfbd4" exitCode=2
Jul 28 01:50:49.301201 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:49.301055    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" event={"ID":"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0","Type":"ContainerDied","Data":"50f45147259b51fc6bc93cea6721178dbbb98762bb1e15dc0de60bb657bbfbd4"}
Jul 28 01:50:50.546219 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:50.546182    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused"
Jul 28 01:50:52.001907 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:52.001871    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.24:8643/healthz\": dial tcp 10.133.0.24:8643: connect: connection refused"
Jul 28 01:50:53.122148 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.122120    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:50:53.223214 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.223186    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-kserve-provision-location\") pod \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") "
Jul 28 01:50:53.223214 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.223216    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-cabundle-cert\") pod \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") "
Jul 28 01:50:53.223436 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.223262    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-proxy-tls\") pod \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") "
Jul 28 01:50:53.223436 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.223282    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-kube-rbac-proxy-sar-config\") pod \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") "
Jul 28 01:50:53.223436 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.223331    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqfm2\" (UniqueName: \"kubernetes.io/projected/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-kube-api-access-gqfm2\") pod \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\" (UID: \"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0\") "
Jul 28 01:50:53.223628 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.223590    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" (UID: "e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:50:53.223725 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.223700    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" (UID: "e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:50:53.223797 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.223714    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" (UID: "e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:50:53.225561 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.225525    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" (UID: "e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:50:53.225694 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.225673    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-kube-api-access-gqfm2" (OuterVolumeSpecName: "kube-api-access-gqfm2") pod "e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" (UID: "e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0"). InnerVolumeSpecName "kube-api-access-gqfm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:50:53.317230 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.317198    2558 generic.go:356] "Generic (PLEG): container finished" podID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerID="f2358e53c1b97142b2b463423d5a3c1b7feac564afbb61215f94aff21832f55f" exitCode=0
Jul 28 01:50:53.317363 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.317255    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"
Jul 28 01:50:53.317363 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.317288    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" event={"ID":"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0","Type":"ContainerDied","Data":"f2358e53c1b97142b2b463423d5a3c1b7feac564afbb61215f94aff21832f55f"}
Jul 28 01:50:53.317363 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.317347    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz" event={"ID":"e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0","Type":"ContainerDied","Data":"3ed726bfe2ce692815f5379a9c9c238845a6ec1c9e4cc513a3ccbf428d534c22"}
Jul 28 01:50:53.317480 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.317374    2558 scope.go:117] "RemoveContainer" containerID="50f45147259b51fc6bc93cea6721178dbbb98762bb1e15dc0de60bb657bbfbd4"
Jul 28 01:50:53.324353 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.324331    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqfm2\" (UniqueName: \"kubernetes.io/projected/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-kube-api-access-gqfm2\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:50:53.324460 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.324363    2558 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-kserve-provision-location\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:50:53.324460 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.324378    2558 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-cabundle-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:50:53.324460 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.324391    2558 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-proxy-tls\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:50:53.324460 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.324405    2558 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:50:53.326049 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.326033    2558 scope.go:117] "RemoveContainer" containerID="f2358e53c1b97142b2b463423d5a3c1b7feac564afbb61215f94aff21832f55f"
Jul 28 01:50:53.333128 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.333113    2558 scope.go:117] "RemoveContainer" containerID="6435e3386a7e570ff8c63811d1abb105b041edeac75fd26e6012171aed32b6c5"
Jul 28 01:50:53.339151 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.339130    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"]
Jul 28 01:50:53.340483 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.340470    2558 scope.go:117] "RemoveContainer" containerID="50f45147259b51fc6bc93cea6721178dbbb98762bb1e15dc0de60bb657bbfbd4"
Jul 28 01:50:53.340758 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:50:53.340706    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50f45147259b51fc6bc93cea6721178dbbb98762bb1e15dc0de60bb657bbfbd4\": container with ID starting with 50f45147259b51fc6bc93cea6721178dbbb98762bb1e15dc0de60bb657bbfbd4 not found: ID does not exist" containerID="50f45147259b51fc6bc93cea6721178dbbb98762bb1e15dc0de60bb657bbfbd4"
Jul 28 01:50:53.340758 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.340741    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50f45147259b51fc6bc93cea6721178dbbb98762bb1e15dc0de60bb657bbfbd4"} err="failed to get container status \"50f45147259b51fc6bc93cea6721178dbbb98762bb1e15dc0de60bb657bbfbd4\": rpc error: code = NotFound desc = could not find container \"50f45147259b51fc6bc93cea6721178dbbb98762bb1e15dc0de60bb657bbfbd4\": container with ID starting with 50f45147259b51fc6bc93cea6721178dbbb98762bb1e15dc0de60bb657bbfbd4 not found: ID does not exist"
Jul 28 01:50:53.340977 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.340763    2558 scope.go:117] "RemoveContainer" containerID="f2358e53c1b97142b2b463423d5a3c1b7feac564afbb61215f94aff21832f55f"
Jul 28 01:50:53.341131 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:50:53.341106    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2358e53c1b97142b2b463423d5a3c1b7feac564afbb61215f94aff21832f55f\": container with ID starting with f2358e53c1b97142b2b463423d5a3c1b7feac564afbb61215f94aff21832f55f not found: ID does not exist" containerID="f2358e53c1b97142b2b463423d5a3c1b7feac564afbb61215f94aff21832f55f"
Jul 28 01:50:53.341248 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.341136    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2358e53c1b97142b2b463423d5a3c1b7feac564afbb61215f94aff21832f55f"} err="failed to get container status \"f2358e53c1b97142b2b463423d5a3c1b7feac564afbb61215f94aff21832f55f\": rpc error: code = NotFound desc = could not find container \"f2358e53c1b97142b2b463423d5a3c1b7feac564afbb61215f94aff21832f55f\": container with ID starting with f2358e53c1b97142b2b463423d5a3c1b7feac564afbb61215f94aff21832f55f not found: ID does not exist"
Jul 28 01:50:53.341248 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.341151    2558 scope.go:117] "RemoveContainer" containerID="6435e3386a7e570ff8c63811d1abb105b041edeac75fd26e6012171aed32b6c5"
Jul 28 01:50:53.341389 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:50:53.341373    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6435e3386a7e570ff8c63811d1abb105b041edeac75fd26e6012171aed32b6c5\": container with ID starting with 6435e3386a7e570ff8c63811d1abb105b041edeac75fd26e6012171aed32b6c5 not found: ID does not exist" containerID="6435e3386a7e570ff8c63811d1abb105b041edeac75fd26e6012171aed32b6c5"
Jul 28 01:50:53.341447 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.341394    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6435e3386a7e570ff8c63811d1abb105b041edeac75fd26e6012171aed32b6c5"} err="failed to get container status \"6435e3386a7e570ff8c63811d1abb105b041edeac75fd26e6012171aed32b6c5\": rpc error: code = NotFound desc = could not find container \"6435e3386a7e570ff8c63811d1abb105b041edeac75fd26e6012171aed32b6c5\": container with ID starting with 6435e3386a7e570ff8c63811d1abb105b041edeac75fd26e6012171aed32b6c5 not found: ID does not exist"
Jul 28 01:50:53.342622 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.342601    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-br2tz"]
Jul 28 01:50:53.550518 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.550441    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" path="/var/lib/kubelet/pods/e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0/volumes"
Jul 28 01:50:53.834327 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.834253    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"]
Jul 28 01:50:53.834570 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.834557    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="storage-initializer"
Jul 28 01:50:53.834619 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.834572    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="storage-initializer"
Jul 28 01:50:53.834619 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.834581    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kube-rbac-proxy"
Jul 28 01:50:53.834619 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.834587    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kube-rbac-proxy"
Jul 28 01:50:53.834619 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.834595    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kserve-container"
Jul 28 01:50:53.834619 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.834600    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kserve-container"
Jul 28 01:50:53.834766 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.834652    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kserve-container"
Jul 28 01:50:53.834766 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.834659    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2582450-c9e1-4dbf-b3b3-87ac9dd9cdb0" containerName="kube-rbac-proxy"
Jul 28 01:50:53.839249 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.839230    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:50:53.841978 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.841951    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 01:50:53.841978 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.841951    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 28 01:50:53.842324 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.841959    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 28 01:50:53.842324 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.842083    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-predictor-serving-cert\""
Jul 28 01:50:53.842324 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.842310    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 28 01:50:53.842494 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.842318    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\""
Jul 28 01:50:53.842494 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.842423    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-cl94s\""
Jul 28 01:50:53.851341 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.851319    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"]
Jul 28 01:50:53.929289 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.929265    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/68056153-71a5-4c56-b80d-1eca5e42fdb4-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-msst7\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:50:53.929289 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.929298    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/68056153-71a5-4c56-b80d-1eca5e42fdb4-cabundle-cert\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-msst7\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:50:53.929457 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.929321    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/68056153-71a5-4c56-b80d-1eca5e42fdb4-proxy-tls\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-msst7\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:50:53.929457 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.929339    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t4vn\" (UniqueName: \"kubernetes.io/projected/68056153-71a5-4c56-b80d-1eca5e42fdb4-kube-api-access-8t4vn\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-msst7\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:50:53.929457 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:53.929408    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/68056153-71a5-4c56-b80d-1eca5e42fdb4-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-msst7\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:50:54.030746 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:54.030716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/68056153-71a5-4c56-b80d-1eca5e42fdb4-cabundle-cert\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-msst7\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:50:54.030871 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:54.030754    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/68056153-71a5-4c56-b80d-1eca5e42fdb4-proxy-tls\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-msst7\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:50:54.030871 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:54.030773    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t4vn\" (UniqueName: \"kubernetes.io/projected/68056153-71a5-4c56-b80d-1eca5e42fdb4-kube-api-access-8t4vn\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-msst7\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:50:54.030871 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:54.030828    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/68056153-71a5-4c56-b80d-1eca5e42fdb4-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-msst7\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:50:54.030971 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:54.030900    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/68056153-71a5-4c56-b80d-1eca5e42fdb4-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-msst7\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:50:54.031319 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:54.031299    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/68056153-71a5-4c56-b80d-1eca5e42fdb4-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-msst7\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:50:54.031474 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:54.031459    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/68056153-71a5-4c56-b80d-1eca5e42fdb4-cabundle-cert\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-msst7\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:50:54.031534 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:54.031515    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/68056153-71a5-4c56-b80d-1eca5e42fdb4-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-msst7\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:50:54.033595 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:54.033574    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/68056153-71a5-4c56-b80d-1eca5e42fdb4-proxy-tls\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-msst7\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:50:54.039244 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:54.039222    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t4vn\" (UniqueName: \"kubernetes.io/projected/68056153-71a5-4c56-b80d-1eca5e42fdb4-kube-api-access-8t4vn\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-msst7\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:50:54.152395 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:54.152314    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:50:54.280270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:54.280240    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"]
Jul 28 01:50:54.283420 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:50:54.283396    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68056153_71a5_4c56_b80d_1eca5e42fdb4.slice/crio-9255e3459ef00ac151e200c50e2dffc1de69231543ddfba0246aadc5b4ad80e5 WatchSource:0}: Error finding container 9255e3459ef00ac151e200c50e2dffc1de69231543ddfba0246aadc5b4ad80e5: Status 404 returned error can't find the container with id 9255e3459ef00ac151e200c50e2dffc1de69231543ddfba0246aadc5b4ad80e5
Jul 28 01:50:54.322777 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:54.322755    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" event={"ID":"68056153-71a5-4c56-b80d-1eca5e42fdb4","Type":"ContainerStarted","Data":"9255e3459ef00ac151e200c50e2dffc1de69231543ddfba0246aadc5b4ad80e5"}
Jul 28 01:50:55.329251 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:55.329217    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" event={"ID":"68056153-71a5-4c56-b80d-1eca5e42fdb4","Type":"ContainerStarted","Data":"3d0050c21dd15ec8d0187437f1e54c0ca315e3902e7acb8e28a5cf766676b9d7"}
Jul 28 01:50:58.343329 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:58.343247    2558 generic.go:356] "Generic (PLEG): container finished" podID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerID="3d0050c21dd15ec8d0187437f1e54c0ca315e3902e7acb8e28a5cf766676b9d7" exitCode=0
Jul 28 01:50:58.343329 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:58.343320    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" event={"ID":"68056153-71a5-4c56-b80d-1eca5e42fdb4","Type":"ContainerDied","Data":"3d0050c21dd15ec8d0187437f1e54c0ca315e3902e7acb8e28a5cf766676b9d7"}
Jul 28 01:50:59.349013 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:59.348980    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" event={"ID":"68056153-71a5-4c56-b80d-1eca5e42fdb4","Type":"ContainerStarted","Data":"51bf9957fa2e6f6e87e0137606acdef616ecf913a685bb01067a1b058a98bb67"}
Jul 28 01:50:59.349373 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:59.349040    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" event={"ID":"68056153-71a5-4c56-b80d-1eca5e42fdb4","Type":"ContainerStarted","Data":"e6b77d4452e16b44e82a7037bc1472353644235e03e3b298fac0444bf4a209e1"}
Jul 28 01:50:59.349373 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:59.349272    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:50:59.379970 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:50:59.379923    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" podStartSLOduration=2.755461999 podStartE2EDuration="6.379906446s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.624444447s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:50:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:50:59.378501368 +0000 UTC m=+1492.395200010" watchObservedRunningTime="2026-07-28 01:50:59.379906446 +0000 UTC m=+1492.396605092"
Jul 28 01:51:00.353322 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:51:00.353294    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:51:00.354508 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:51:00.354482    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 28 01:51:01.357561 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:51:01.357513    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 28 01:51:06.363281 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:51:06.363254    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:51:06.363763 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:51:06.363736    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 28 01:51:07.466043 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:51:07.466014    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 01:51:07.466452 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:51:07.466014    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 01:51:16.363787 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:51:16.363741    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 28 01:51:26.363704 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:51:26.363659    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 28 01:51:36.364274 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:51:36.364236    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 28 01:51:46.364054 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:51:46.364008    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 28 01:51:56.364640 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:51:56.364598    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 28 01:52:06.364030 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:52:06.363987    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 28 01:52:16.365114 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:52:16.365085    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:53:43.987363 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:43.987333    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"]
Jul 28 01:53:43.989908 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:43.987583    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kserve-container" containerID="cri-o://e6b77d4452e16b44e82a7037bc1472353644235e03e3b298fac0444bf4a209e1" gracePeriod=30
Jul 28 01:53:43.989908 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:43.987631    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kube-rbac-proxy" containerID="cri-o://51bf9957fa2e6f6e87e0137606acdef616ecf913a685bb01067a1b058a98bb67" gracePeriod=30
Jul 28 01:53:44.990207 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:44.990176    2558 generic.go:356] "Generic (PLEG): container finished" podID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerID="51bf9957fa2e6f6e87e0137606acdef616ecf913a685bb01067a1b058a98bb67" exitCode=2
Jul 28 01:53:44.990602 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:44.990234    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" event={"ID":"68056153-71a5-4c56-b80d-1eca5e42fdb4","Type":"ContainerDied","Data":"51bf9957fa2e6f6e87e0137606acdef616ecf913a685bb01067a1b058a98bb67"}
Jul 28 01:53:46.358543 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:46.358504    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.25:8643/healthz\": dial tcp 10.133.0.25:8643: connect: connection refused"
Jul 28 01:53:46.363962 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:46.363928    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused"
Jul 28 01:53:48.334591 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:48.334567    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:53:48.396194 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:48.396139    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/68056153-71a5-4c56-b80d-1eca5e42fdb4-proxy-tls\") pod \"68056153-71a5-4c56-b80d-1eca5e42fdb4\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") "
Jul 28 01:53:48.396194 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:48.396194    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/68056153-71a5-4c56-b80d-1eca5e42fdb4-kserve-provision-location\") pod \"68056153-71a5-4c56-b80d-1eca5e42fdb4\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") "
Jul 28 01:53:48.396355 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:48.396212    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/68056153-71a5-4c56-b80d-1eca5e42fdb4-cabundle-cert\") pod \"68056153-71a5-4c56-b80d-1eca5e42fdb4\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") "
Jul 28 01:53:48.396355 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:48.396234    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t4vn\" (UniqueName: \"kubernetes.io/projected/68056153-71a5-4c56-b80d-1eca5e42fdb4-kube-api-access-8t4vn\") pod \"68056153-71a5-4c56-b80d-1eca5e42fdb4\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") "
Jul 28 01:53:48.396355 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:48.396285    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/68056153-71a5-4c56-b80d-1eca5e42fdb4-kube-rbac-proxy-sar-config\") pod \"68056153-71a5-4c56-b80d-1eca5e42fdb4\" (UID: \"68056153-71a5-4c56-b80d-1eca5e42fdb4\") "
Jul 28 01:53:48.396607 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:48.396583    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68056153-71a5-4c56-b80d-1eca5e42fdb4-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "68056153-71a5-4c56-b80d-1eca5e42fdb4" (UID: "68056153-71a5-4c56-b80d-1eca5e42fdb4"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:53:48.396683 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:48.396604    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68056153-71a5-4c56-b80d-1eca5e42fdb4-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "68056153-71a5-4c56-b80d-1eca5e42fdb4" (UID: "68056153-71a5-4c56-b80d-1eca5e42fdb4"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:53:48.396683 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:48.396662    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68056153-71a5-4c56-b80d-1eca5e42fdb4-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "68056153-71a5-4c56-b80d-1eca5e42fdb4" (UID: "68056153-71a5-4c56-b80d-1eca5e42fdb4"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:53:48.398255 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:48.398233    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68056153-71a5-4c56-b80d-1eca5e42fdb4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "68056153-71a5-4c56-b80d-1eca5e42fdb4" (UID: "68056153-71a5-4c56-b80d-1eca5e42fdb4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:53:48.398448 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:48.398427    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68056153-71a5-4c56-b80d-1eca5e42fdb4-kube-api-access-8t4vn" (OuterVolumeSpecName: "kube-api-access-8t4vn") pod "68056153-71a5-4c56-b80d-1eca5e42fdb4" (UID: "68056153-71a5-4c56-b80d-1eca5e42fdb4"). InnerVolumeSpecName "kube-api-access-8t4vn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:53:48.496815 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:48.496790    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t4vn\" (UniqueName: \"kubernetes.io/projected/68056153-71a5-4c56-b80d-1eca5e42fdb4-kube-api-access-8t4vn\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:53:48.496815 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:48.496811    2558 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/68056153-71a5-4c56-b80d-1eca5e42fdb4-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:53:48.496946 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:48.496824    2558 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/68056153-71a5-4c56-b80d-1eca5e42fdb4-proxy-tls\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:53:48.496946 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:48.496832    2558 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/68056153-71a5-4c56-b80d-1eca5e42fdb4-kserve-provision-location\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:53:48.496946 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:48.496841    2558 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/68056153-71a5-4c56-b80d-1eca5e42fdb4-cabundle-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:53:49.010753 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.010721    2558 generic.go:356] "Generic (PLEG): container finished" podID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerID="e6b77d4452e16b44e82a7037bc1472353644235e03e3b298fac0444bf4a209e1" exitCode=0
Jul 28 01:53:49.010921 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.010781    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" event={"ID":"68056153-71a5-4c56-b80d-1eca5e42fdb4","Type":"ContainerDied","Data":"e6b77d4452e16b44e82a7037bc1472353644235e03e3b298fac0444bf4a209e1"}
Jul 28 01:53:49.010921 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.010783    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"
Jul 28 01:53:49.010921 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.010843    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7" event={"ID":"68056153-71a5-4c56-b80d-1eca5e42fdb4","Type":"ContainerDied","Data":"9255e3459ef00ac151e200c50e2dffc1de69231543ddfba0246aadc5b4ad80e5"}
Jul 28 01:53:49.010921 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.010880    2558 scope.go:117] "RemoveContainer" containerID="51bf9957fa2e6f6e87e0137606acdef616ecf913a685bb01067a1b058a98bb67"
Jul 28 01:53:49.019472 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.019454    2558 scope.go:117] "RemoveContainer" containerID="e6b77d4452e16b44e82a7037bc1472353644235e03e3b298fac0444bf4a209e1"
Jul 28 01:53:49.026730 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.026708    2558 scope.go:117] "RemoveContainer" containerID="3d0050c21dd15ec8d0187437f1e54c0ca315e3902e7acb8e28a5cf766676b9d7"
Jul 28 01:53:49.031713 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.031692    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"]
Jul 28 01:53:49.034437 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.034418    2558 scope.go:117] "RemoveContainer" containerID="51bf9957fa2e6f6e87e0137606acdef616ecf913a685bb01067a1b058a98bb67"
Jul 28 01:53:49.034781 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:53:49.034764    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51bf9957fa2e6f6e87e0137606acdef616ecf913a685bb01067a1b058a98bb67\": container with ID starting with 51bf9957fa2e6f6e87e0137606acdef616ecf913a685bb01067a1b058a98bb67 not found: ID does not exist" containerID="51bf9957fa2e6f6e87e0137606acdef616ecf913a685bb01067a1b058a98bb67"
Jul 28 01:53:49.034853 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.034789    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51bf9957fa2e6f6e87e0137606acdef616ecf913a685bb01067a1b058a98bb67"} err="failed to get container status \"51bf9957fa2e6f6e87e0137606acdef616ecf913a685bb01067a1b058a98bb67\": rpc error: code = NotFound desc = could not find container \"51bf9957fa2e6f6e87e0137606acdef616ecf913a685bb01067a1b058a98bb67\": container with ID starting with 51bf9957fa2e6f6e87e0137606acdef616ecf913a685bb01067a1b058a98bb67 not found: ID does not exist"
Jul 28 01:53:49.034853 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.034809    2558 scope.go:117] "RemoveContainer" containerID="e6b77d4452e16b44e82a7037bc1472353644235e03e3b298fac0444bf4a209e1"
Jul 28 01:53:49.035276 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:53:49.035234    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6b77d4452e16b44e82a7037bc1472353644235e03e3b298fac0444bf4a209e1\": container with ID starting with e6b77d4452e16b44e82a7037bc1472353644235e03e3b298fac0444bf4a209e1 not found: ID does not exist" containerID="e6b77d4452e16b44e82a7037bc1472353644235e03e3b298fac0444bf4a209e1"
Jul 28 01:53:49.035276 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.035265    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6b77d4452e16b44e82a7037bc1472353644235e03e3b298fac0444bf4a209e1"} err="failed to get container status \"e6b77d4452e16b44e82a7037bc1472353644235e03e3b298fac0444bf4a209e1\": rpc error: code = NotFound desc = could not find container \"e6b77d4452e16b44e82a7037bc1472353644235e03e3b298fac0444bf4a209e1\": container with ID starting with e6b77d4452e16b44e82a7037bc1472353644235e03e3b298fac0444bf4a209e1 not found: ID does not exist"
Jul 28 01:53:49.035502 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.035286    2558 scope.go:117] "RemoveContainer" containerID="3d0050c21dd15ec8d0187437f1e54c0ca315e3902e7acb8e28a5cf766676b9d7"
Jul 28 01:53:49.035769 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:53:49.035745    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d0050c21dd15ec8d0187437f1e54c0ca315e3902e7acb8e28a5cf766676b9d7\": container with ID starting with 3d0050c21dd15ec8d0187437f1e54c0ca315e3902e7acb8e28a5cf766676b9d7 not found: ID does not exist" containerID="3d0050c21dd15ec8d0187437f1e54c0ca315e3902e7acb8e28a5cf766676b9d7"
Jul 28 01:53:49.035871 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.035779    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d0050c21dd15ec8d0187437f1e54c0ca315e3902e7acb8e28a5cf766676b9d7"} err="failed to get container status \"3d0050c21dd15ec8d0187437f1e54c0ca315e3902e7acb8e28a5cf766676b9d7\": rpc error: code = NotFound desc = could not find container \"3d0050c21dd15ec8d0187437f1e54c0ca315e3902e7acb8e28a5cf766676b9d7\": container with ID starting with 3d0050c21dd15ec8d0187437f1e54c0ca315e3902e7acb8e28a5cf766676b9d7 not found: ID does not exist"
Jul 28 01:53:49.036977 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.036959    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-msst7"]
Jul 28 01:53:49.158610 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.158578    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"]
Jul 28 01:53:49.158894 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.158882    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kserve-container"
Jul 28 01:53:49.158944 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.158896    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kserve-container"
Jul 28 01:53:49.158944 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.158910    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="storage-initializer"
Jul 28 01:53:49.158944 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.158916    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="storage-initializer"
Jul 28 01:53:49.158944 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.158925    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kube-rbac-proxy"
Jul 28 01:53:49.158944 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.158931    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kube-rbac-proxy"
Jul 28 01:53:49.159114 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.158972    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kserve-container"
Jul 28 01:53:49.159114 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.158981    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" containerName="kube-rbac-proxy"
Jul 28 01:53:49.163599 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.163580    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:49.166300 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.166160    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-stop-kube-rbac-proxy-sar-config\""
Jul 28 01:53:49.166300 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.166238    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 28 01:53:49.166300 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.166267    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-cl94s\""
Jul 28 01:53:49.166300 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.166266    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 01:53:49.166681 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.166327    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 28 01:53:49.166681 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.166645    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-stop-predictor-serving-cert\""
Jul 28 01:53:49.166793 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.166768    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 28 01:53:49.173434 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.173410    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"]
Jul 28 01:53:49.201505 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.201469    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/17e0ffc7-5bca-4bc5-abb4-4ee926401337-cabundle-cert\") pod \"isvc-canary-stop-predictor-86dc9fdb65-vjtj4\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:49.201649 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.201517    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2xft\" (UniqueName: \"kubernetes.io/projected/17e0ffc7-5bca-4bc5-abb4-4ee926401337-kube-api-access-d2xft\") pod \"isvc-canary-stop-predictor-86dc9fdb65-vjtj4\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:49.201649 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.201578    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/17e0ffc7-5bca-4bc5-abb4-4ee926401337-kserve-provision-location\") pod \"isvc-canary-stop-predictor-86dc9fdb65-vjtj4\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:49.201649 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.201595    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/17e0ffc7-5bca-4bc5-abb4-4ee926401337-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-86dc9fdb65-vjtj4\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:49.201649 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.201614    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/17e0ffc7-5bca-4bc5-abb4-4ee926401337-proxy-tls\") pod \"isvc-canary-stop-predictor-86dc9fdb65-vjtj4\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:49.302720 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.302630    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2xft\" (UniqueName: \"kubernetes.io/projected/17e0ffc7-5bca-4bc5-abb4-4ee926401337-kube-api-access-d2xft\") pod \"isvc-canary-stop-predictor-86dc9fdb65-vjtj4\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:49.302720 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.302667    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/17e0ffc7-5bca-4bc5-abb4-4ee926401337-kserve-provision-location\") pod \"isvc-canary-stop-predictor-86dc9fdb65-vjtj4\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:49.302720 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.302696    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/17e0ffc7-5bca-4bc5-abb4-4ee926401337-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-86dc9fdb65-vjtj4\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:49.303006 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.302727    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/17e0ffc7-5bca-4bc5-abb4-4ee926401337-proxy-tls\") pod \"isvc-canary-stop-predictor-86dc9fdb65-vjtj4\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:49.303006 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.302814    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/17e0ffc7-5bca-4bc5-abb4-4ee926401337-cabundle-cert\") pod \"isvc-canary-stop-predictor-86dc9fdb65-vjtj4\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:49.303140 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.303121    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/17e0ffc7-5bca-4bc5-abb4-4ee926401337-kserve-provision-location\") pod \"isvc-canary-stop-predictor-86dc9fdb65-vjtj4\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:49.303455 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.303432    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/17e0ffc7-5bca-4bc5-abb4-4ee926401337-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-86dc9fdb65-vjtj4\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:49.303455 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.303446    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/17e0ffc7-5bca-4bc5-abb4-4ee926401337-cabundle-cert\") pod \"isvc-canary-stop-predictor-86dc9fdb65-vjtj4\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:49.305422 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.305402    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/17e0ffc7-5bca-4bc5-abb4-4ee926401337-proxy-tls\") pod \"isvc-canary-stop-predictor-86dc9fdb65-vjtj4\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:49.311386 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.311362    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2xft\" (UniqueName: \"kubernetes.io/projected/17e0ffc7-5bca-4bc5-abb4-4ee926401337-kube-api-access-d2xft\") pod \"isvc-canary-stop-predictor-86dc9fdb65-vjtj4\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:49.474902 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.474864    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:49.551137 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.551106    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68056153-71a5-4c56-b80d-1eca5e42fdb4" path="/var/lib/kubelet/pods/68056153-71a5-4c56-b80d-1eca5e42fdb4/volumes"
Jul 28 01:53:49.605608 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:49.605573    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"]
Jul 28 01:53:49.607706 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:53:49.607683    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e0ffc7_5bca_4bc5_abb4_4ee926401337.slice/crio-5f783f97f610bd138c2894b71c8e161730506d6734a71827cf3ac500e1deecb7 WatchSource:0}: Error finding container 5f783f97f610bd138c2894b71c8e161730506d6734a71827cf3ac500e1deecb7: Status 404 returned error can't find the container with id 5f783f97f610bd138c2894b71c8e161730506d6734a71827cf3ac500e1deecb7
Jul 28 01:53:50.016960 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:50.016926    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" event={"ID":"17e0ffc7-5bca-4bc5-abb4-4ee926401337","Type":"ContainerStarted","Data":"67649e35604279f6a7433086e91cc434fd93e26a2cebe8810a7643477daa2f9b"}
Jul 28 01:53:50.017129 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:50.016981    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" event={"ID":"17e0ffc7-5bca-4bc5-abb4-4ee926401337","Type":"ContainerStarted","Data":"5f783f97f610bd138c2894b71c8e161730506d6734a71827cf3ac500e1deecb7"}
Jul 28 01:53:54.033555 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:54.033523    2558 generic.go:356] "Generic (PLEG): container finished" podID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerID="67649e35604279f6a7433086e91cc434fd93e26a2cebe8810a7643477daa2f9b" exitCode=0
Jul 28 01:53:54.033949 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:54.033596    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" event={"ID":"17e0ffc7-5bca-4bc5-abb4-4ee926401337","Type":"ContainerDied","Data":"67649e35604279f6a7433086e91cc434fd93e26a2cebe8810a7643477daa2f9b"}
Jul 28 01:53:55.039082 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:55.039046    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" event={"ID":"17e0ffc7-5bca-4bc5-abb4-4ee926401337","Type":"ContainerStarted","Data":"a528bf750e45a528abbdb2bf52242ad049e66bde5148f263bffda48abc755e98"}
Jul 28 01:53:55.039498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:55.039129    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" event={"ID":"17e0ffc7-5bca-4bc5-abb4-4ee926401337","Type":"ContainerStarted","Data":"c94521e3d07715a56954c5ff113092ac361c8702b742627773b2589f7ef2f0b4"}
Jul 28 01:53:55.039498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:55.039356    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:55.058651 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:55.058603    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" podStartSLOduration=2.488211257 podStartE2EDuration="6.058588735s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.570377478s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:53:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:53:55.05675024 +0000 UTC m=+1668.073448877" watchObservedRunningTime="2026-07-28 01:53:55.058588735 +0000 UTC m=+1668.075287377"
Jul 28 01:53:56.044171 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:56.044137    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:53:56.045423 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:56.045398    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Jul 28 01:53:57.047789 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:53:57.047747    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Jul 28 01:54:02.052431 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:54:02.052403    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:54:02.052953 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:54:02.052928    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Jul 28 01:54:12.053600 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:54:12.053534    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Jul 28 01:54:22.053125 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:54:22.053082    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Jul 28 01:54:32.053133 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:54:32.053053    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Jul 28 01:54:42.052847 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:54:42.052806    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Jul 28 01:54:52.052888 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:54:52.052851    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Jul 28 01:55:02.053861 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:02.053821    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Jul 28 01:55:12.054181 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:12.054152    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:55:19.214383 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:19.214353    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"]
Jul 28 01:55:19.214880 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:19.214616    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kserve-container" containerID="cri-o://c94521e3d07715a56954c5ff113092ac361c8702b742627773b2589f7ef2f0b4" gracePeriod=30
Jul 28 01:55:19.214880 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:19.214697    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kube-rbac-proxy" containerID="cri-o://a528bf750e45a528abbdb2bf52242ad049e66bde5148f263bffda48abc755e98" gracePeriod=30
Jul 28 01:55:19.366454 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:19.366410    2558 generic.go:356] "Generic (PLEG): container finished" podID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerID="a528bf750e45a528abbdb2bf52242ad049e66bde5148f263bffda48abc755e98" exitCode=2
Jul 28 01:55:19.366613 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:19.366484    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" event={"ID":"17e0ffc7-5bca-4bc5-abb4-4ee926401337","Type":"ContainerDied","Data":"a528bf750e45a528abbdb2bf52242ad049e66bde5148f263bffda48abc755e98"}
Jul 28 01:55:22.048975 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:22.048935    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.26:8643/healthz\": dial tcp 10.133.0.26:8643: connect: connection refused"
Jul 28 01:55:22.053270 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:22.053250    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused"
Jul 28 01:55:23.385526 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:23.385489    2558 generic.go:356] "Generic (PLEG): container finished" podID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerID="c94521e3d07715a56954c5ff113092ac361c8702b742627773b2589f7ef2f0b4" exitCode=0
Jul 28 01:55:23.385850 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:23.385520    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" event={"ID":"17e0ffc7-5bca-4bc5-abb4-4ee926401337","Type":"ContainerDied","Data":"c94521e3d07715a56954c5ff113092ac361c8702b742627773b2589f7ef2f0b4"}
Jul 28 01:55:23.454528 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:23.454504    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:55:23.561025 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:23.560964    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/17e0ffc7-5bca-4bc5-abb4-4ee926401337-cabundle-cert\") pod \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") "
Jul 28 01:55:23.561173 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:23.561066    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/17e0ffc7-5bca-4bc5-abb4-4ee926401337-proxy-tls\") pod \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") "
Jul 28 01:55:23.561173 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:23.561141    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/17e0ffc7-5bca-4bc5-abb4-4ee926401337-kserve-provision-location\") pod \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") "
Jul 28 01:55:23.561296 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:23.561176    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/17e0ffc7-5bca-4bc5-abb4-4ee926401337-kube-rbac-proxy-sar-config\") pod \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") "
Jul 28 01:55:23.561296 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:23.561205    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2xft\" (UniqueName: \"kubernetes.io/projected/17e0ffc7-5bca-4bc5-abb4-4ee926401337-kube-api-access-d2xft\") pod \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\" (UID: \"17e0ffc7-5bca-4bc5-abb4-4ee926401337\") "
Jul 28 01:55:23.561392 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:23.561331    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17e0ffc7-5bca-4bc5-abb4-4ee926401337-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "17e0ffc7-5bca-4bc5-abb4-4ee926401337" (UID: "17e0ffc7-5bca-4bc5-abb4-4ee926401337"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:55:23.561492 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:23.561475    2558 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/17e0ffc7-5bca-4bc5-abb4-4ee926401337-cabundle-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:55:23.561492 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:23.561477    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17e0ffc7-5bca-4bc5-abb4-4ee926401337-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "17e0ffc7-5bca-4bc5-abb4-4ee926401337" (UID: "17e0ffc7-5bca-4bc5-abb4-4ee926401337"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:55:23.561638 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:23.561488    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17e0ffc7-5bca-4bc5-abb4-4ee926401337-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "17e0ffc7-5bca-4bc5-abb4-4ee926401337" (UID: "17e0ffc7-5bca-4bc5-abb4-4ee926401337"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:55:23.563363 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:23.563335    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17e0ffc7-5bca-4bc5-abb4-4ee926401337-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "17e0ffc7-5bca-4bc5-abb4-4ee926401337" (UID: "17e0ffc7-5bca-4bc5-abb4-4ee926401337"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:55:23.563363 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:23.563345    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17e0ffc7-5bca-4bc5-abb4-4ee926401337-kube-api-access-d2xft" (OuterVolumeSpecName: "kube-api-access-d2xft") pod "17e0ffc7-5bca-4bc5-abb4-4ee926401337" (UID: "17e0ffc7-5bca-4bc5-abb4-4ee926401337"). InnerVolumeSpecName "kube-api-access-d2xft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:55:23.662399 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:23.662370    2558 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/17e0ffc7-5bca-4bc5-abb4-4ee926401337-proxy-tls\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:55:23.662399 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:23.662393    2558 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/17e0ffc7-5bca-4bc5-abb4-4ee926401337-kserve-provision-location\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:55:23.662399 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:23.662403    2558 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/17e0ffc7-5bca-4bc5-abb4-4ee926401337-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:55:23.662602 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:23.662412    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2xft\" (UniqueName: \"kubernetes.io/projected/17e0ffc7-5bca-4bc5-abb4-4ee926401337-kube-api-access-d2xft\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:55:24.391366 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:24.391340    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"
Jul 28 01:55:24.391366 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:24.391351    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4" event={"ID":"17e0ffc7-5bca-4bc5-abb4-4ee926401337","Type":"ContainerDied","Data":"5f783f97f610bd138c2894b71c8e161730506d6734a71827cf3ac500e1deecb7"}
Jul 28 01:55:24.391852 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:24.391413    2558 scope.go:117] "RemoveContainer" containerID="a528bf750e45a528abbdb2bf52242ad049e66bde5148f263bffda48abc755e98"
Jul 28 01:55:24.399871 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:24.399855    2558 scope.go:117] "RemoveContainer" containerID="c94521e3d07715a56954c5ff113092ac361c8702b742627773b2589f7ef2f0b4"
Jul 28 01:55:24.406785 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:24.406769    2558 scope.go:117] "RemoveContainer" containerID="67649e35604279f6a7433086e91cc434fd93e26a2cebe8810a7643477daa2f9b"
Jul 28 01:55:24.412421 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:24.412400    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"]
Jul 28 01:55:24.418145 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:24.418123    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-86dc9fdb65-vjtj4"]
Jul 28 01:55:25.550498 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:55:25.550463    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" path="/var/lib/kubelet/pods/17e0ffc7-5bca-4bc5-abb4-4ee926401337/volumes"
Jul 28 01:56:07.489187 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:56:07.489162    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 01:56:07.489653 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:56:07.489634    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 01:57:04.824878 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.824843    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"]
Jul 28 01:57:04.825342 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.825126    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kserve-container"
Jul 28 01:57:04.825342 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.825136    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kserve-container"
Jul 28 01:57:04.825342 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.825149    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kube-rbac-proxy"
Jul 28 01:57:04.825342 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.825155    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kube-rbac-proxy"
Jul 28 01:57:04.825342 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.825164    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="storage-initializer"
Jul 28 01:57:04.825342 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.825169    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="storage-initializer"
Jul 28 01:57:04.825342 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.825224    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kube-rbac-proxy"
Jul 28 01:57:04.825342 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.825233    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="17e0ffc7-5bca-4bc5-abb4-4ee926401337" containerName="kserve-container"
Jul 28 01:57:04.828590 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.828569    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:04.831311 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.831290    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"invalid-s3-secret-733ea5\""
Jul 28 01:57:04.831311 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.831299    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 01:57:04.831577 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.831560    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 28 01:57:04.831631 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.831613    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-secondary-733ea5-kube-rbac-proxy-sar-config\""
Jul 28 01:57:04.832341 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.832315    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"invalid-s3-sa-733ea5-dockercfg-cqqf2\""
Jul 28 01:57:04.832464 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.832353    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-secondary-733ea5-predictor-serving-cert\""
Jul 28 01:57:04.832464 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.832434    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 28 01:57:04.852594 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.852569    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"]
Jul 28 01:57:04.929089 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.929063    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-proxy-tls\") pod \"isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") " pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:04.929089 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.929093    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-kube-rbac-proxy-sar-config\") pod \"isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") " pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:04.929274 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.929111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-kserve-provision-location\") pod \"isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") " pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:04.929274 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.929199    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-cabundle-cert\") pod \"isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") " pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:04.929274 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:04.929244    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jt7w\" (UniqueName: \"kubernetes.io/projected/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-kube-api-access-5jt7w\") pod \"isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") " pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:05.029932 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:05.029887    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-proxy-tls\") pod \"isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") " pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:05.029932 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:05.029932    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-kube-rbac-proxy-sar-config\") pod \"isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") " pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:05.030147 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:05.029951    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-kserve-provision-location\") pod \"isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") " pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:05.030147 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:05.030010    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-cabundle-cert\") pod \"isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") " pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:05.030147 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:05.030037    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jt7w\" (UniqueName: \"kubernetes.io/projected/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-kube-api-access-5jt7w\") pod \"isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") " pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:05.030470 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:05.030447    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-kserve-provision-location\") pod \"isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") " pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:05.030792 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:05.030741    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-cabundle-cert\") pod \"isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") " pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:05.030792 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:05.030741    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-kube-rbac-proxy-sar-config\") pod \"isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") " pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:05.032572 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:05.032526    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-proxy-tls\") pod \"isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") " pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:05.039461 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:05.039442    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jt7w\" (UniqueName: \"kubernetes.io/projected/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-kube-api-access-5jt7w\") pod \"isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") " pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:05.138606 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:05.138512    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:05.275282 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:05.275251    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"]
Jul 28 01:57:05.278593 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:57:05.278566    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3ae9af5_f733_4bb9_b1f8_a6c7a06e9676.slice/crio-d92c0ef28c3d29abaf14369006b567bf8e4df42a1731eb927a3559792a2e3bea WatchSource:0}: Error finding container d92c0ef28c3d29abaf14369006b567bf8e4df42a1731eb927a3559792a2e3bea: Status 404 returned error can't find the container with id d92c0ef28c3d29abaf14369006b567bf8e4df42a1731eb927a3559792a2e3bea
Jul 28 01:57:05.778688 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:05.778643    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2" event={"ID":"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676","Type":"ContainerStarted","Data":"008e355ee7d07f6df948ba57ace46dc75d41ceeaf153b7cad95f24989fbe6032"}
Jul 28 01:57:05.778840 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:05.778722    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2" event={"ID":"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676","Type":"ContainerStarted","Data":"d92c0ef28c3d29abaf14369006b567bf8e4df42a1731eb927a3559792a2e3bea"}
Jul 28 01:57:08.791310 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:08.791282    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2_c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676/storage-initializer/0.log"
Jul 28 01:57:08.791658 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:08.791334    2558 generic.go:356] "Generic (PLEG): container finished" podID="c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676" containerID="008e355ee7d07f6df948ba57ace46dc75d41ceeaf153b7cad95f24989fbe6032" exitCode=1
Jul 28 01:57:08.791658 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:08.791410    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2" event={"ID":"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676","Type":"ContainerDied","Data":"008e355ee7d07f6df948ba57ace46dc75d41ceeaf153b7cad95f24989fbe6032"}
Jul 28 01:57:09.797564 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:09.797533    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2_c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676/storage-initializer/0.log"
Jul 28 01:57:09.797950 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:09.797677    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2" event={"ID":"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676","Type":"ContainerStarted","Data":"e71647b9df677c24e24fba663fe205f4d7b805f9a89007d9b398450b2fbeee55"}
Jul 28 01:57:11.807654 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:11.807629    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2_c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676/storage-initializer/1.log"
Jul 28 01:57:11.808020 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:11.807977    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2_c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676/storage-initializer/0.log"
Jul 28 01:57:11.808020 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:11.808010    2558 generic.go:356] "Generic (PLEG): container finished" podID="c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676" containerID="e71647b9df677c24e24fba663fe205f4d7b805f9a89007d9b398450b2fbeee55" exitCode=1
Jul 28 01:57:11.808104 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:11.808083    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2" event={"ID":"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676","Type":"ContainerDied","Data":"e71647b9df677c24e24fba663fe205f4d7b805f9a89007d9b398450b2fbeee55"}
Jul 28 01:57:11.808164 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:11.808153    2558 scope.go:117] "RemoveContainer" containerID="008e355ee7d07f6df948ba57ace46dc75d41ceeaf153b7cad95f24989fbe6032"
Jul 28 01:57:11.808474 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:11.808459    2558 scope.go:117] "RemoveContainer" containerID="008e355ee7d07f6df948ba57ace46dc75d41ceeaf153b7cad95f24989fbe6032"
Jul 28 01:57:11.818339 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:57:11.818315    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-initializer\" with CrashLoopBackOff: \"back-off 10s restarting failed container=storage-initializer pod=isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2_kserve-ci-e2e-test(c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676)\"" pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2" podUID="c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676"
Jul 28 01:57:11.818642 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:57:11.818617    2558 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_storage-initializer_isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2_kserve-ci-e2e-test_c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676_0 in pod sandbox d92c0ef28c3d29abaf14369006b567bf8e4df42a1731eb927a3559792a2e3bea from index: no such id: '008e355ee7d07f6df948ba57ace46dc75d41ceeaf153b7cad95f24989fbe6032'" containerID="008e355ee7d07f6df948ba57ace46dc75d41ceeaf153b7cad95f24989fbe6032"
Jul 28 01:57:11.818702 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:11.818651    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"008e355ee7d07f6df948ba57ace46dc75d41ceeaf153b7cad95f24989fbe6032"} err="rpc error: code = Unknown desc = failed to delete container k8s_storage-initializer_isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2_kserve-ci-e2e-test_c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676_0 in pod sandbox d92c0ef28c3d29abaf14369006b567bf8e4df42a1731eb927a3559792a2e3bea from index: no such id: '008e355ee7d07f6df948ba57ace46dc75d41ceeaf153b7cad95f24989fbe6032'"
Jul 28 01:57:12.813107 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:12.813079    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2_c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676/storage-initializer/1.log"
Jul 28 01:57:20.848773 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:20.846349    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"]
Jul 28 01:57:20.977290 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:20.977266    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2_c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676/storage-initializer/1.log"
Jul 28 01:57:20.980931 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:20.980915    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:21.060568 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.060530    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-cabundle-cert\") pod \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") "
Jul 28 01:57:21.060730 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.060614    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jt7w\" (UniqueName: \"kubernetes.io/projected/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-kube-api-access-5jt7w\") pod \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") "
Jul 28 01:57:21.060730 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.060670    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-proxy-tls\") pod \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") "
Jul 28 01:57:21.060881 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.060752    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-kserve-provision-location\") pod \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") "
Jul 28 01:57:21.060881 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.060783    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-kube-rbac-proxy-sar-config\") pod \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\" (UID: \"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676\") "
Jul 28 01:57:21.060973 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.060908    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676" (UID: "c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:57:21.061022 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.061004    2558 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-cabundle-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:57:21.061098 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.061063    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676" (UID: "c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:57:21.061203 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.061168    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676" (UID: "c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:57:21.062971 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.062948    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-kube-api-access-5jt7w" (OuterVolumeSpecName: "kube-api-access-5jt7w") pod "c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676" (UID: "c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676"). InnerVolumeSpecName "kube-api-access-5jt7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:57:21.063056 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.063026    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676" (UID: "c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:57:21.162280 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.162227    2558 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-kserve-provision-location\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:57:21.162280 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.162249    2558 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:57:21.162280 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.162259    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jt7w\" (UniqueName: \"kubernetes.io/projected/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-kube-api-access-5jt7w\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:57:21.162280 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.162270    2558 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676-proxy-tls\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:57:21.848761 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.848683    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2_c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676/storage-initializer/1.log"
Jul 28 01:57:21.848909 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.848785    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"
Jul 28 01:57:21.848909 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.848793    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2" event={"ID":"c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676","Type":"ContainerDied","Data":"d92c0ef28c3d29abaf14369006b567bf8e4df42a1731eb927a3559792a2e3bea"}
Jul 28 01:57:21.848909 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.848858    2558 scope.go:117] "RemoveContainer" containerID="e71647b9df677c24e24fba663fe205f4d7b805f9a89007d9b398450b2fbeee55"
Jul 28 01:57:21.880882 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.880857    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"]
Jul 28 01:57:21.884539 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:21.884517    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-secondary-733ea5-predictor-7959dcc5d6-dwdz2"]
Jul 28 01:57:23.549927 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:23.549892    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676" path="/var/lib/kubelet/pods/c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676/volumes"
Jul 28 01:57:36.215029 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.214948    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"]
Jul 28 01:57:36.215394 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.215315    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676" containerName="storage-initializer"
Jul 28 01:57:36.215394 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.215329    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676" containerName="storage-initializer"
Jul 28 01:57:36.215394 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.215344    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676" containerName="storage-initializer"
Jul 28 01:57:36.215394 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.215349    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676" containerName="storage-initializer"
Jul 28 01:57:36.215394 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.215393    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676" containerName="storage-initializer"
Jul 28 01:57:36.215564 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.215402    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3ae9af5-f733-4bb9-b1f8-a6c7a06e9676" containerName="storage-initializer"
Jul 28 01:57:36.219918 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.219901    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:36.222450 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.222340    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"raw-sklearn-9f304-predictor-serving-cert\""
Jul 28 01:57:36.222450 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.222378    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 01:57:36.222450 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.222378    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"raw-sklearn-9f304-kube-rbac-proxy-sar-config\""
Jul 28 01:57:36.222724 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.222691    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 28 01:57:36.222777 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.222745    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 28 01:57:36.223487 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.223465    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-cl94s\""
Jul 28 01:57:36.223630 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.223474    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 28 01:57:36.230514 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.230495    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"]
Jul 28 01:57:36.280933 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.280911    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a51b8809-5b40-43d1-bce0-1c4a61a5721f-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-9f304-predictor-7fbbfcf89b-d785x\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") " pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:36.281048 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.280957    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a51b8809-5b40-43d1-bce0-1c4a61a5721f-kserve-provision-location\") pod \"raw-sklearn-9f304-predictor-7fbbfcf89b-d785x\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") " pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:36.281048 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.280978    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a51b8809-5b40-43d1-bce0-1c4a61a5721f-proxy-tls\") pod \"raw-sklearn-9f304-predictor-7fbbfcf89b-d785x\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") " pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:36.281048 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.281025    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a51b8809-5b40-43d1-bce0-1c4a61a5721f-cabundle-cert\") pod \"raw-sklearn-9f304-predictor-7fbbfcf89b-d785x\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") " pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:36.281179 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.281107    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8nwz\" (UniqueName: \"kubernetes.io/projected/a51b8809-5b40-43d1-bce0-1c4a61a5721f-kube-api-access-n8nwz\") pod \"raw-sklearn-9f304-predictor-7fbbfcf89b-d785x\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") " pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:36.381644 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.381616    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a51b8809-5b40-43d1-bce0-1c4a61a5721f-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-9f304-predictor-7fbbfcf89b-d785x\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") " pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:36.381758 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.381672    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a51b8809-5b40-43d1-bce0-1c4a61a5721f-kserve-provision-location\") pod \"raw-sklearn-9f304-predictor-7fbbfcf89b-d785x\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") " pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:36.381758 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.381704    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a51b8809-5b40-43d1-bce0-1c4a61a5721f-proxy-tls\") pod \"raw-sklearn-9f304-predictor-7fbbfcf89b-d785x\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") " pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:36.381866 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.381796    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a51b8809-5b40-43d1-bce0-1c4a61a5721f-cabundle-cert\") pod \"raw-sklearn-9f304-predictor-7fbbfcf89b-d785x\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") " pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:36.381924 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:57:36.381807    2558 secret.go:189] Couldn't get secret kserve-ci-e2e-test/raw-sklearn-9f304-predictor-serving-cert: secret "raw-sklearn-9f304-predictor-serving-cert" not found
Jul 28 01:57:36.381924 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.381868    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8nwz\" (UniqueName: \"kubernetes.io/projected/a51b8809-5b40-43d1-bce0-1c4a61a5721f-kube-api-access-n8nwz\") pod \"raw-sklearn-9f304-predictor-7fbbfcf89b-d785x\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") " pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:36.382021 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:57:36.381941    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a51b8809-5b40-43d1-bce0-1c4a61a5721f-proxy-tls podName:a51b8809-5b40-43d1-bce0-1c4a61a5721f nodeName:}" failed. No retries permitted until 2026-07-28 01:57:36.881917208 +0000 UTC m=+1889.898615834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a51b8809-5b40-43d1-bce0-1c4a61a5721f-proxy-tls") pod "raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" (UID: "a51b8809-5b40-43d1-bce0-1c4a61a5721f") : secret "raw-sklearn-9f304-predictor-serving-cert" not found
Jul 28 01:57:36.382172 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.382119    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a51b8809-5b40-43d1-bce0-1c4a61a5721f-kserve-provision-location\") pod \"raw-sklearn-9f304-predictor-7fbbfcf89b-d785x\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") " pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:36.382362 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.382347    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a51b8809-5b40-43d1-bce0-1c4a61a5721f-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-9f304-predictor-7fbbfcf89b-d785x\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") " pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:36.382462 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.382442    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a51b8809-5b40-43d1-bce0-1c4a61a5721f-cabundle-cert\") pod \"raw-sklearn-9f304-predictor-7fbbfcf89b-d785x\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") " pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:36.390196 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.390168    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8nwz\" (UniqueName: \"kubernetes.io/projected/a51b8809-5b40-43d1-bce0-1c4a61a5721f-kube-api-access-n8nwz\") pod \"raw-sklearn-9f304-predictor-7fbbfcf89b-d785x\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") " pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:36.887126 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.887091    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a51b8809-5b40-43d1-bce0-1c4a61a5721f-proxy-tls\") pod \"raw-sklearn-9f304-predictor-7fbbfcf89b-d785x\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") " pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:36.889671 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:36.889651    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a51b8809-5b40-43d1-bce0-1c4a61a5721f-proxy-tls\") pod \"raw-sklearn-9f304-predictor-7fbbfcf89b-d785x\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") " pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:37.130746 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:37.130711    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:37.261804 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:37.261774    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"]
Jul 28 01:57:37.264789 ip-10-0-135-95 kubenswrapper[2558]: W0728 01:57:37.264761    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda51b8809_5b40_43d1_bce0_1c4a61a5721f.slice/crio-9ec79a66bdb27f8e7a28f781f6c2371bb017458f928e8934b0bc36e8519ad474 WatchSource:0}: Error finding container 9ec79a66bdb27f8e7a28f781f6c2371bb017458f928e8934b0bc36e8519ad474: Status 404 returned error can't find the container with id 9ec79a66bdb27f8e7a28f781f6c2371bb017458f928e8934b0bc36e8519ad474
Jul 28 01:57:37.909194 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:37.909154    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" event={"ID":"a51b8809-5b40-43d1-bce0-1c4a61a5721f","Type":"ContainerStarted","Data":"87b5d3ff696eddd75a8a88f6f9e71496143cb9973699f5cf6132190d02cc4561"}
Jul 28 01:57:37.909364 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:37.909220    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" event={"ID":"a51b8809-5b40-43d1-bce0-1c4a61a5721f","Type":"ContainerStarted","Data":"9ec79a66bdb27f8e7a28f781f6c2371bb017458f928e8934b0bc36e8519ad474"}
Jul 28 01:57:40.922820 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:40.922791    2558 generic.go:356] "Generic (PLEG): container finished" podID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerID="87b5d3ff696eddd75a8a88f6f9e71496143cb9973699f5cf6132190d02cc4561" exitCode=0
Jul 28 01:57:40.923109 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:40.922830    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" event={"ID":"a51b8809-5b40-43d1-bce0-1c4a61a5721f","Type":"ContainerDied","Data":"87b5d3ff696eddd75a8a88f6f9e71496143cb9973699f5cf6132190d02cc4561"}
Jul 28 01:57:41.928466 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:41.928430    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" event={"ID":"a51b8809-5b40-43d1-bce0-1c4a61a5721f","Type":"ContainerStarted","Data":"bf787680d920e0a8481c39aaae374bbf1c85f2cf755a7a5a007ab8258a6f9076"}
Jul 28 01:57:41.928923 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:41.928490    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" event={"ID":"a51b8809-5b40-43d1-bce0-1c4a61a5721f","Type":"ContainerStarted","Data":"0b60c8485b3cc027be7ec520dd9a29b323f64989ac8c63a35e3ff8abe785110c"}
Jul 28 01:57:41.928923 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:41.928784    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:41.928992 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:41.928950    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:41.930038 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:41.930014    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Jul 28 01:57:41.951163 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:41.951120    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" podStartSLOduration=2.399981851 podStartE2EDuration="5.951107378s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.551125527s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:57:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:57:41.948965483 +0000 UTC m=+1894.965664140" watchObservedRunningTime="2026-07-28 01:57:41.951107378 +0000 UTC m=+1894.967806020"
Jul 28 01:57:42.933692 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:42.933648    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Jul 28 01:57:47.938116 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:47.938084    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:57:47.938816 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:47.938782    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Jul 28 01:57:57.939563 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:57:57.939497    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Jul 28 01:58:07.938973 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:58:07.938931    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Jul 28 01:58:17.938619 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:58:17.938582    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Jul 28 01:58:27.938764 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:58:27.938728    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Jul 28 01:58:37.938879 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:58:37.938839    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Jul 28 01:58:47.939021 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:58:47.938971    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Jul 28 01:58:57.939285 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:58:57.939209    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:59:06.350845 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:06.350804    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"]
Jul 28 01:59:06.351306 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:06.351120    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kserve-container" containerID="cri-o://0b60c8485b3cc027be7ec520dd9a29b323f64989ac8c63a35e3ff8abe785110c" gracePeriod=30
Jul 28 01:59:06.351306 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:06.351161    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kube-rbac-proxy" containerID="cri-o://bf787680d920e0a8481c39aaae374bbf1c85f2cf755a7a5a007ab8258a6f9076" gracePeriod=30
Jul 28 01:59:07.264052 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:07.264018    2558 generic.go:356] "Generic (PLEG): container finished" podID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerID="bf787680d920e0a8481c39aaae374bbf1c85f2cf755a7a5a007ab8258a6f9076" exitCode=2
Jul 28 01:59:07.264052 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:07.264054    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" event={"ID":"a51b8809-5b40-43d1-bce0-1c4a61a5721f","Type":"ContainerDied","Data":"bf787680d920e0a8481c39aaae374bbf1c85f2cf755a7a5a007ab8258a6f9076"}
Jul 28 01:59:07.934783 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:07.934735    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.28:8643/healthz\": dial tcp 10.133.0.28:8643: connect: connection refused"
Jul 28 01:59:07.939091 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:07.939061    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused"
Jul 28 01:59:10.485772 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:10.485748    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:59:10.627918 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:10.627849    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a51b8809-5b40-43d1-bce0-1c4a61a5721f-kserve-provision-location\") pod \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") "
Jul 28 01:59:10.627918 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:10.627888    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a51b8809-5b40-43d1-bce0-1c4a61a5721f-proxy-tls\") pod \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") "
Jul 28 01:59:10.628130 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:10.627934    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a51b8809-5b40-43d1-bce0-1c4a61a5721f-cabundle-cert\") pod \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") "
Jul 28 01:59:10.628130 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:10.627970    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a51b8809-5b40-43d1-bce0-1c4a61a5721f-kube-rbac-proxy-sar-config\") pod \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") "
Jul 28 01:59:10.628130 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:10.627996    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8nwz\" (UniqueName: \"kubernetes.io/projected/a51b8809-5b40-43d1-bce0-1c4a61a5721f-kube-api-access-n8nwz\") pod \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\" (UID: \"a51b8809-5b40-43d1-bce0-1c4a61a5721f\") "
Jul 28 01:59:10.628276 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:10.628244    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a51b8809-5b40-43d1-bce0-1c4a61a5721f-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "a51b8809-5b40-43d1-bce0-1c4a61a5721f" (UID: "a51b8809-5b40-43d1-bce0-1c4a61a5721f"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:59:10.628320 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:10.628295    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a51b8809-5b40-43d1-bce0-1c4a61a5721f-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "a51b8809-5b40-43d1-bce0-1c4a61a5721f" (UID: "a51b8809-5b40-43d1-bce0-1c4a61a5721f"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:59:10.628358 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:10.628336    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a51b8809-5b40-43d1-bce0-1c4a61a5721f-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "a51b8809-5b40-43d1-bce0-1c4a61a5721f" (UID: "a51b8809-5b40-43d1-bce0-1c4a61a5721f"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:59:10.630287 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:10.630254    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a51b8809-5b40-43d1-bce0-1c4a61a5721f-kube-api-access-n8nwz" (OuterVolumeSpecName: "kube-api-access-n8nwz") pod "a51b8809-5b40-43d1-bce0-1c4a61a5721f" (UID: "a51b8809-5b40-43d1-bce0-1c4a61a5721f"). InnerVolumeSpecName "kube-api-access-n8nwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:59:10.630287 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:10.630263    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a51b8809-5b40-43d1-bce0-1c4a61a5721f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a51b8809-5b40-43d1-bce0-1c4a61a5721f" (UID: "a51b8809-5b40-43d1-bce0-1c4a61a5721f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:59:10.728666 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:10.728640    2558 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a51b8809-5b40-43d1-bce0-1c4a61a5721f-cabundle-cert\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:59:10.728666 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:10.728664    2558 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a51b8809-5b40-43d1-bce0-1c4a61a5721f-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:59:10.728803 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:10.728674    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8nwz\" (UniqueName: \"kubernetes.io/projected/a51b8809-5b40-43d1-bce0-1c4a61a5721f-kube-api-access-n8nwz\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:59:10.728803 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:10.728683    2558 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a51b8809-5b40-43d1-bce0-1c4a61a5721f-kserve-provision-location\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:59:10.728803 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:10.728692    2558 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a51b8809-5b40-43d1-bce0-1c4a61a5721f-proxy-tls\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 01:59:11.281596 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:11.281536    2558 generic.go:356] "Generic (PLEG): container finished" podID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerID="0b60c8485b3cc027be7ec520dd9a29b323f64989ac8c63a35e3ff8abe785110c" exitCode=0
Jul 28 01:59:11.281596 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:11.281577    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" event={"ID":"a51b8809-5b40-43d1-bce0-1c4a61a5721f","Type":"ContainerDied","Data":"0b60c8485b3cc027be7ec520dd9a29b323f64989ac8c63a35e3ff8abe785110c"}
Jul 28 01:59:11.281806 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:11.281621    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"
Jul 28 01:59:11.281806 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:11.281637    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x" event={"ID":"a51b8809-5b40-43d1-bce0-1c4a61a5721f","Type":"ContainerDied","Data":"9ec79a66bdb27f8e7a28f781f6c2371bb017458f928e8934b0bc36e8519ad474"}
Jul 28 01:59:11.281806 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:11.281664    2558 scope.go:117] "RemoveContainer" containerID="bf787680d920e0a8481c39aaae374bbf1c85f2cf755a7a5a007ab8258a6f9076"
Jul 28 01:59:11.290320 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:11.290303    2558 scope.go:117] "RemoveContainer" containerID="0b60c8485b3cc027be7ec520dd9a29b323f64989ac8c63a35e3ff8abe785110c"
Jul 28 01:59:11.297561 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:11.297528    2558 scope.go:117] "RemoveContainer" containerID="87b5d3ff696eddd75a8a88f6f9e71496143cb9973699f5cf6132190d02cc4561"
Jul 28 01:59:11.304695 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:11.304646    2558 scope.go:117] "RemoveContainer" containerID="bf787680d920e0a8481c39aaae374bbf1c85f2cf755a7a5a007ab8258a6f9076"
Jul 28 01:59:11.305105 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:59:11.305087    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf787680d920e0a8481c39aaae374bbf1c85f2cf755a7a5a007ab8258a6f9076\": container with ID starting with bf787680d920e0a8481c39aaae374bbf1c85f2cf755a7a5a007ab8258a6f9076 not found: ID does not exist" containerID="bf787680d920e0a8481c39aaae374bbf1c85f2cf755a7a5a007ab8258a6f9076"
Jul 28 01:59:11.305105 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:11.305115    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf787680d920e0a8481c39aaae374bbf1c85f2cf755a7a5a007ab8258a6f9076"} err="failed to get container status \"bf787680d920e0a8481c39aaae374bbf1c85f2cf755a7a5a007ab8258a6f9076\": rpc error: code = NotFound desc = could not find container \"bf787680d920e0a8481c39aaae374bbf1c85f2cf755a7a5a007ab8258a6f9076\": container with ID starting with bf787680d920e0a8481c39aaae374bbf1c85f2cf755a7a5a007ab8258a6f9076 not found: ID does not exist"
Jul 28 01:59:11.305268 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:11.305139    2558 scope.go:117] "RemoveContainer" containerID="0b60c8485b3cc027be7ec520dd9a29b323f64989ac8c63a35e3ff8abe785110c"
Jul 28 01:59:11.305427 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:59:11.305407    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b60c8485b3cc027be7ec520dd9a29b323f64989ac8c63a35e3ff8abe785110c\": container with ID starting with 0b60c8485b3cc027be7ec520dd9a29b323f64989ac8c63a35e3ff8abe785110c not found: ID does not exist" containerID="0b60c8485b3cc027be7ec520dd9a29b323f64989ac8c63a35e3ff8abe785110c"
Jul 28 01:59:11.305500 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:11.305434    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b60c8485b3cc027be7ec520dd9a29b323f64989ac8c63a35e3ff8abe785110c"} err="failed to get container status \"0b60c8485b3cc027be7ec520dd9a29b323f64989ac8c63a35e3ff8abe785110c\": rpc error: code = NotFound desc = could not find container \"0b60c8485b3cc027be7ec520dd9a29b323f64989ac8c63a35e3ff8abe785110c\": container with ID starting with 0b60c8485b3cc027be7ec520dd9a29b323f64989ac8c63a35e3ff8abe785110c not found: ID does not exist"
Jul 28 01:59:11.305500 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:11.305453    2558 scope.go:117] "RemoveContainer" containerID="87b5d3ff696eddd75a8a88f6f9e71496143cb9973699f5cf6132190d02cc4561"
Jul 28 01:59:11.305826 ip-10-0-135-95 kubenswrapper[2558]: E0728 01:59:11.305808    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87b5d3ff696eddd75a8a88f6f9e71496143cb9973699f5cf6132190d02cc4561\": container with ID starting with 87b5d3ff696eddd75a8a88f6f9e71496143cb9973699f5cf6132190d02cc4561 not found: ID does not exist" containerID="87b5d3ff696eddd75a8a88f6f9e71496143cb9973699f5cf6132190d02cc4561"
Jul 28 01:59:11.305870 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:11.305833    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87b5d3ff696eddd75a8a88f6f9e71496143cb9973699f5cf6132190d02cc4561"} err="failed to get container status \"87b5d3ff696eddd75a8a88f6f9e71496143cb9973699f5cf6132190d02cc4561\": rpc error: code = NotFound desc = could not find container \"87b5d3ff696eddd75a8a88f6f9e71496143cb9973699f5cf6132190d02cc4561\": container with ID starting with 87b5d3ff696eddd75a8a88f6f9e71496143cb9973699f5cf6132190d02cc4561 not found: ID does not exist"
Jul 28 01:59:11.306322 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:11.306304    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"]
Jul 28 01:59:11.310901 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:11.310881    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/raw-sklearn-9f304-predictor-7fbbfcf89b-d785x"]
Jul 28 01:59:11.551102 ip-10-0-135-95 kubenswrapper[2558]: I0728 01:59:11.550935    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" path="/var/lib/kubelet/pods/a51b8809-5b40-43d1-bce0-1c4a61a5721f/volumes"
Jul 28 02:00:47.944966 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:47.944930    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9f4nx/must-gather-h79mm"]
Jul 28 02:00:47.945369 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:47.945206    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kserve-container"
Jul 28 02:00:47.945369 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:47.945217    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kserve-container"
Jul 28 02:00:47.945369 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:47.945231    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="storage-initializer"
Jul 28 02:00:47.945369 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:47.945238    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="storage-initializer"
Jul 28 02:00:47.945369 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:47.945244    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kube-rbac-proxy"
Jul 28 02:00:47.945369 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:47.945249    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kube-rbac-proxy"
Jul 28 02:00:47.945369 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:47.945300    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kube-rbac-proxy"
Jul 28 02:00:47.945369 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:47.945309    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a51b8809-5b40-43d1-bce0-1c4a61a5721f" containerName="kserve-container"
Jul 28 02:00:47.948060 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:47.948043    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9f4nx/must-gather-h79mm"
Jul 28 02:00:47.950798 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:47.950756    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9f4nx\"/\"openshift-service-ca.crt\""
Jul 28 02:00:47.950925 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:47.950821    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9f4nx\"/\"default-dockercfg-qz6hl\""
Jul 28 02:00:47.951788 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:47.951774    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9f4nx\"/\"kube-root-ca.crt\""
Jul 28 02:00:47.957102 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:47.957077    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9f4nx/must-gather-h79mm"]
Jul 28 02:00:48.043382 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:48.043348    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8cd75d4f-3b63-4549-b3f6-9186d9bb694d-must-gather-output\") pod \"must-gather-h79mm\" (UID: \"8cd75d4f-3b63-4549-b3f6-9186d9bb694d\") " pod="openshift-must-gather-9f4nx/must-gather-h79mm"
Jul 28 02:00:48.043520 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:48.043426    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j2km\" (UniqueName: \"kubernetes.io/projected/8cd75d4f-3b63-4549-b3f6-9186d9bb694d-kube-api-access-2j2km\") pod \"must-gather-h79mm\" (UID: \"8cd75d4f-3b63-4549-b3f6-9186d9bb694d\") " pod="openshift-must-gather-9f4nx/must-gather-h79mm"
Jul 28 02:00:48.144411 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:48.144388    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8cd75d4f-3b63-4549-b3f6-9186d9bb694d-must-gather-output\") pod \"must-gather-h79mm\" (UID: \"8cd75d4f-3b63-4549-b3f6-9186d9bb694d\") " pod="openshift-must-gather-9f4nx/must-gather-h79mm"
Jul 28 02:00:48.144526 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:48.144423    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j2km\" (UniqueName: \"kubernetes.io/projected/8cd75d4f-3b63-4549-b3f6-9186d9bb694d-kube-api-access-2j2km\") pod \"must-gather-h79mm\" (UID: \"8cd75d4f-3b63-4549-b3f6-9186d9bb694d\") " pod="openshift-must-gather-9f4nx/must-gather-h79mm"
Jul 28 02:00:48.144722 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:48.144703    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8cd75d4f-3b63-4549-b3f6-9186d9bb694d-must-gather-output\") pod \"must-gather-h79mm\" (UID: \"8cd75d4f-3b63-4549-b3f6-9186d9bb694d\") " pod="openshift-must-gather-9f4nx/must-gather-h79mm"
Jul 28 02:00:48.154339 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:48.154320    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j2km\" (UniqueName: \"kubernetes.io/projected/8cd75d4f-3b63-4549-b3f6-9186d9bb694d-kube-api-access-2j2km\") pod \"must-gather-h79mm\" (UID: \"8cd75d4f-3b63-4549-b3f6-9186d9bb694d\") " pod="openshift-must-gather-9f4nx/must-gather-h79mm"
Jul 28 02:00:48.258006 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:48.257945    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9f4nx/must-gather-h79mm"
Jul 28 02:00:48.391839 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:48.391801    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9f4nx/must-gather-h79mm"]
Jul 28 02:00:48.394696 ip-10-0-135-95 kubenswrapper[2558]: W0728 02:00:48.394669    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cd75d4f_3b63_4549_b3f6_9186d9bb694d.slice/crio-08eab01f5be8230477b9c36cc419e05d725e9e5ebbe4054efe338164b1fb58e0 WatchSource:0}: Error finding container 08eab01f5be8230477b9c36cc419e05d725e9e5ebbe4054efe338164b1fb58e0: Status 404 returned error can't find the container with id 08eab01f5be8230477b9c36cc419e05d725e9e5ebbe4054efe338164b1fb58e0
Jul 28 02:00:48.396605 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:48.396585    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 02:00:48.637153 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:48.637077    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9f4nx/must-gather-h79mm" event={"ID":"8cd75d4f-3b63-4549-b3f6-9186d9bb694d","Type":"ContainerStarted","Data":"08eab01f5be8230477b9c36cc419e05d725e9e5ebbe4054efe338164b1fb58e0"}
Jul 28 02:00:56.678489 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:56.678449    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9f4nx/must-gather-h79mm" event={"ID":"8cd75d4f-3b63-4549-b3f6-9186d9bb694d","Type":"ContainerStarted","Data":"b41916e480045af765d7f505a4f6017644f6fe739456139753870b159c6f5380"}
Jul 28 02:00:56.678489 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:56.678492    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9f4nx/must-gather-h79mm" event={"ID":"8cd75d4f-3b63-4549-b3f6-9186d9bb694d","Type":"ContainerStarted","Data":"ccc1cc5afab894434c0d4e4d78facaff20e8d16e6fe668b2eb58ada768062e8b"}
Jul 28 02:00:56.705723 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:00:56.705675    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9f4nx/must-gather-h79mm" podStartSLOduration=2.306245948 podStartE2EDuration="9.705659963s" totalImagesPullingTime="7.399414015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:00:56.703840354 +0000 UTC m=+2089.720538998" watchObservedRunningTime="2026-07-28 02:00:56.705659963 +0000 UTC m=+2089.722358606"
Jul 28 02:01:07.521831 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:07.521802    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 02:01:07.525107 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:07.525078    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 02:01:18.775665 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:18.775630    2558 generic.go:356] "Generic (PLEG): container finished" podID="8cd75d4f-3b63-4549-b3f6-9186d9bb694d" containerID="ccc1cc5afab894434c0d4e4d78facaff20e8d16e6fe668b2eb58ada768062e8b" exitCode=0
Jul 28 02:01:18.776055 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:18.775702    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9f4nx/must-gather-h79mm" event={"ID":"8cd75d4f-3b63-4549-b3f6-9186d9bb694d","Type":"ContainerDied","Data":"ccc1cc5afab894434c0d4e4d78facaff20e8d16e6fe668b2eb58ada768062e8b"}
Jul 28 02:01:18.776055 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:18.775986    2558 scope.go:117] "RemoveContainer" containerID="ccc1cc5afab894434c0d4e4d78facaff20e8d16e6fe668b2eb58ada768062e8b"
Jul 28 02:01:18.986709 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:18.986680    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-9f4nx_must-gather-h79mm_8cd75d4f-3b63-4549-b3f6-9186d9bb694d/gather/0.log"
Jul 28 02:01:22.301221 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:22.301189    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mg49d_78c22c72-ea97-4178-a43b-b731dd3956b7/global-pull-secret-syncer/0.log"
Jul 28 02:01:22.459728 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:22.459698    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tlvdp_a19469af-bf1b-44e7-9596-ad3566e692e2/konnectivity-agent/0.log"
Jul 28 02:01:22.503347 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:22.503318    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-95.ec2.internal_89ce73b10fe517b9feb646e9ce269241/haproxy/0.log"
Jul 28 02:01:24.382202 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.382166    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-9f4nx/must-gather-h79mm"]
Jul 28 02:01:24.382631 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.382387    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-9f4nx/must-gather-h79mm" podUID="8cd75d4f-3b63-4549-b3f6-9186d9bb694d" containerName="copy" containerID="cri-o://b41916e480045af765d7f505a4f6017644f6fe739456139753870b159c6f5380" gracePeriod=2
Jul 28 02:01:24.385136 ip-10-0-135-95 kubenswrapper[2558]: E0728 02:01:24.385099    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-h79mm\" is forbidden: User \"system:node:ip-10-0-135-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-9f4nx\": no relationship found between node 'ip-10-0-135-95.ec2.internal' and this object" podUID="8cd75d4f-3b63-4549-b3f6-9186d9bb694d" pod="openshift-must-gather-9f4nx/must-gather-h79mm"
Jul 28 02:01:24.386196 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.386171    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-9f4nx/must-gather-h79mm"]
Jul 28 02:01:24.615501 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.615481    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-9f4nx_must-gather-h79mm_8cd75d4f-3b63-4549-b3f6-9186d9bb694d/copy/0.log"
Jul 28 02:01:24.616931 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.616915    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9f4nx/must-gather-h79mm"
Jul 28 02:01:24.619717 ip-10-0-135-95 kubenswrapper[2558]: E0728 02:01:24.619695    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-h79mm\" is forbidden: User \"system:node:ip-10-0-135-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-9f4nx\": no relationship found between node 'ip-10-0-135-95.ec2.internal' and this object" podUID="8cd75d4f-3b63-4549-b3f6-9186d9bb694d" pod="openshift-must-gather-9f4nx/must-gather-h79mm"
Jul 28 02:01:24.756164 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.756142    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j2km\" (UniqueName: \"kubernetes.io/projected/8cd75d4f-3b63-4549-b3f6-9186d9bb694d-kube-api-access-2j2km\") pod \"8cd75d4f-3b63-4549-b3f6-9186d9bb694d\" (UID: \"8cd75d4f-3b63-4549-b3f6-9186d9bb694d\") "
Jul 28 02:01:24.756312 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.756176    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8cd75d4f-3b63-4549-b3f6-9186d9bb694d-must-gather-output\") pod \"8cd75d4f-3b63-4549-b3f6-9186d9bb694d\" (UID: \"8cd75d4f-3b63-4549-b3f6-9186d9bb694d\") "
Jul 28 02:01:24.757611 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.757575    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cd75d4f-3b63-4549-b3f6-9186d9bb694d-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "8cd75d4f-3b63-4549-b3f6-9186d9bb694d" (UID: "8cd75d4f-3b63-4549-b3f6-9186d9bb694d"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:24.758227 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.758212    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd75d4f-3b63-4549-b3f6-9186d9bb694d-kube-api-access-2j2km" (OuterVolumeSpecName: "kube-api-access-2j2km") pod "8cd75d4f-3b63-4549-b3f6-9186d9bb694d" (UID: "8cd75d4f-3b63-4549-b3f6-9186d9bb694d"). InnerVolumeSpecName "kube-api-access-2j2km". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:01:24.799175 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.799153    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-9f4nx_must-gather-h79mm_8cd75d4f-3b63-4549-b3f6-9186d9bb694d/copy/0.log"
Jul 28 02:01:24.799486 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.799466    2558 generic.go:356] "Generic (PLEG): container finished" podID="8cd75d4f-3b63-4549-b3f6-9186d9bb694d" containerID="b41916e480045af765d7f505a4f6017644f6fe739456139753870b159c6f5380" exitCode=143
Jul 28 02:01:24.799535 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.799508    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9f4nx/must-gather-h79mm"
Jul 28 02:01:24.799535 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.799526    2558 scope.go:117] "RemoveContainer" containerID="b41916e480045af765d7f505a4f6017644f6fe739456139753870b159c6f5380"
Jul 28 02:01:24.801932 ip-10-0-135-95 kubenswrapper[2558]: E0728 02:01:24.801904    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-h79mm\" is forbidden: User \"system:node:ip-10-0-135-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-9f4nx\": no relationship found between node 'ip-10-0-135-95.ec2.internal' and this object" podUID="8cd75d4f-3b63-4549-b3f6-9186d9bb694d" pod="openshift-must-gather-9f4nx/must-gather-h79mm"
Jul 28 02:01:24.806987 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.806962    2558 scope.go:117] "RemoveContainer" containerID="ccc1cc5afab894434c0d4e4d78facaff20e8d16e6fe668b2eb58ada768062e8b"
Jul 28 02:01:24.810330 ip-10-0-135-95 kubenswrapper[2558]: E0728 02:01:24.810300    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-h79mm\" is forbidden: User \"system:node:ip-10-0-135-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-9f4nx\": no relationship found between node 'ip-10-0-135-95.ec2.internal' and this object" podUID="8cd75d4f-3b63-4549-b3f6-9186d9bb694d" pod="openshift-must-gather-9f4nx/must-gather-h79mm"
Jul 28 02:01:24.818617 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.818600    2558 scope.go:117] "RemoveContainer" containerID="b41916e480045af765d7f505a4f6017644f6fe739456139753870b159c6f5380"
Jul 28 02:01:24.818853 ip-10-0-135-95 kubenswrapper[2558]: E0728 02:01:24.818831    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b41916e480045af765d7f505a4f6017644f6fe739456139753870b159c6f5380\": container with ID starting with b41916e480045af765d7f505a4f6017644f6fe739456139753870b159c6f5380 not found: ID does not exist" containerID="b41916e480045af765d7f505a4f6017644f6fe739456139753870b159c6f5380"
Jul 28 02:01:24.818889 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.818862    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b41916e480045af765d7f505a4f6017644f6fe739456139753870b159c6f5380"} err="failed to get container status \"b41916e480045af765d7f505a4f6017644f6fe739456139753870b159c6f5380\": rpc error: code = NotFound desc = could not find container \"b41916e480045af765d7f505a4f6017644f6fe739456139753870b159c6f5380\": container with ID starting with b41916e480045af765d7f505a4f6017644f6fe739456139753870b159c6f5380 not found: ID does not exist"
Jul 28 02:01:24.818889 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.818880    2558 scope.go:117] "RemoveContainer" containerID="ccc1cc5afab894434c0d4e4d78facaff20e8d16e6fe668b2eb58ada768062e8b"
Jul 28 02:01:24.819122 ip-10-0-135-95 kubenswrapper[2558]: E0728 02:01:24.819105    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccc1cc5afab894434c0d4e4d78facaff20e8d16e6fe668b2eb58ada768062e8b\": container with ID starting with ccc1cc5afab894434c0d4e4d78facaff20e8d16e6fe668b2eb58ada768062e8b not found: ID does not exist" containerID="ccc1cc5afab894434c0d4e4d78facaff20e8d16e6fe668b2eb58ada768062e8b"
Jul 28 02:01:24.819174 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.819127    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccc1cc5afab894434c0d4e4d78facaff20e8d16e6fe668b2eb58ada768062e8b"} err="failed to get container status \"ccc1cc5afab894434c0d4e4d78facaff20e8d16e6fe668b2eb58ada768062e8b\": rpc error: code = NotFound desc = could not find container \"ccc1cc5afab894434c0d4e4d78facaff20e8d16e6fe668b2eb58ada768062e8b\": container with ID starting with ccc1cc5afab894434c0d4e4d78facaff20e8d16e6fe668b2eb58ada768062e8b not found: ID does not exist"
Jul 28 02:01:24.857692 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.857667    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j2km\" (UniqueName: \"kubernetes.io/projected/8cd75d4f-3b63-4549-b3f6-9186d9bb694d-kube-api-access-2j2km\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 02:01:24.857692 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:24.857685    2558 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8cd75d4f-3b63-4549-b3f6-9186d9bb694d-must-gather-output\") on node \"ip-10-0-135-95.ec2.internal\" DevicePath \"\""
Jul 28 02:01:25.549929 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:25.549894    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cd75d4f-3b63-4549-b3f6-9186d9bb694d" path="/var/lib/kubelet/pods/8cd75d4f-3b63-4549-b3f6-9186d9bb694d/volumes"
Jul 28 02:01:26.756689 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:26.756664    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-zpzsb_b70dc550-2255-480d-9256-c48cbe82a57e/kube-state-metrics/0.log"
Jul 28 02:01:26.784912 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:26.784873    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-zpzsb_b70dc550-2255-480d-9256-c48cbe82a57e/kube-rbac-proxy-main/0.log"
Jul 28 02:01:26.812081 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:26.812057    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-zpzsb_b70dc550-2255-480d-9256-c48cbe82a57e/kube-rbac-proxy-self/0.log"
Jul 28 02:01:26.844311 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:26.844283    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-75b6d4b985-6hl77_de12bd8b-f020-47c7-b5a3-5d2b6753a893/metrics-server/0.log"
Jul 28 02:01:26.914235 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:26.914175    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4wnrx_8e7896ed-e4e6-428d-888b-fa0e652718b4/node-exporter/0.log"
Jul 28 02:01:26.946600 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:26.946579    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4wnrx_8e7896ed-e4e6-428d-888b-fa0e652718b4/kube-rbac-proxy/0.log"
Jul 28 02:01:26.974442 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:26.974421    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4wnrx_8e7896ed-e4e6-428d-888b-fa0e652718b4/init-textfile/0.log"
Jul 28 02:01:27.373888 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:27.373857    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06c550f8-b334-47c3-b92c-ede8b7e52bcf/prometheus/0.log"
Jul 28 02:01:27.396650 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:27.396623    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06c550f8-b334-47c3-b92c-ede8b7e52bcf/config-reloader/0.log"
Jul 28 02:01:27.429274 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:27.429248    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06c550f8-b334-47c3-b92c-ede8b7e52bcf/thanos-sidecar/0.log"
Jul 28 02:01:27.456125 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:27.456097    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06c550f8-b334-47c3-b92c-ede8b7e52bcf/kube-rbac-proxy-web/0.log"
Jul 28 02:01:27.505163 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:27.505140    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06c550f8-b334-47c3-b92c-ede8b7e52bcf/kube-rbac-proxy/0.log"
Jul 28 02:01:27.555783 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:27.555764    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06c550f8-b334-47c3-b92c-ede8b7e52bcf/kube-rbac-proxy-thanos/0.log"
Jul 28 02:01:27.618903 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:27.618884    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06c550f8-b334-47c3-b92c-ede8b7e52bcf/init-config-reloader/0.log"
Jul 28 02:01:27.655562 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:27.655495    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-vr4sw_a02086b1-a514-42d9-84c3-45274a01c732/prometheus-operator/0.log"
Jul 28 02:01:27.678635 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:27.678615    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-vr4sw_a02086b1-a514-42d9-84c3-45274a01c732/kube-rbac-proxy/0.log"
Jul 28 02:01:27.707142 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:27.707122    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-45q88_0040b8c9-9c71-4ac7-9bb8-3dff7ad139c6/prometheus-operator-admission-webhook/0.log"
Jul 28 02:01:27.742726 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:27.742704    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77cb5947b7-rrx9x_ffb868fc-b114-4f7d-b59c-7954277113da/telemeter-client/0.log"
Jul 28 02:01:27.770335 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:27.770318    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77cb5947b7-rrx9x_ffb868fc-b114-4f7d-b59c-7954277113da/reload/0.log"
Jul 28 02:01:27.795179 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:27.795137    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77cb5947b7-rrx9x_ffb868fc-b114-4f7d-b59c-7954277113da/kube-rbac-proxy/0.log"
Jul 28 02:01:30.259819 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.259789    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-dm7d9_4fc7091d-0514-4ace-b06a-5d5553701527/download-server/0.log"
Jul 28 02:01:30.685848 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.685822    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"]
Jul 28 02:01:30.686149 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.686135    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd75d4f-3b63-4549-b3f6-9186d9bb694d" containerName="gather"
Jul 28 02:01:30.686198 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.686154    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd75d4f-3b63-4549-b3f6-9186d9bb694d" containerName="gather"
Jul 28 02:01:30.686198 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.686174    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd75d4f-3b63-4549-b3f6-9186d9bb694d" containerName="copy"
Jul 28 02:01:30.686198 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.686179    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd75d4f-3b63-4549-b3f6-9186d9bb694d" containerName="copy"
Jul 28 02:01:30.686290 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.686254    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cd75d4f-3b63-4549-b3f6-9186d9bb694d" containerName="copy"
Jul 28 02:01:30.686290 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.686263    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cd75d4f-3b63-4549-b3f6-9186d9bb694d" containerName="gather"
Jul 28 02:01:30.690433 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.690414    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:30.693468 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.693445    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4jnbh\"/\"kube-root-ca.crt\""
Jul 28 02:01:30.693732 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.693718    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4jnbh\"/\"openshift-service-ca.crt\""
Jul 28 02:01:30.694457 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.694443    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4jnbh\"/\"default-dockercfg-5ljcm\""
Jul 28 02:01:30.700038 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.700017    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"]
Jul 28 02:01:30.702244 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.702223    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkvpz\" (UniqueName: \"kubernetes.io/projected/60df39fb-1bd6-4d63-908f-f95d18d76c2b-kube-api-access-dkvpz\") pod \"perf-node-gather-daemonset-5v5lj\" (UID: \"60df39fb-1bd6-4d63-908f-f95d18d76c2b\") " pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:30.702325 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.702267    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60df39fb-1bd6-4d63-908f-f95d18d76c2b-sys\") pod \"perf-node-gather-daemonset-5v5lj\" (UID: \"60df39fb-1bd6-4d63-908f-f95d18d76c2b\") " pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:30.702325 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.702290    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60df39fb-1bd6-4d63-908f-f95d18d76c2b-proc\") pod \"perf-node-gather-daemonset-5v5lj\" (UID: \"60df39fb-1bd6-4d63-908f-f95d18d76c2b\") " pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:30.702410 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.702351    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60df39fb-1bd6-4d63-908f-f95d18d76c2b-lib-modules\") pod \"perf-node-gather-daemonset-5v5lj\" (UID: \"60df39fb-1bd6-4d63-908f-f95d18d76c2b\") " pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:30.702410 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.702377    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60df39fb-1bd6-4d63-908f-f95d18d76c2b-podres\") pod \"perf-node-gather-daemonset-5v5lj\" (UID: \"60df39fb-1bd6-4d63-908f-f95d18d76c2b\") " pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:30.803157 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.803125    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkvpz\" (UniqueName: \"kubernetes.io/projected/60df39fb-1bd6-4d63-908f-f95d18d76c2b-kube-api-access-dkvpz\") pod \"perf-node-gather-daemonset-5v5lj\" (UID: \"60df39fb-1bd6-4d63-908f-f95d18d76c2b\") " pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:30.803326 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.803167    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60df39fb-1bd6-4d63-908f-f95d18d76c2b-sys\") pod \"perf-node-gather-daemonset-5v5lj\" (UID: \"60df39fb-1bd6-4d63-908f-f95d18d76c2b\") " pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:30.803326 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.803182    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60df39fb-1bd6-4d63-908f-f95d18d76c2b-proc\") pod \"perf-node-gather-daemonset-5v5lj\" (UID: \"60df39fb-1bd6-4d63-908f-f95d18d76c2b\") " pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:30.803326 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.803217    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60df39fb-1bd6-4d63-908f-f95d18d76c2b-lib-modules\") pod \"perf-node-gather-daemonset-5v5lj\" (UID: \"60df39fb-1bd6-4d63-908f-f95d18d76c2b\") " pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:30.803326 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.803234    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60df39fb-1bd6-4d63-908f-f95d18d76c2b-podres\") pod \"perf-node-gather-daemonset-5v5lj\" (UID: \"60df39fb-1bd6-4d63-908f-f95d18d76c2b\") " pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:30.803326 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.803271    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60df39fb-1bd6-4d63-908f-f95d18d76c2b-sys\") pod \"perf-node-gather-daemonset-5v5lj\" (UID: \"60df39fb-1bd6-4d63-908f-f95d18d76c2b\") " pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:30.803326 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.803319    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60df39fb-1bd6-4d63-908f-f95d18d76c2b-proc\") pod \"perf-node-gather-daemonset-5v5lj\" (UID: \"60df39fb-1bd6-4d63-908f-f95d18d76c2b\") " pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:30.803623 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.803382    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60df39fb-1bd6-4d63-908f-f95d18d76c2b-lib-modules\") pod \"perf-node-gather-daemonset-5v5lj\" (UID: \"60df39fb-1bd6-4d63-908f-f95d18d76c2b\") " pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:30.803623 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.803387    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60df39fb-1bd6-4d63-908f-f95d18d76c2b-podres\") pod \"perf-node-gather-daemonset-5v5lj\" (UID: \"60df39fb-1bd6-4d63-908f-f95d18d76c2b\") " pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:30.811001 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:30.810983    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkvpz\" (UniqueName: \"kubernetes.io/projected/60df39fb-1bd6-4d63-908f-f95d18d76c2b-kube-api-access-dkvpz\") pod \"perf-node-gather-daemonset-5v5lj\" (UID: \"60df39fb-1bd6-4d63-908f-f95d18d76c2b\") " pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:31.000781 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:31.000701    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:31.130513 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:31.130476    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"]
Jul 28 02:01:31.134502 ip-10-0-135-95 kubenswrapper[2558]: W0728 02:01:31.134471    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod60df39fb_1bd6_4d63_908f_f95d18d76c2b.slice/crio-82ba32f321c3224f566534003b57dce4e0d8cda577096c5d0291db431143189d WatchSource:0}: Error finding container 82ba32f321c3224f566534003b57dce4e0d8cda577096c5d0291db431143189d: Status 404 returned error can't find the container with id 82ba32f321c3224f566534003b57dce4e0d8cda577096c5d0291db431143189d
Jul 28 02:01:31.695414 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:31.695357    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8g6j6_fc5800f8-5c7e-484e-8481-54616647a748/dns/0.log"
Jul 28 02:01:31.719528 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:31.719500    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8g6j6_fc5800f8-5c7e-484e-8481-54616647a748/kube-rbac-proxy/0.log"
Jul 28 02:01:31.825944 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:31.825910    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj" event={"ID":"60df39fb-1bd6-4d63-908f-f95d18d76c2b","Type":"ContainerStarted","Data":"b1694b2f5c04198a3a1b32a10181e0186a676c9749dc054a95017922c294c5cd"}
Jul 28 02:01:31.826084 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:31.825967    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj" event={"ID":"60df39fb-1bd6-4d63-908f-f95d18d76c2b","Type":"ContainerStarted","Data":"82ba32f321c3224f566534003b57dce4e0d8cda577096c5d0291db431143189d"}
Jul 28 02:01:31.826084 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:31.826050    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:31.844671 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:31.844628    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj" podStartSLOduration=1.844613459 podStartE2EDuration="1.844613459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 02:01:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:01:31.842860638 +0000 UTC m=+2124.859559282" watchObservedRunningTime="2026-07-28 02:01:31.844613459 +0000 UTC m=+2124.861312101"
Jul 28 02:01:31.888931 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:31.888911    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j84km_b19da232-9d4c-41fe-b81a-1a34a4166a6c/dns-node-resolver/0.log"
Jul 28 02:01:32.368541 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:32.368514    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-54d68ff985-nmq2c_f0895846-cecf-467d-b179-0bc9d9211934/registry/0.log"
Jul 28 02:01:32.392747 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:32.392700    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9kp6b_20045825-79f7-46f4-917d-2846016a45b2/node-ca/0.log"
Jul 28 02:01:33.517487 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:33.517458    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4srvw_c6df4508-4b57-4b4a-8f7d-246f0af70ddb/serve-healthcheck-canary/0.log"
Jul 28 02:01:34.050769 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:34.050745    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mjh5h_01e345cd-8032-4983-9078-5570c9cd1e3c/kube-rbac-proxy/0.log"
Jul 28 02:01:34.072430 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:34.072409    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mjh5h_01e345cd-8032-4983-9078-5570c9cd1e3c/exporter/0.log"
Jul 28 02:01:34.095482 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:34.095428    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mjh5h_01e345cd-8032-4983-9078-5570c9cd1e3c/extractor/0.log"
Jul 28 02:01:36.497330 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:36.497288    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-xb7np_3ebfecde-6946-4564-acc0-ee474dd45769/s3-init/0.log"
Jul 28 02:01:36.512966 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:36.512942    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-xb7np_3ebfecde-6946-4564-acc0-ee474dd45769/download-hf-model/0.log"
Jul 28 02:01:37.838643 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:37.838615    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4jnbh/perf-node-gather-daemonset-5v5lj"
Jul 28 02:01:41.951896 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:41.951818    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cfrlp_d2ead989-c1b2-42a6-9c17-e00a21d8d757/kube-multus-additional-cni-plugins/0.log"
Jul 28 02:01:41.977289 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:41.977266    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cfrlp_d2ead989-c1b2-42a6-9c17-e00a21d8d757/egress-router-binary-copy/0.log"
Jul 28 02:01:42.000899 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:42.000879    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cfrlp_d2ead989-c1b2-42a6-9c17-e00a21d8d757/cni-plugins/0.log"
Jul 28 02:01:42.026055 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:42.026036    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cfrlp_d2ead989-c1b2-42a6-9c17-e00a21d8d757/bond-cni-plugin/0.log"
Jul 28 02:01:42.047482 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:42.047462    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cfrlp_d2ead989-c1b2-42a6-9c17-e00a21d8d757/routeoverride-cni/0.log"
Jul 28 02:01:42.073216 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:42.073195    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cfrlp_d2ead989-c1b2-42a6-9c17-e00a21d8d757/whereabouts-cni-bincopy/0.log"
Jul 28 02:01:42.103094 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:42.103075    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cfrlp_d2ead989-c1b2-42a6-9c17-e00a21d8d757/whereabouts-cni/0.log"
Jul 28 02:01:42.473352 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:42.473325    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q7phb_a264e673-0627-4b00-8de1-753170b00bee/kube-multus/0.log"
Jul 28 02:01:42.629709 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:42.629676    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lmrxw_b94d344e-9357-41ea-a7a7-36490cfe27bd/network-metrics-daemon/0.log"
Jul 28 02:01:42.648852 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:42.648827    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lmrxw_b94d344e-9357-41ea-a7a7-36490cfe27bd/kube-rbac-proxy/0.log"
Jul 28 02:01:43.811319 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:43.811251    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-controller/0.log"
Jul 28 02:01:43.831255 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:43.831208    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/0.log"
Jul 28 02:01:43.831404 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:43.831323    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovn-acl-logging/1.log"
Jul 28 02:01:43.851593 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:43.851570    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/kube-rbac-proxy-node/0.log"
Jul 28 02:01:43.874578 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:43.874533    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/kube-rbac-proxy-ovn-metrics/0.log"
Jul 28 02:01:43.897657 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:43.897639    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/northd/0.log"
Jul 28 02:01:43.920946 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:43.920926    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/nbdb/0.log"
Jul 28 02:01:43.945440 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:43.945419    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/sbdb/0.log"
Jul 28 02:01:43.987355 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:43.987332    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xftxq_489f9e99-b968-4ac5-b583-7a04541903c0/ovnkube-controller/0.log"
Jul 28 02:01:45.039174 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:45.039148    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-b262s_78f08e99-cb7b-4f45-9713-9afd7f2fad94/network-check-target-container/0.log"
Jul 28 02:01:45.962404 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:45.962376    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xkxr9_5c4f5668-1f21-447d-8bab-dd8da04835d4/iptables-alerter/0.log"
Jul 28 02:01:46.606795 ip-10-0-135-95 kubenswrapper[2558]: I0728 02:01:46.606724    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-fv88b_4af086fc-42a0-4bc5-a391-d35f222d8606/tuned/0.log"