Jul 06 14:20:17.320703 ip-10-0-135-124 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 14:20:17.774457 ip-10-0-135-124 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 14:20:17.774457 ip-10-0-135-124 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 14:20:17.774457 ip-10-0-135-124 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 14:20:17.774457 ip-10-0-135-124 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 14:20:17.774457 ip-10-0-135-124 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 14:20:17.776418 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.776314    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 14:20:17.783223 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783205    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:20:17.783223 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783222    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:20:17.783223 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783226    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783229    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783233    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783236    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783239    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783242    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783247    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783251    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783254    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783257    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783260    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783263    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783265    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783268    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783271    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783273    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783276    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783286    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783289    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:20:17.783323 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783291    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783294    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783296    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783298    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783301    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783303    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783306    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783308    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783311    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783313    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783316    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783318    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783320    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783323    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783325    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783328    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783331    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783334    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783336    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783339    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:20:17.783804 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783341    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783344    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783347    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783349    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783351    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783354    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783356    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783373    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783378    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783382    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783386    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783391    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783394    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783397    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783400    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783404    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783406    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783409    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783411    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783414    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:20:17.784279 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783417    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783419    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783421    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783424    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783427    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783429    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783432    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783435    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783437    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783440    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783442    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783445    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783447    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783449    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783452    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783454    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783458    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783460    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783463    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:20:17.784832 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783465    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:20:17.785283 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783467    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:20:17.785283 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783470    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:20:17.785283 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783472    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:20:17.785283 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783475    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:20:17.785283 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783478    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:20:17.785283 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783480    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:20:17.785283 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783484    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:20:17.785283 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783487    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:20:17.785283 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783490    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:20:17.785283 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783492    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:20:17.785283 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783496    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:20:17.785283 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783499    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:20:17.785283 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783504    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:20:17.785283 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783508    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:20:17.785283 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783511    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:20:17.785283 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783514    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:20:17.785283 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783517    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:20:17.785283 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.783520    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:20:17.786466 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786454    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:20:17.786466 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786464    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786468    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786472    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786474    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786478    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786481    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786483    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786486    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786488    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786491    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786493    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786496    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786498    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786502    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786506    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786509    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786512    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786514    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786518    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:20:17.786530 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786521    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786523    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786526    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786529    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786531    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786534    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786537    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786539    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786542    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786545    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786547    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786550    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786552    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786555    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786557    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786560    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786562    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786564    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786567    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786569    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:20:17.787014 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786571    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786574    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786579    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786582    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786585    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786587    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786590    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786592    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786595    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786598    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786600    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786602    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786606    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786610    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786613    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786616    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786618    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786620    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786623    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:20:17.787522 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786625    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786628    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786630    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786632    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786634    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786638    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786641    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786643    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786645    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786648    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786650    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786652    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786655    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786657    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786660    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786662    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786664    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786667    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786669    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786673    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786675    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:20:17.787980 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786677    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786680    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786682    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786685    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786687    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786690    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786693    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786695    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786697    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786700    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786703    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786705    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786708    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786710    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786713    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786715    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786717    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786720    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.786722    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:20:17.788557 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787162    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787168    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787172    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787177    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787181    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787185    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787188    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787190    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787193    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787196    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787199    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787202    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787204    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787207    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787209    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787212    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787214    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787217    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787220    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:20:17.789017 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787224    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787229    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787232    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787235    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787238    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787240    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787244    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787246    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787249    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787251    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787254    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787256    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787258    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787261    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787263    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787265    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787268    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787270    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787273    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:20:17.789517 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787275    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787277    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787280    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787283    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787286    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787288    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787291    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787293    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787295    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787297    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787300    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787302    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787305    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787308    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787311    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787314    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787316    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787319    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787321    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787323    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:20:17.790015 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787326    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787328    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787330    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787333    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787335    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787337    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787340    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787342    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787344    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787347    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787350    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787353    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787355    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787358    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787378    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787382    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787386    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787390    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787394    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787397    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:20:17.790519 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787399    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787402    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787404    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787407    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787409    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787414    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787418    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787421    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787424    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787427    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787430    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787432    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787435    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787437    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787440    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787442    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787444    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787447    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787449    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787451    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:20:17.791005 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.787454    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787533    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787549    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787556    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787560    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787564    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787567    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787572    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787576    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787579    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787582    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787585    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787588    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787591    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787594    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787597    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787599    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787602    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787605    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787610    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787612    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787615    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787618    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787622    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 14:20:17.791506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787625    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787628    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787631    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787634    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787637    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787640    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787643    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787645    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787648    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787652    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787655    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787658    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787660    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787663    2562 flags.go:64] FLAG: --enable-server="true"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787666    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787670    2562 flags.go:64] FLAG: --event-burst="100"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787673    2562 flags.go:64] FLAG: --event-qps="50"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787676    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787679    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787682    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787685    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787688    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787691    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787694    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787697    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 14:20:17.792090 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787700    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787703    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787706    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787709    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787712    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787715    2562 flags.go:64] FLAG: --feature-gates=""
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787719    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787721    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787724    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787727    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787730    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787733    2562 flags.go:64] FLAG: --help="false"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787736    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-135-124.ec2.internal"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787739    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787742    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787744    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787748    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787751    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787753    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787756    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787759    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787761    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787764    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787767    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 14:20:17.792715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787770    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787772    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787775    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787778    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787781    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787783    2562 flags.go:64] FLAG: --lock-file=""
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787786    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787789    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787792    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787797    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787800    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787803    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787806    2562 flags.go:64] FLAG: --logging-format="text"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787809    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787812    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787814    2562 flags.go:64] FLAG: --manifest-url=""
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787817    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787822    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787825    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787828    2562 flags.go:64] FLAG: --max-pods="110"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787831    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787834    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787837    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787840    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787843    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 14:20:17.793299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787846    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787849    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787859    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787862    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787864    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787867    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787870    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787878    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787882    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787885    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787888    2562 flags.go:64] FLAG: --port="10250"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787891    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787894    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03d944b954582ee74"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787897    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787900    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787902    2562 flags.go:64] FLAG: --register-node="true"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787905    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787908    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787911    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787914    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787918    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787921    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787924    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787928    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787931    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 14:20:17.793992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787933    2562 flags.go:64] FLAG: --runonce="false"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787936    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787939    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787942    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787944    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787947    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787950    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787953    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787956    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787959    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787961    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787964    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787967    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787970    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787974    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787979    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787984    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787987    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787990    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787994    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787996    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.787999    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.788002    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.788005    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.788008    2562 flags.go:64] FLAG: --v="2"
Jul 06 14:20:17.794620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.788012    2562 flags.go:64] FLAG: --version="false"
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.788016    2562 flags.go:64] FLAG: --vmodule=""
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.788019    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.788023    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788147    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788152    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788155    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788158    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788161    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788165    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788168    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788171    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788174    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788176    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788178    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788181    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788183    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788186    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788188    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788191    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:20:17.795567 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788193    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788197    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788201    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788203    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788205    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788208    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788210    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788213    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788215    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788218    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788220    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788222    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788225    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788227    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788229    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788232    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788235    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788238    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788240    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788243    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:20:17.796266 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788245    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788248    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788250    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788253    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788255    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788257    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788260    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788262    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788264    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788267    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788269    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788272    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788274    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788279    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788282    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788285    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788287    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788290    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788292    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:20:17.796798 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788294    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788297    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788299    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788304    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788307    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788310    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788313    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788316    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788318    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788321    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788324    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788326    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788329    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788332    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788334    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788337    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788339    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788341    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788345    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:20:17.797261 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788348    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788351    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788354    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788356    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788373    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788376    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788378    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788382    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788386    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788388    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788391    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788393    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788396    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788398    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788401    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788403    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788406    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788408    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788411    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788413    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:20:17.797743 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788416    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:20:17.798232 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788418    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:20:17.798232 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788421    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:20:17.798232 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788423    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:20:17.798232 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.788426    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:20:17.798232 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.789064    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 14:20:17.798232 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.797443    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 14:20:17.798232 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.797460    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 14:20:17.798232 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.797482    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 14:20:17.798232 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.797488    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 14:20:17.798232 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797543    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:20:17.798232 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797548    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:20:17.798232 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797552    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:20:17.798232 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797555    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:20:17.798232 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797558    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:20:17.798232 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797560    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797563    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797566    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797569    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797571    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797574    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797577    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797579    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797582    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797586    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797590    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797593    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797596    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797598    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797601    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797603    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797606    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797608    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797611    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797613    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:20:17.798688 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797616    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797618    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797621    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797623    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797626    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797629    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797632    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797634    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797637    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797640    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797642    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797644    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797647    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797650    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797652    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797655    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797657    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797661    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797664    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797667    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:20:17.799188 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797670    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797673    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797675    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797677    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797680    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797682    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797684    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797687    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797689    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797691    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797694    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797696    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797699    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797701    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797704    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797706    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797710    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797712    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797715    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:20:17.799731 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797717    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797720    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797722    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797725    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797727    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797730    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797732    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797735    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797737    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797740    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797742    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797745    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797747    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797750    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797752    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797756    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797758    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797761    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797763    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:20:17.800181 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797766    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:20:17.800659 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797768    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:20:17.800659 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797770    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:20:17.800659 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797773    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:20:17.800659 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797775    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:20:17.800659 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797777    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:20:17.800659 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797780    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:20:17.800659 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797782    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:20:17.800659 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797786    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:20:17.800659 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797789    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:20:17.800659 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797793    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:20:17.800659 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797796    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:20:17.800659 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797798    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:20:17.800659 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797801    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:20:17.800659 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797803    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:20:17.800659 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797806    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:20:17.801021 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.797811    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 14:20:17.801021 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797932    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:20:17.801021 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797937    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:20:17.801021 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797940    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:20:17.801021 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797943    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:20:17.801021 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797945    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:20:17.801021 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797950    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:20:17.801021 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797953    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:20:17.801021 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797956    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:20:17.801021 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797959    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:20:17.801021 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797961    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:20:17.801021 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797964    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:20:17.801021 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797967    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:20:17.801021 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797970    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:20:17.801021 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797973    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797975    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797977    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797980    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797982    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797985    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797987    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797990    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797992    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797994    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797997    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.797999    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798001    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798005    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798009    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798012    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798015    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798017    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798020    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:20:17.801397 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798022    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798025    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798027    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798030    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798033    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798036    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798038    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798041    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798043    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798046    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798048    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798051    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798053    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798056    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798059    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798061    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798064    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798066    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798069    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798071    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:20:17.801849 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798074    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798076    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798078    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798081    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798083    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798086    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798088    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798091    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798093    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798096    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798099    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798101    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798104    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798106    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798109    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798111    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798114    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798116    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798118    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798121    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:20:17.802320 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798124    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798126    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798129    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798131    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798133    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798136    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798139    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798142    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798144    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798146    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798149    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798151    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798153    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798156    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798158    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798160    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798163    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798166    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798168    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:20:17.802861 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798171    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:20:17.803358 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798173    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:20:17.803358 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798175    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:20:17.803358 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798177    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:20:17.803358 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798180    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:20:17.803358 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798183    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:20:17.803358 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798185    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:20:17.803358 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:17.798187    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:20:17.803358 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.798192    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 14:20:17.803358 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.798313    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 14:20:17.803358 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.802183    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 14:20:17.803863 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.803851    2562 server.go:1019] "Starting client certificate rotation"
Jul 06 14:20:17.803970 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.803952    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 14:20:17.804006 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.803990    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 14:20:17.806664 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.806650    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 14:20:17.808665 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.808635    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 14:20:17.821604 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.821584    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 06 14:20:17.824262 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.824245    2562 log.go:25] "Validated CRI v1 image API"
Jul 06 14:20:17.826292 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.826274    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 14:20:17.829039 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.829015    2562 fs.go:135] Filesystem UUIDs: map[24ec5c7c-6676-446d-ada0-5aeee8420d60:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 83bb305d-0886-4a35-b51e-80f53b6fca7c:/dev/nvme0n1p3]
Jul 06 14:20:17.829099 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.829039    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 14:20:17.832434 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.832213    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 14:20:17.835944 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.835832    2562 manager.go:216] Machine: {Timestamp:2026-07-06 14:20:17.834429968 +0000 UTC m=+0.381098593 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099221 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2aadddcfe0e3c9e12677467e1be814 SystemUUID:ec2aaddd-cfe0-e3c9-e126-77467e1be814 BootID:d0082fa7-d868-4a2c-a303-1bc0cc2b53e0 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3d:be:86:14:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3d:be:86:14:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:73:20:15:ed:ef Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 14:20:17.835944 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.835937    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 14:20:17.836059 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.836026    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 14:20:17.839426 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.839397    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 14:20:17.839562 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.839428    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-124.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 14:20:17.840162 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.840150    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 14:20:17.840200 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.840165    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 14:20:17.840200 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.840174    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 14:20:17.840841 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.840830    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 14:20:17.842355 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.842342    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 14:20:17.846222 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.846208    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 14:20:17.846352 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.846343    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 14:20:17.846396 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.846390    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 14:20:17.846434 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.846403    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 14:20:17.846434 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.846419    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 14:20:17.846434 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.846429    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 06 14:20:17.846508 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.846439    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 14:20:17.846838 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.846825    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 14:20:17.846882 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.846843    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 14:20:17.849424 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.849403    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 14:20:17.851809 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.851795    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 14:20:17.851869 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.851827    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 14:20:17.853017 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.853002    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 14:20:17.853060 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.853032    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 14:20:17.853060 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.853047    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 14:20:17.853112 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.853060    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 14:20:17.853112 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.853079    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 14:20:17.853112 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.853093    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 14:20:17.853112 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.853104    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 14:20:17.853112 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.853110    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 14:20:17.853235 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.853117    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 14:20:17.853235 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.853123    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 14:20:17.853235 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.853131    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 14:20:17.853235 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.853137    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 14:20:17.854028 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.854018    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 14:20:17.854028 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.854028    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 14:20:17.857573 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.857558    2562 server.go:1268] "Started kubelet"
Jul 06 14:20:17.857797 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.857662    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 14:20:17.858022 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.857991    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 14:20:17.858262 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.858238    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 14:20:17.858337 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.858302    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kv58n"
Jul 06 14:20:17.858544 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:17.858512    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 14:20:17.858623 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:17.858540    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 14:20:17.858675 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.858614    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-124.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 14:20:17.858654 ip-10-0-135-124 systemd[1]: Started Kubernetes Kubelet.
Jul 06 14:20:17.861532 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.860846    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 14:20:17.861532 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.861120    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 14:20:17.863014 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:17.862990    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 14:20:17.865379 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.865350    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kv58n"
Jul 06 14:20:17.866331 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.866318    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 14:20:17.866422 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.866336    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 14:20:17.866487 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:17.866444    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-124.ec2.internal\" not found"
Jul 06 14:20:17.867003 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.866988    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 14:20:17.867085 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.867008    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 14:20:17.867085 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.866990    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 14:20:17.867175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.867112    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 14:20:17.867175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.867120    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 14:20:17.867457 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.867445    2562 factory.go:153] Registering CRI-O factory
Jul 06 14:20:17.867518 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.867469    2562 factory.go:223] Registration of the crio container factory successfully
Jul 06 14:20:17.867518 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.867517    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 14:20:17.867596 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.867525    2562 factory.go:55] Registering systemd factory
Jul 06 14:20:17.867596 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.867530    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 06 14:20:17.867596 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.867555    2562 factory.go:103] Registering Raw factory
Jul 06 14:20:17.867596 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.867564    2562 manager.go:1196] Started watching for new ooms in manager
Jul 06 14:20:17.868174 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.868160    2562 manager.go:349] Starting recovery of all containers
Jul 06 14:20:17.870350 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:17.870328    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 14:20:17.870818 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:17.870787    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 14:20:17.875237 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:17.869722    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-124.ec2.internal.18bfb935b96fcc83  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-124.ec2.internal,UID:ip-10-0-135-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-124.ec2.internal,},FirstTimestamp:2026-07-06 14:20:17.857522819 +0000 UTC m=+0.404191446,LastTimestamp:2026-07-06 14:20:17.857522819 +0000 UTC m=+0.404191446,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-124.ec2.internal,}"
Jul 06 14:20:17.880669 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.880501    2562 manager.go:354] Recovery completed
Jul 06 14:20:17.881484 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.881457    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 14:20:17.882354 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:17.882318    2562 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 06 14:20:17.885793 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.885771    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:20:17.888598 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.888583    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:20:17.888669 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.888614    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:20:17.888669 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.888625    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:20:17.889127 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.889111    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 14:20:17.889127 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.889124    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 14:20:17.889223 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.889139    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 14:20:17.889223 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.889168    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:20:17.889911 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.889896    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:20:17.889986 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.889928    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:20:17.889986 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.889943    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:20:17.890321 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.890309    2562 policy_none.go:49] "None policy: Start"
Jul 06 14:20:17.890411 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.890329    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 14:20:17.890411 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.890340    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 14:20:17.891444 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.891434    2562 policy_none.go:47] "Start"
Jul 06 14:20:17.934988 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.934969    2562 manager.go:337] "Starting Device Plugin manager"
Jul 06 14:20:17.935129 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:17.935059    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 14:20:17.935129 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.935075    2562 server.go:87] "Starting device plugin registration server"
Jul 06 14:20:17.935378 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.935348    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 14:20:17.935458 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.935377    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 14:20:17.936037 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.935984    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 14:20:17.936146 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.936077    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 14:20:17.936146 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:17.936086    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 14:20:17.936259 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:17.936223    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 14:20:17.936302 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:17.936291    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-124.ec2.internal\" not found"
Jul 06 14:20:18.035926 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.035842    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:20:18.037516 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.037218    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:20:18.037516 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.037254    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:20:18.037516 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.037264    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:20:18.037516 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.037303    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-124.ec2.internal"
Jul 06 14:20:18.042018 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.041995    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 14:20:18.042127 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.042043    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 14:20:18.042127 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.042068    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 14:20:18.042127 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:18.042108    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 14:20:18.044087 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.044069    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:20:18.051436 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.051419    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-124.ec2.internal"
Jul 06 14:20:18.051514 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:18.051443    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-124.ec2.internal\": node \"ip-10-0-135-124.ec2.internal\" not found"
Jul 06 14:20:18.106885 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:18.106859    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-124.ec2.internal\" not found"
Jul 06 14:20:18.142957 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.142922    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-124.ec2.internal"]
Jul 06 14:20:18.143037 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.143013    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:20:18.144018 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.144003    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:20:18.144103 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.144033    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:20:18.144103 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.144043    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:20:18.145431 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.145419    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:20:18.145552 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.145535    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal"
Jul 06 14:20:18.145600 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.145583    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:20:18.146470 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.146449    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:20:18.146542 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.146484    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:20:18.146542 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.146494    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:20:18.146542 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.146461    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:20:18.146630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.146553    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:20:18.146630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.146574    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:20:18.147875 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.147861    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-124.ec2.internal"
Jul 06 14:20:18.147914 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.147887    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:20:18.148749 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.148733    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:20:18.148818 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.148760    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:20:18.148818 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.148770    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:20:18.168565 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.168535    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a00e02199f23972a2bbdd8527950f4e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal\" (UID: \"a00e02199f23972a2bbdd8527950f4e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal"
Jul 06 14:20:18.168565 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.168567    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a00e02199f23972a2bbdd8527950f4e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal\" (UID: \"a00e02199f23972a2bbdd8527950f4e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal"
Jul 06 14:20:18.168739 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.168585    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1589fdad0eee7678693602cdf14d162f-config\") pod \"kube-apiserver-proxy-ip-10-0-135-124.ec2.internal\" (UID: \"1589fdad0eee7678693602cdf14d162f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-124.ec2.internal"
Jul 06 14:20:18.173410 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:18.173388    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-124.ec2.internal\" not found" node="ip-10-0-135-124.ec2.internal"
Jul 06 14:20:18.178072 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:18.178055    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-124.ec2.internal\" not found" node="ip-10-0-135-124.ec2.internal"
Jul 06 14:20:18.207882 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:18.207841    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-124.ec2.internal\" not found"
Jul 06 14:20:18.269461 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.269429    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a00e02199f23972a2bbdd8527950f4e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal\" (UID: \"a00e02199f23972a2bbdd8527950f4e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal"
Jul 06 14:20:18.269461 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.269459    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a00e02199f23972a2bbdd8527950f4e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal\" (UID: \"a00e02199f23972a2bbdd8527950f4e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal"
Jul 06 14:20:18.269643 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.269476    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1589fdad0eee7678693602cdf14d162f-config\") pod \"kube-apiserver-proxy-ip-10-0-135-124.ec2.internal\" (UID: \"1589fdad0eee7678693602cdf14d162f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-124.ec2.internal"
Jul 06 14:20:18.269643 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.269533    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1589fdad0eee7678693602cdf14d162f-config\") pod \"kube-apiserver-proxy-ip-10-0-135-124.ec2.internal\" (UID: \"1589fdad0eee7678693602cdf14d162f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-124.ec2.internal"
Jul 06 14:20:18.269643 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.269536    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a00e02199f23972a2bbdd8527950f4e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal\" (UID: \"a00e02199f23972a2bbdd8527950f4e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal"
Jul 06 14:20:18.269643 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:18.269536    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a00e02199f23972a2bbdd8527950f4e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal\" (UID: \"a00e02199f23972a2bbdd8527950f4e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal"
Jul 06 14:20:18.308255 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:18.308174    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-124.ec2.internal\" not found"
Jul 06 14:20:20.106506 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:20.106484    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-124.ec2.internal\" not found"
Jul 06 14:20:20.176113 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:20.176069    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal"
Jul 06 14:20:20.180694 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:20.180455    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-124.ec2.internal"
Jul 06 14:20:20.207622 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:20.207586    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-124.ec2.internal\" not found"
Jul 06 14:20:20.308218 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:20.308116    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-124.ec2.internal\" not found"
Jul 06 14:20:20.408589 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:20.408565    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-124.ec2.internal\" not found"
Jul 06 14:20:20.501156 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:20.501118    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 14:20:20.501675 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:20.501286    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 14:20:20.509452 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:20.509422    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-124.ec2.internal\" not found"
Jul 06 14:20:20.568971 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:20.568867    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 14:15:19 +0000 UTC" deadline="2027-12-18 21:24:45.783237494 +0000 UTC"
Jul 06 14:20:20.568971 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:20.568912    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12727h4m25.214330086s"
Jul 06 14:20:20.609619 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:20.609577    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-124.ec2.internal\" not found"
Jul 06 14:20:20.678837 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:20.678810    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:20:20.709896 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:20.709869    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-124.ec2.internal\" not found"
Jul 06 14:20:20.710112 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:20.710094    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:20:20.810979 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:20.810941    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-124.ec2.internal\" not found"
Jul 06 14:20:20.829815 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:20.829739    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:20:20.865067 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:20.865038    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal"
Jul 06 14:20:20.878848 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:20.878815    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 14:20:20.879825 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:20.879810    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-124.ec2.internal"
Jul 06 14:20:20.887509 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:20.887489    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 14:20:20.931658 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:20.931619    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda00e02199f23972a2bbdd8527950f4e8.slice/crio-c1cbb5d50a48e4aa0283583904fa2ddbb93b6391a9701dced1ae181168d1562e WatchSource:0}: Error finding container c1cbb5d50a48e4aa0283583904fa2ddbb93b6391a9701dced1ae181168d1562e: Status 404 returned error can't find the container with id c1cbb5d50a48e4aa0283583904fa2ddbb93b6391a9701dced1ae181168d1562e
Jul 06 14:20:20.932396 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:20.932373    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1589fdad0eee7678693602cdf14d162f.slice/crio-ca0e02777d963f75c1cdc7afd348d08125b77edea0ae62c37a320706aa9e1a42 WatchSource:0}: Error finding container ca0e02777d963f75c1cdc7afd348d08125b77edea0ae62c37a320706aa9e1a42: Status 404 returned error can't find the container with id ca0e02777d963f75c1cdc7afd348d08125b77edea0ae62c37a320706aa9e1a42
Jul 06 14:20:20.935893 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:20.935874    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:20:21.545114 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.545078    2562 apiserver.go:52] "Watching apiserver"
Jul 06 14:20:21.552631 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.552608    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 14:20:21.555025 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.554977    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-zsdxr","openshift-multus/multus-additional-cni-plugins-l4pfm","openshift-multus/network-metrics-daemon-7m68m","openshift-network-diagnostics/network-check-target-vvs2w","kube-system/konnectivity-agent-mmd82","openshift-dns/node-resolver-vvpws","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal","openshift-multus/multus-dmf4b","openshift-network-operator/iptables-alerter-lpwqt","openshift-ovn-kubernetes/ovnkube-node-gwkjw","kube-system/global-pull-secret-syncer-49jdc","kube-system/kube-apiserver-proxy-ip-10-0-135-124.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j","openshift-cluster-node-tuning-operator/tuned-tvb6v"]
Jul 06 14:20:21.556642 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.556620    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.558028 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.558008    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.559415 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.559398    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:21.559507 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:21.559466    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:21.560742 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.560717    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:21.560839 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:21.560782    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:21.561475 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.561456    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 14:20:21.561874 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.561856    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 14:20:21.561944 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.561870    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 14:20:21.562000 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.561951    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 14:20:21.562000 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.561968    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jt2tj\""
Jul 06 14:20:21.562204 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.562186    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zsdxr"
Jul 06 14:20:21.562307 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.562246    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 14:20:21.563589 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.563573    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.564600 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.564584    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 14:20:21.565050 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.565032    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mmd82"
Jul 06 14:20:21.566998 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.566977    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lpwqt"
Jul 06 14:20:21.567788 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.567768    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 14:20:21.569062 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.568933    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 14:20:21.569062 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.569023    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 14:20:21.569210 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.569071    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 14:20:21.569262 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.569216    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vvpws"
Jul 06 14:20:21.571098 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.571079    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rznq7\""
Jul 06 14:20:21.571231 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.571215    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:21.571302 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:21.571278    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:21.572704 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.572688    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.573995 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.573975    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.575751 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.575732    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsjck\" (UniqueName: \"kubernetes.io/projected/d56c55cf-0128-4fb3-9416-2aa8754c56f6-kube-api-access-fsjck\") pod \"node-ca-zsdxr\" (UID: \"d56c55cf-0128-4fb3-9416-2aa8754c56f6\") " pod="openshift-image-registry/node-ca-zsdxr"
Jul 06 14:20:21.575843 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.575766    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.575843 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.575793    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs\") pod \"network-metrics-daemon-7m68m\" (UID: \"0741a5cc-f80e-49c5-9c57-df5f5ea7710d\") " pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:21.575843 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.575816    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.576000 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.575840    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lns5w\" (UniqueName: \"kubernetes.io/projected/2c18b158-e302-4ac8-b7a7-ad5faf534c52-kube-api-access-lns5w\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.576000 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.575863    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztkqt\" (UniqueName: \"kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt\") pod \"network-check-target-vvs2w\" (UID: \"f5f065bf-98db-456d-a71d-2b6ddf324436\") " pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:21.576000 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.575888    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-cni-binary-copy\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.576000 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.575910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9b36f481-6b7c-46d2-aedc-4fb7500117ed-device-dir\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.576000 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.575933    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-slash\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.576000 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.575955    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c18b158-e302-4ac8-b7a7-ad5faf534c52-env-overrides\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.576000 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.575979    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-cnibin\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.576280 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7733a06d-9827-44bd-a425-e9a6676753f0-host-slash\") pod \"iptables-alerter-lpwqt\" (UID: \"7733a06d-9827-44bd-a425-e9a6676753f0\") " pod="openshift-network-operator/iptables-alerter-lpwqt"
Jul 06 14:20:21.576280 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576024    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9b36f481-6b7c-46d2-aedc-4fb7500117ed-socket-dir\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.576280 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576048    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9b36f481-6b7c-46d2-aedc-4fb7500117ed-registration-dir\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.576280 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576070    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d56c55cf-0128-4fb3-9416-2aa8754c56f6-host\") pod \"node-ca-zsdxr\" (UID: \"d56c55cf-0128-4fb3-9416-2aa8754c56f6\") " pod="openshift-image-registry/node-ca-zsdxr"
Jul 06 14:20:21.576280 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576092    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-run-netns\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.576280 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-var-lib-openvswitch\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.576280 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576169    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-cni-bin\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.576280 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576185    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-cni-netd\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.576280 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c18b158-e302-4ac8-b7a7-ad5faf534c52-ovn-node-metrics-cert\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.576280 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576215    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.576280 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576229    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9b36f481-6b7c-46d2-aedc-4fb7500117ed-etc-selinux\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.576280 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576258    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d56c55cf-0128-4fb3-9416-2aa8754c56f6-serviceca\") pod \"node-ca-zsdxr\" (UID: \"d56c55cf-0128-4fb3-9416-2aa8754c56f6\") " pod="openshift-image-registry/node-ca-zsdxr"
Jul 06 14:20:21.576280 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576278    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-log-socket\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.576889 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576294    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-kubelet\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.576889 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576308    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-run-systemd\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.576889 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-etc-openvswitch\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.576889 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576357    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-run-ovn-kubernetes\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.576889 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576407    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-system-cni-dir\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.576889 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576426    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6fd2b9fc-8eed-49bc-b589-60e74d28f89c-agent-certs\") pod \"konnectivity-agent-mmd82\" (UID: \"6fd2b9fc-8eed-49bc-b589-60e74d28f89c\") " pod="kube-system/konnectivity-agent-mmd82"
Jul 06 14:20:21.576889 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576443    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c18b158-e302-4ac8-b7a7-ad5faf534c52-ovnkube-config\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.576889 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576485    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw6n7\" (UniqueName: \"kubernetes.io/projected/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-kube-api-access-zw6n7\") pod \"network-metrics-daemon-7m68m\" (UID: \"0741a5cc-f80e-49c5-9c57-df5f5ea7710d\") " pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:21.576889 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576503    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.576889 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576522    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc9lx\" (UniqueName: \"kubernetes.io/projected/7733a06d-9827-44bd-a425-e9a6676753f0-kube-api-access-nc9lx\") pod \"iptables-alerter-lpwqt\" (UID: \"7733a06d-9827-44bd-a425-e9a6676753f0\") " pod="openshift-network-operator/iptables-alerter-lpwqt"
Jul 06 14:20:21.576889 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576558    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9b36f481-6b7c-46d2-aedc-4fb7500117ed-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.576889 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576574    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-systemd-units\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.576889 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576610    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-node-log\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.576889 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576633    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c18b158-e302-4ac8-b7a7-ad5faf534c52-ovnkube-script-lib\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.576889 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576668    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-os-release\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.576889 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576704    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9b36f481-6b7c-46d2-aedc-4fb7500117ed-sys-fs\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576753    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576740    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6fd2b9fc-8eed-49bc-b589-60e74d28f89c-konnectivity-ca\") pod \"konnectivity-agent-mmd82\" (UID: \"6fd2b9fc-8eed-49bc-b589-60e74d28f89c\") " pod="kube-system/konnectivity-agent-mmd82"
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576811    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-run-openvswitch\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576844    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576871    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-run-ovn\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drk2k\" (UniqueName: \"kubernetes.io/projected/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-kube-api-access-drk2k\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7733a06d-9827-44bd-a425-e9a6676753f0-iptables-alerter-script\") pod \"iptables-alerter-lpwqt\" (UID: \"7733a06d-9827-44bd-a425-e9a6676753f0\") " pod="openshift-network-operator/iptables-alerter-lpwqt"
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.576954    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csdlc\" (UniqueName: \"kubernetes.io/projected/9b36f481-6b7c-46d2-aedc-4fb7500117ed-kube-api-access-csdlc\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.577015    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.577055    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.577075    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d4x8g\""
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.577223    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.577255    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.577390    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.577442    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.577454    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.577635    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.577642    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.577680    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.577696    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.577746    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 14:20:21.577800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.577777    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:20:21.578658 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.577942    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2qlgb\""
Jul 06 14:20:21.578658 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.577950    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zvkbn\""
Jul 06 14:20:21.578658 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.578014    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rtkq9\""
Jul 06 14:20:21.578658 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.578017    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4z4hr\""
Jul 06 14:20:21.578658 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.578082    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:20:21.578658 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.578278    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 14:20:21.578658 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.578431    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fttd5\""
Jul 06 14:20:21.578658 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.578590    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9cg22\""
Jul 06 14:20:21.578952 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.578669    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 14:20:21.610605 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.610581    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 14:20:21.625573 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.625542    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:20:21.638544 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.638517    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k6nnd"
Jul 06 14:20:21.653499 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.653467    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k6nnd"
Jul 06 14:20:21.668163 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.668107    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 14:20:21.677265 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677232    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-var-lib-openvswitch\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.677439 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677271    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-cni-bin\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.677439 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-cni-netd\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.677439 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677319    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9b36f481-6b7c-46d2-aedc-4fb7500117ed-etc-selinux\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.677439 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677344    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5040554-3ad9-44d9-8b09-cba10a5e4198-tmp\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.677439 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677365    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-system-cni-dir\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.677439 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677370    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-var-lib-openvswitch\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.677439 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677387    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-log-socket\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.677439 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677373    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-cni-bin\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.677813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677455    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-log-socket\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.677813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677458    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-cni-netd\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.677813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677503    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-kubelet\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.677813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677512    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9b36f481-6b7c-46d2-aedc-4fb7500117ed-etc-selinux\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.677813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677533    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-etc-openvswitch\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.677813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677558    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-run-ovn-kubernetes\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.677813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677581    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-etc-openvswitch\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.677813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677583    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-system-cni-dir\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.677813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677612    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6fd2b9fc-8eed-49bc-b589-60e74d28f89c-agent-certs\") pod \"konnectivity-agent-mmd82\" (UID: \"6fd2b9fc-8eed-49bc-b589-60e74d28f89c\") " pod="kube-system/konnectivity-agent-mmd82"
Jul 06 14:20:21.677813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677625    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-run-ovn-kubernetes\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.677813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677641    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-systemd\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.677813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677614    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-system-cni-dir\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.677813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677570    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-kubelet\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.677813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677667    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c18b158-e302-4ac8-b7a7-ad5faf534c52-ovnkube-config\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.677813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677705    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc9lx\" (UniqueName: \"kubernetes.io/projected/7733a06d-9827-44bd-a425-e9a6676753f0-kube-api-access-nc9lx\") pod \"iptables-alerter-lpwqt\" (UID: \"7733a06d-9827-44bd-a425-e9a6676753f0\") " pod="openshift-network-operator/iptables-alerter-lpwqt"
Jul 06 14:20:21.677813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677731    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-host\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.677813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677757    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-multus-socket-dir-parent\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.678630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9b36f481-6b7c-46d2-aedc-4fb7500117ed-sys-fs\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.678630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677822    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6fd2b9fc-8eed-49bc-b589-60e74d28f89c-konnectivity-ca\") pod \"konnectivity-agent-mmd82\" (UID: \"6fd2b9fc-8eed-49bc-b589-60e74d28f89c\") " pod="kube-system/konnectivity-agent-mmd82"
Jul 06 14:20:21.678630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677846    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-sysconfig\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.678630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677870    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-lib-modules\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.678630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677893    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7hgv\" (UniqueName: \"kubernetes.io/projected/b085f67c-31a3-47bd-8150-b721cc9f0ac9-kube-api-access-k7hgv\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.678630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677921    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-run-openvswitch\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.678630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677941    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 14:20:21.678630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678189    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9b36f481-6b7c-46d2-aedc-4fb7500117ed-sys-fs\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.678630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678255    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c18b158-e302-4ac8-b7a7-ad5faf534c52-ovnkube-config\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.678630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678324    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-run-openvswitch\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.678630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.677946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drk2k\" (UniqueName: \"kubernetes.io/projected/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-kube-api-access-drk2k\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.678630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7733a06d-9827-44bd-a425-e9a6676753f0-iptables-alerter-script\") pod \"iptables-alerter-lpwqt\" (UID: \"7733a06d-9827-44bd-a425-e9a6676753f0\") " pod="openshift-network-operator/iptables-alerter-lpwqt"
Jul 06 14:20:21.678630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsjck\" (UniqueName: \"kubernetes.io/projected/d56c55cf-0128-4fb3-9416-2aa8754c56f6-kube-api-access-fsjck\") pod \"node-ca-zsdxr\" (UID: \"d56c55cf-0128-4fb3-9416-2aa8754c56f6\") " pod="openshift-image-registry/node-ca-zsdxr"
Jul 06 14:20:21.678630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-tuned\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.678630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678501    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs\") pod \"network-metrics-daemon-7m68m\" (UID: \"0741a5cc-f80e-49c5-9c57-df5f5ea7710d\") " pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:21.678630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678523    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.678630 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678544    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-run\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.679296 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678565    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-hostroot\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.679296 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678583    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-multus-conf-dir\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.679296 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678606    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztkqt\" (UniqueName: \"kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt\") pod \"network-check-target-vvs2w\" (UID: \"f5f065bf-98db-456d-a71d-2b6ddf324436\") " pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:21.679296 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678625    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-kubelet-config\") pod \"global-pull-secret-syncer-49jdc\" (UID: \"1b898534-bd6c-43bf-a49c-0ee858e6fb3f\") " pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:21.679296 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-sysctl-d\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.679296 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678662    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-etc-kubernetes\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.679296 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678681    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6fd2b9fc-8eed-49bc-b589-60e74d28f89c-konnectivity-ca\") pod \"konnectivity-agent-mmd82\" (UID: \"6fd2b9fc-8eed-49bc-b589-60e74d28f89c\") " pod="kube-system/konnectivity-agent-mmd82"
Jul 06 14:20:21.679296 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678682    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-slash\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.679296 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678717    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7733a06d-9827-44bd-a425-e9a6676753f0-host-slash\") pod \"iptables-alerter-lpwqt\" (UID: \"7733a06d-9827-44bd-a425-e9a6676753f0\") " pod="openshift-network-operator/iptables-alerter-lpwqt"
Jul 06 14:20:21.679296 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678739    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9b36f481-6b7c-46d2-aedc-4fb7500117ed-socket-dir\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.679296 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678759    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d56c55cf-0128-4fb3-9416-2aa8754c56f6-host\") pod \"node-ca-zsdxr\" (UID: \"d56c55cf-0128-4fb3-9416-2aa8754c56f6\") " pod="openshift-image-registry/node-ca-zsdxr"
Jul 06 14:20:21.679296 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-var-lib-kubelet\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.679296 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:21.678800    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:20:21.679296 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:21.678874    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs podName:0741a5cc-f80e-49c5-9c57-df5f5ea7710d nodeName:}" failed. No retries permitted until 2026-07-06 14:20:22.178855143 +0000 UTC m=+3.027742114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs") pod "network-metrics-daemon-7m68m" (UID: "0741a5cc-f80e-49c5-9c57-df5f5ea7710d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:20:21.679296 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679001    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7733a06d-9827-44bd-a425-e9a6676753f0-iptables-alerter-script\") pod \"iptables-alerter-lpwqt\" (UID: \"7733a06d-9827-44bd-a425-e9a6676753f0\") " pod="openshift-network-operator/iptables-alerter-lpwqt"
Jul 06 14:20:21.679296 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.678802    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/11b08486-332e-46a6-a323-0399f4262447-hosts-file\") pod \"node-resolver-vvpws\" (UID: \"11b08486-332e-46a6-a323-0399f4262447\") " pod="openshift-dns/node-resolver-vvpws"
Jul 06 14:20:21.679296 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679096    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-multus-cni-dir\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.680076 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-host-run-k8s-cni-cncf-io\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.680076 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-run-netns\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.680076 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679220    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c18b158-e302-4ac8-b7a7-ad5faf534c52-ovn-node-metrics-cert\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.680076 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679229    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-run-netns\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.680076 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679249    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.680076 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679301    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d56c55cf-0128-4fb3-9416-2aa8754c56f6-serviceca\") pod \"node-ca-zsdxr\" (UID: \"d56c55cf-0128-4fb3-9416-2aa8754c56f6\") " pod="openshift-image-registry/node-ca-zsdxr"
Jul 06 14:20:21.680076 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret\") pod \"global-pull-secret-syncer-49jdc\" (UID: \"1b898534-bd6c-43bf-a49c-0ee858e6fb3f\") " pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:21.680076 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679353    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.680076 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679424    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-modprobe-d\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.680076 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679459    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-host-var-lib-kubelet\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.680076 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679483    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-host-run-multus-certs\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.680076 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679511    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-run-systemd\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.680076 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679534    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-sys\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.680076 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679568    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk92l\" (UniqueName: \"kubernetes.io/projected/b5040554-3ad9-44d9-8b09-cba10a5e4198-kube-api-access-dk92l\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.680076 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679592    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-host-var-lib-cni-bin\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.680076 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679621    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw6n7\" (UniqueName: \"kubernetes.io/projected/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-kube-api-access-zw6n7\") pod \"network-metrics-daemon-7m68m\" (UID: \"0741a5cc-f80e-49c5-9c57-df5f5ea7710d\") " pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:21.680076 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679647    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.680896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679713    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-slash\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.680896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679717    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d56c55cf-0128-4fb3-9416-2aa8754c56f6-serviceca\") pod \"node-ca-zsdxr\" (UID: \"d56c55cf-0128-4fb3-9416-2aa8754c56f6\") " pod="openshift-image-registry/node-ca-zsdxr"
Jul 06 14:20:21.680896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679768    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7733a06d-9827-44bd-a425-e9a6676753f0-host-slash\") pod \"iptables-alerter-lpwqt\" (UID: \"7733a06d-9827-44bd-a425-e9a6676753f0\") " pod="openshift-network-operator/iptables-alerter-lpwqt"
Jul 06 14:20:21.680896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679803    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d56c55cf-0128-4fb3-9416-2aa8754c56f6-host\") pod \"node-ca-zsdxr\" (UID: \"d56c55cf-0128-4fb3-9416-2aa8754c56f6\") " pod="openshift-image-registry/node-ca-zsdxr"
Jul 06 14:20:21.680896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679835    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9b36f481-6b7c-46d2-aedc-4fb7500117ed-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.680896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679860    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-run-systemd\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.680896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679864    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-dbus\") pod \"global-pull-secret-syncer-49jdc\" (UID: \"1b898534-bd6c-43bf-a49c-0ee858e6fb3f\") " pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:21.680896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679895    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-cnibin\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.680896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679922    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-systemd-units\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.680896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679922    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9b36f481-6b7c-46d2-aedc-4fb7500117ed-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.680896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.679976    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-systemd-units\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.680896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680012    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-node-log\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.680896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680045    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c18b158-e302-4ac8-b7a7-ad5faf534c52-ovnkube-script-lib\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.680896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680075    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-os-release\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.680896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680163    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-run-ovn\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.680896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680192    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csdlc\" (UniqueName: \"kubernetes.io/projected/9b36f481-6b7c-46d2-aedc-4fb7500117ed-kube-api-access-csdlc\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.680896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680222    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-os-release\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.681674 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680239    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.681674 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680257    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b085f67c-31a3-47bd-8150-b721cc9f0ac9-multus-daemon-config\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.681674 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.681674 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-sysctl-conf\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.681674 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680348    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-host-run-netns\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.681674 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680374    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lns5w\" (UniqueName: \"kubernetes.io/projected/2c18b158-e302-4ac8-b7a7-ad5faf534c52-kube-api-access-lns5w\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.681674 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680421    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.681674 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-cni-binary-copy\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.681674 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680483    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9b36f481-6b7c-46d2-aedc-4fb7500117ed-device-dir\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.681674 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680509    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-kubernetes\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.681674 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680521    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9b36f481-6b7c-46d2-aedc-4fb7500117ed-socket-dir\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.681674 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680533    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v44dj\" (UniqueName: \"kubernetes.io/projected/11b08486-332e-46a6-a323-0399f4262447-kube-api-access-v44dj\") pod \"node-resolver-vvpws\" (UID: \"11b08486-332e-46a6-a323-0399f4262447\") " pod="openshift-dns/node-resolver-vvpws"
Jul 06 14:20:21.681674 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b085f67c-31a3-47bd-8150-b721cc9f0ac9-cni-binary-copy\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.681674 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680584    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-host-var-lib-cni-multus\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.681674 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680591    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-run-ovn\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.681674 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680611    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c18b158-e302-4ac8-b7a7-ad5faf534c52-env-overrides\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.682443 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680687    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.682443 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680783    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-cnibin\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.682443 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680849    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9b36f481-6b7c-46d2-aedc-4fb7500117ed-registration-dir\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.682443 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680880    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11b08486-332e-46a6-a323-0399f4262447-tmp-dir\") pod \"node-resolver-vvpws\" (UID: \"11b08486-332e-46a6-a323-0399f4262447\") " pod="openshift-dns/node-resolver-vvpws"
Jul 06 14:20:21.682443 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680939    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c18b158-e302-4ac8-b7a7-ad5faf534c52-ovnkube-script-lib\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.682443 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.680992    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-os-release\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.682443 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.681031    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-cnibin\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.682443 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.681063    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c18b158-e302-4ac8-b7a7-ad5faf534c52-node-log\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.682443 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.681083    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9b36f481-6b7c-46d2-aedc-4fb7500117ed-device-dir\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.682443 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.681114    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c18b158-e302-4ac8-b7a7-ad5faf534c52-env-overrides\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.682443 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.681128    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9b36f481-6b7c-46d2-aedc-4fb7500117ed-registration-dir\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.682443 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.681532    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-cni-binary-copy\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.683047 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.683024    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6fd2b9fc-8eed-49bc-b589-60e74d28f89c-agent-certs\") pod \"konnectivity-agent-mmd82\" (UID: \"6fd2b9fc-8eed-49bc-b589-60e74d28f89c\") " pod="kube-system/konnectivity-agent-mmd82"
Jul 06 14:20:21.683609 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.683589    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c18b158-e302-4ac8-b7a7-ad5faf534c52-ovn-node-metrics-cert\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.690399 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.690368    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drk2k\" (UniqueName: \"kubernetes.io/projected/a7902abd-a9f3-486c-b7e0-6e7135dd4a37-kube-api-access-drk2k\") pod \"multus-additional-cni-plugins-l4pfm\" (UID: \"a7902abd-a9f3-486c-b7e0-6e7135dd4a37\") " pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.691004 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:21.690959    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:20:21.691004 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:21.690989    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:20:21.691004 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:21.691005    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ztkqt for pod openshift-network-diagnostics/network-check-target-vvs2w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:20:21.691222 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:21.691088    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt podName:f5f065bf-98db-456d-a71d-2b6ddf324436 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:22.191073843 +0000 UTC m=+3.039960792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ztkqt" (UniqueName: "kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt") pod "network-check-target-vvs2w" (UID: "f5f065bf-98db-456d-a71d-2b6ddf324436") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:20:21.692656 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.692631    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lns5w\" (UniqueName: \"kubernetes.io/projected/2c18b158-e302-4ac8-b7a7-ad5faf534c52-kube-api-access-lns5w\") pod \"ovnkube-node-gwkjw\" (UID: \"2c18b158-e302-4ac8-b7a7-ad5faf534c52\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.692997 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.692951    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsjck\" (UniqueName: \"kubernetes.io/projected/d56c55cf-0128-4fb3-9416-2aa8754c56f6-kube-api-access-fsjck\") pod \"node-ca-zsdxr\" (UID: \"d56c55cf-0128-4fb3-9416-2aa8754c56f6\") " pod="openshift-image-registry/node-ca-zsdxr"
Jul 06 14:20:21.693260 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.693239    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csdlc\" (UniqueName: \"kubernetes.io/projected/9b36f481-6b7c-46d2-aedc-4fb7500117ed-kube-api-access-csdlc\") pod \"aws-ebs-csi-driver-node-s8l2j\" (UID: \"9b36f481-6b7c-46d2-aedc-4fb7500117ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.693411 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.693386    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw6n7\" (UniqueName: \"kubernetes.io/projected/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-kube-api-access-zw6n7\") pod \"network-metrics-daemon-7m68m\" (UID: \"0741a5cc-f80e-49c5-9c57-df5f5ea7710d\") " pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:21.694112 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.694091    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc9lx\" (UniqueName: \"kubernetes.io/projected/7733a06d-9827-44bd-a425-e9a6676753f0-kube-api-access-nc9lx\") pod \"iptables-alerter-lpwqt\" (UID: \"7733a06d-9827-44bd-a425-e9a6676753f0\") " pod="openshift-network-operator/iptables-alerter-lpwqt"
Jul 06 14:20:21.745787 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.745725    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-124.ec2.internal" event={"ID":"1589fdad0eee7678693602cdf14d162f","Type":"ContainerStarted","Data":"ca0e02777d963f75c1cdc7afd348d08125b77edea0ae62c37a320706aa9e1a42"}
Jul 06 14:20:21.749571 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.749540    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal" event={"ID":"a00e02199f23972a2bbdd8527950f4e8","Type":"ContainerStarted","Data":"c1cbb5d50a48e4aa0283583904fa2ddbb93b6391a9701dced1ae181168d1562e"}
Jul 06 14:20:21.781459 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5040554-3ad9-44d9-8b09-cba10a5e4198-tmp\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.781459 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781463    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-system-cni-dir\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.781689 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781489    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-systemd\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.781689 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-host\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.781689 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781542    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-multus-socket-dir-parent\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.781689 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781581    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-sysconfig\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.781689 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781609    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-lib-modules\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.781689 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781630    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7hgv\" (UniqueName: \"kubernetes.io/projected/b085f67c-31a3-47bd-8150-b721cc9f0ac9-kube-api-access-k7hgv\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.781689 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781660    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-tuned\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.782016 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781696    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-run\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.782016 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-hostroot\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.782016 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781742    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-multus-conf-dir\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.782016 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781777    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-kubelet-config\") pod \"global-pull-secret-syncer-49jdc\" (UID: \"1b898534-bd6c-43bf-a49c-0ee858e6fb3f\") " pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:21.782016 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781799    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-sysctl-d\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.782016 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781817    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-etc-kubernetes\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.782016 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-var-lib-kubelet\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.782016 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781850    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/11b08486-332e-46a6-a323-0399f4262447-hosts-file\") pod \"node-resolver-vvpws\" (UID: \"11b08486-332e-46a6-a323-0399f4262447\") " pod="openshift-dns/node-resolver-vvpws"
Jul 06 14:20:21.782016 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781864    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-multus-cni-dir\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.782016 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781881    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-host-run-k8s-cni-cncf-io\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.782016 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781900    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret\") pod \"global-pull-secret-syncer-49jdc\" (UID: \"1b898534-bd6c-43bf-a49c-0ee858e6fb3f\") " pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:21.782016 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781918    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-modprobe-d\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.782016 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781940    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-host-var-lib-kubelet\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.782016 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-host-run-multus-certs\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.782016 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781979    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-sys\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.782016 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.781992    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk92l\" (UniqueName: \"kubernetes.io/projected/b5040554-3ad9-44d9-8b09-cba10a5e4198-kube-api-access-dk92l\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.782016 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.782008    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-host-var-lib-cni-bin\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.782927 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.782032    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-dbus\") pod \"global-pull-secret-syncer-49jdc\" (UID: \"1b898534-bd6c-43bf-a49c-0ee858e6fb3f\") " pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:21.782927 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.782051    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-cnibin\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.782927 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.782100    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-os-release\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.782927 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.782125    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b085f67c-31a3-47bd-8150-b721cc9f0ac9-multus-daemon-config\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.782927 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.782163    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-sysctl-conf\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.782927 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.782191    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-host-run-netns\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.782927 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.782221    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-kubernetes\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.782927 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.782244    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v44dj\" (UniqueName: \"kubernetes.io/projected/11b08486-332e-46a6-a323-0399f4262447-kube-api-access-v44dj\") pod \"node-resolver-vvpws\" (UID: \"11b08486-332e-46a6-a323-0399f4262447\") " pod="openshift-dns/node-resolver-vvpws"
Jul 06 14:20:21.782927 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.782268    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b085f67c-31a3-47bd-8150-b721cc9f0ac9-cni-binary-copy\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.782927 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.782291    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-host-var-lib-cni-multus\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.782927 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.782321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11b08486-332e-46a6-a323-0399f4262447-tmp-dir\") pod \"node-resolver-vvpws\" (UID: \"11b08486-332e-46a6-a323-0399f4262447\") " pod="openshift-dns/node-resolver-vvpws"
Jul 06 14:20:21.782927 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.782625    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-multus-cni-dir\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.783496 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.783306    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-kubelet-config\") pod \"global-pull-secret-syncer-49jdc\" (UID: \"1b898534-bd6c-43bf-a49c-0ee858e6fb3f\") " pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:21.783496 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.783368    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-run\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.783496 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.783410    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-hostroot\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.783496 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.783450    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-multus-conf-dir\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.785537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.783850    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-system-cni-dir\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.785537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.783883    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-etc-kubernetes\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.785537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.783917    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-systemd\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.785537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.783964    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-host\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.785537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.784014    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-multus-socket-dir-parent\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.785537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.784024    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-sysctl-d\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.785537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.784062    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-sysconfig\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.785537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.784127    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-lib-modules\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.785537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.784294    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-host-var-lib-kubelet\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.785537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.784339    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-host-run-k8s-cni-cncf-io\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.785537 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:21.784391    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:20:21.785537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.784412    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-modprobe-d\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.785537 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:21.784457    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret podName:1b898534-bd6c-43bf-a49c-0ee858e6fb3f nodeName:}" failed. No retries permitted until 2026-07-06 14:20:22.284437919 +0000 UTC m=+3.133324888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret") pod "global-pull-secret-syncer-49jdc" (UID: "1b898534-bd6c-43bf-a49c-0ee858e6fb3f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:20:21.785537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.784456    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-host-run-netns\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.785537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.784503    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-os-release\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.785537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.784548    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-cnibin\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.785537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.784819    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-kubernetes\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.785537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.784876    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-sys\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.786687 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.784918    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-host-run-multus-certs\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.786687 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.784970    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-var-lib-kubelet\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.786687 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.785050    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b085f67c-31a3-47bd-8150-b721cc9f0ac9-multus-daemon-config\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.786687 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.785199    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-sysctl-conf\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.786687 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.785252    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/11b08486-332e-46a6-a323-0399f4262447-hosts-file\") pod \"node-resolver-vvpws\" (UID: \"11b08486-332e-46a6-a323-0399f4262447\") " pod="openshift-dns/node-resolver-vvpws"
Jul 06 14:20:21.786687 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.785384    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-host-var-lib-cni-bin\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.786687 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.785429    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b085f67c-31a3-47bd-8150-b721cc9f0ac9-host-var-lib-cni-multus\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.786687 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.785487    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b085f67c-31a3-47bd-8150-b721cc9f0ac9-cni-binary-copy\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.786687 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.785832    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-dbus\") pod \"global-pull-secret-syncer-49jdc\" (UID: \"1b898534-bd6c-43bf-a49c-0ee858e6fb3f\") " pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:21.786687 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.786034    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5040554-3ad9-44d9-8b09-cba10a5e4198-tmp\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.786687 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.786097    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11b08486-332e-46a6-a323-0399f4262447-tmp-dir\") pod \"node-resolver-vvpws\" (UID: \"11b08486-332e-46a6-a323-0399f4262447\") " pod="openshift-dns/node-resolver-vvpws"
Jul 06 14:20:21.787725 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.787707    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5040554-3ad9-44d9-8b09-cba10a5e4198-etc-tuned\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.794378 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.794334    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v44dj\" (UniqueName: \"kubernetes.io/projected/11b08486-332e-46a6-a323-0399f4262447-kube-api-access-v44dj\") pod \"node-resolver-vvpws\" (UID: \"11b08486-332e-46a6-a323-0399f4262447\") " pod="openshift-dns/node-resolver-vvpws"
Jul 06 14:20:21.794887 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.794865    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7hgv\" (UniqueName: \"kubernetes.io/projected/b085f67c-31a3-47bd-8150-b721cc9f0ac9-kube-api-access-k7hgv\") pod \"multus-dmf4b\" (UID: \"b085f67c-31a3-47bd-8150-b721cc9f0ac9\") " pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.794966 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.794891    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk92l\" (UniqueName: \"kubernetes.io/projected/b5040554-3ad9-44d9-8b09-cba10a5e4198-kube-api-access-dk92l\") pod \"tuned-tvb6v\" (UID: \"b5040554-3ad9-44d9-8b09-cba10a5e4198\") " pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.866567 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.866483    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:21.874530 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.874317    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j"
Jul 06 14:20:21.881537 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:21.881499    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c18b158_e302_4ac8_b7a7_ad5faf534c52.slice/crio-4d07203971d67e3558d12b75db730d64b9c965655bb6a44bd6460a8dc0cc4ad5 WatchSource:0}: Error finding container 4d07203971d67e3558d12b75db730d64b9c965655bb6a44bd6460a8dc0cc4ad5: Status 404 returned error can't find the container with id 4d07203971d67e3558d12b75db730d64b9c965655bb6a44bd6460a8dc0cc4ad5
Jul 06 14:20:21.882519 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.882491    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zsdxr"
Jul 06 14:20:21.888079 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:21.887244    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b36f481_6b7c_46d2_aedc_4fb7500117ed.slice/crio-34df570cab0c1aeebea3d6df198646d8fa818851b05a40d0fab11e8bfe5db174 WatchSource:0}: Error finding container 34df570cab0c1aeebea3d6df198646d8fa818851b05a40d0fab11e8bfe5db174: Status 404 returned error can't find the container with id 34df570cab0c1aeebea3d6df198646d8fa818851b05a40d0fab11e8bfe5db174
Jul 06 14:20:21.888079 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.887644    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l4pfm"
Jul 06 14:20:21.894491 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.894459    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mmd82"
Jul 06 14:20:21.895987 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:21.895953    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd56c55cf_0128_4fb3_9416_2aa8754c56f6.slice/crio-755b4fa5ea05899e6c759ed2ac58d0d69fe5ed0eddb0f4c0681bc7a43f5f5244 WatchSource:0}: Error finding container 755b4fa5ea05899e6c759ed2ac58d0d69fe5ed0eddb0f4c0681bc7a43f5f5244: Status 404 returned error can't find the container with id 755b4fa5ea05899e6c759ed2ac58d0d69fe5ed0eddb0f4c0681bc7a43f5f5244
Jul 06 14:20:21.902078 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.899779    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lpwqt"
Jul 06 14:20:21.903634 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:21.903611    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7902abd_a9f3_486c_b7e0_6e7135dd4a37.slice/crio-81dbb803cdf83a3537b88ba2ae3054fde0c4c3e07e33ccc9eb3c3c48835a9b30 WatchSource:0}: Error finding container 81dbb803cdf83a3537b88ba2ae3054fde0c4c3e07e33ccc9eb3c3c48835a9b30: Status 404 returned error can't find the container with id 81dbb803cdf83a3537b88ba2ae3054fde0c4c3e07e33ccc9eb3c3c48835a9b30
Jul 06 14:20:21.905806 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.905609    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vvpws"
Jul 06 14:20:21.907333 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:21.907304    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd2b9fc_8eed_49bc_b589_60e74d28f89c.slice/crio-3bfc8163b01a8af80b704becd502f683c2c7a7f3aa5a25a126e128cee306b513 WatchSource:0}: Error finding container 3bfc8163b01a8af80b704becd502f683c2c7a7f3aa5a25a126e128cee306b513: Status 404 returned error can't find the container with id 3bfc8163b01a8af80b704becd502f683c2c7a7f3aa5a25a126e128cee306b513
Jul 06 14:20:21.911361 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:21.911337    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7733a06d_9827_44bd_a425_e9a6676753f0.slice/crio-21db1f84ae26f8f22861ea3f653813e98242a375de2d8119ea094823fe0b1199 WatchSource:0}: Error finding container 21db1f84ae26f8f22861ea3f653813e98242a375de2d8119ea094823fe0b1199: Status 404 returned error can't find the container with id 21db1f84ae26f8f22861ea3f653813e98242a375de2d8119ea094823fe0b1199
Jul 06 14:20:21.912331 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.912308    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dmf4b"
Jul 06 14:20:21.918221 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:21.918200    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tvb6v"
Jul 06 14:20:21.919242 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:21.919223    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b08486_332e_46a6_a323_0399f4262447.slice/crio-f40d9b3dfa8ffaaf9f945b9db27d4b79fba261fa626a22cc923dd5d8eab047d6 WatchSource:0}: Error finding container f40d9b3dfa8ffaaf9f945b9db27d4b79fba261fa626a22cc923dd5d8eab047d6: Status 404 returned error can't find the container with id f40d9b3dfa8ffaaf9f945b9db27d4b79fba261fa626a22cc923dd5d8eab047d6
Jul 06 14:20:21.922715 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:21.922678    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb085f67c_31a3_47bd_8150_b721cc9f0ac9.slice/crio-b9c6b12a5fc102ff57b44b2b18ab20f2fbb40cd57d3796f3c25b89e6891e8909 WatchSource:0}: Error finding container b9c6b12a5fc102ff57b44b2b18ab20f2fbb40cd57d3796f3c25b89e6891e8909: Status 404 returned error can't find the container with id b9c6b12a5fc102ff57b44b2b18ab20f2fbb40cd57d3796f3c25b89e6891e8909
Jul 06 14:20:21.928646 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:20:21.928622    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5040554_3ad9_44d9_8b09_cba10a5e4198.slice/crio-a2c3946212543eabd9e9953db8ffeff8c245cebfab13eb6347ffc80814557470 WatchSource:0}: Error finding container a2c3946212543eabd9e9953db8ffeff8c245cebfab13eb6347ffc80814557470: Status 404 returned error can't find the container with id a2c3946212543eabd9e9953db8ffeff8c245cebfab13eb6347ffc80814557470
Jul 06 14:20:22.185582 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:22.185488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs\") pod \"network-metrics-daemon-7m68m\" (UID: \"0741a5cc-f80e-49c5-9c57-df5f5ea7710d\") " pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:22.185736 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:22.185614    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:20:22.185736 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:22.185681    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs podName:0741a5cc-f80e-49c5-9c57-df5f5ea7710d nodeName:}" failed. No retries permitted until 2026-07-06 14:20:23.185665278 +0000 UTC m=+4.034552230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs") pod "network-metrics-daemon-7m68m" (UID: "0741a5cc-f80e-49c5-9c57-df5f5ea7710d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:20:22.286803 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:22.286772    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret\") pod \"global-pull-secret-syncer-49jdc\" (UID: \"1b898534-bd6c-43bf-a49c-0ee858e6fb3f\") " pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:22.286983 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:22.286867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztkqt\" (UniqueName: \"kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt\") pod \"network-check-target-vvs2w\" (UID: \"f5f065bf-98db-456d-a71d-2b6ddf324436\") " pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:22.286983 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:22.286958    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:20:22.287090 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:22.286994    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:20:22.287090 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:22.287010    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:20:22.287090 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:22.287023    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ztkqt for pod openshift-network-diagnostics/network-check-target-vvs2w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:20:22.287090 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:22.287044    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret podName:1b898534-bd6c-43bf-a49c-0ee858e6fb3f nodeName:}" failed. No retries permitted until 2026-07-06 14:20:23.28702003 +0000 UTC m=+4.135906981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret") pod "global-pull-secret-syncer-49jdc" (UID: "1b898534-bd6c-43bf-a49c-0ee858e6fb3f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:20:22.287090 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:22.287072    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt podName:f5f065bf-98db-456d-a71d-2b6ddf324436 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:23.287056177 +0000 UTC m=+4.135943128 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ztkqt" (UniqueName: "kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt") pod "network-check-target-vvs2w" (UID: "f5f065bf-98db-456d-a71d-2b6ddf324436") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:20:22.656499 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:22.656385    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 14:15:21 +0000 UTC" deadline="2028-04-15 12:27:21.524880352 +0000 UTC"
Jul 06 14:20:22.656499 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:22.656449    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15574h6m58.868435997s"
Jul 06 14:20:22.740753 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:22.740689    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:22.740935 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:22.740846    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:22.752816 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:22.752778    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vvpws" event={"ID":"11b08486-332e-46a6-a323-0399f4262447","Type":"ContainerStarted","Data":"f40d9b3dfa8ffaaf9f945b9db27d4b79fba261fa626a22cc923dd5d8eab047d6"}
Jul 06 14:20:22.755376 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:22.755343    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lpwqt" event={"ID":"7733a06d-9827-44bd-a425-e9a6676753f0","Type":"ContainerStarted","Data":"21db1f84ae26f8f22861ea3f653813e98242a375de2d8119ea094823fe0b1199"}
Jul 06 14:20:22.758048 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:22.758017    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4pfm" event={"ID":"a7902abd-a9f3-486c-b7e0-6e7135dd4a37","Type":"ContainerStarted","Data":"81dbb803cdf83a3537b88ba2ae3054fde0c4c3e07e33ccc9eb3c3c48835a9b30"}
Jul 06 14:20:22.761373 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:22.761344    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw" event={"ID":"2c18b158-e302-4ac8-b7a7-ad5faf534c52","Type":"ContainerStarted","Data":"4d07203971d67e3558d12b75db730d64b9c965655bb6a44bd6460a8dc0cc4ad5"}
Jul 06 14:20:22.765662 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:22.765632    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tvb6v" event={"ID":"b5040554-3ad9-44d9-8b09-cba10a5e4198","Type":"ContainerStarted","Data":"a2c3946212543eabd9e9953db8ffeff8c245cebfab13eb6347ffc80814557470"}
Jul 06 14:20:22.767206 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:22.767180    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dmf4b" event={"ID":"b085f67c-31a3-47bd-8150-b721cc9f0ac9","Type":"ContainerStarted","Data":"b9c6b12a5fc102ff57b44b2b18ab20f2fbb40cd57d3796f3c25b89e6891e8909"}
Jul 06 14:20:22.769038 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:22.769012    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mmd82" event={"ID":"6fd2b9fc-8eed-49bc-b589-60e74d28f89c","Type":"ContainerStarted","Data":"3bfc8163b01a8af80b704becd502f683c2c7a7f3aa5a25a126e128cee306b513"}
Jul 06 14:20:22.771587 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:22.771560    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zsdxr" event={"ID":"d56c55cf-0128-4fb3-9416-2aa8754c56f6","Type":"ContainerStarted","Data":"755b4fa5ea05899e6c759ed2ac58d0d69fe5ed0eddb0f4c0681bc7a43f5f5244"}
Jul 06 14:20:22.774183 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:22.774158    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j" event={"ID":"9b36f481-6b7c-46d2-aedc-4fb7500117ed","Type":"ContainerStarted","Data":"34df570cab0c1aeebea3d6df198646d8fa818851b05a40d0fab11e8bfe5db174"}
Jul 06 14:20:23.192921 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:23.192880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs\") pod \"network-metrics-daemon-7m68m\" (UID: \"0741a5cc-f80e-49c5-9c57-df5f5ea7710d\") " pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:23.193157 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:23.193046    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:20:23.193157 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:23.193114    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs podName:0741a5cc-f80e-49c5-9c57-df5f5ea7710d nodeName:}" failed. No retries permitted until 2026-07-06 14:20:25.193095345 +0000 UTC m=+6.041982314 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs") pod "network-metrics-daemon-7m68m" (UID: "0741a5cc-f80e-49c5-9c57-df5f5ea7710d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:20:23.293885 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:23.293844    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztkqt\" (UniqueName: \"kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt\") pod \"network-check-target-vvs2w\" (UID: \"f5f065bf-98db-456d-a71d-2b6ddf324436\") " pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:23.294065 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:23.293907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret\") pod \"global-pull-secret-syncer-49jdc\" (UID: \"1b898534-bd6c-43bf-a49c-0ee858e6fb3f\") " pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:23.294065 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:23.294058    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:20:23.294190 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:23.294121    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret podName:1b898534-bd6c-43bf-a49c-0ee858e6fb3f nodeName:}" failed. No retries permitted until 2026-07-06 14:20:25.294101803 +0000 UTC m=+6.142988775 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret") pod "global-pull-secret-syncer-49jdc" (UID: "1b898534-bd6c-43bf-a49c-0ee858e6fb3f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:20:23.294579 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:23.294557    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:20:23.294669 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:23.294584    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:20:23.294669 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:23.294600    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ztkqt for pod openshift-network-diagnostics/network-check-target-vvs2w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:20:23.294669 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:23.294646    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt podName:f5f065bf-98db-456d-a71d-2b6ddf324436 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:25.29463123 +0000 UTC m=+6.143518182 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ztkqt" (UniqueName: "kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt") pod "network-check-target-vvs2w" (UID: "f5f065bf-98db-456d-a71d-2b6ddf324436") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:20:23.657624 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:23.657425    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 14:15:21 +0000 UTC" deadline="2027-12-19 08:44:57.850325579 +0000 UTC"
Jul 06 14:20:23.657624 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:23.657474    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12738h24m34.192857198s"
Jul 06 14:20:23.743391 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:23.743357    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:23.743570 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:23.743490    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:23.743904 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:23.743882    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:23.744005 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:23.743984    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:24.740514 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:24.740441    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:24.740949 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:24.740566    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:25.209858 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:25.209772    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs\") pod \"network-metrics-daemon-7m68m\" (UID: \"0741a5cc-f80e-49c5-9c57-df5f5ea7710d\") " pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:25.210033 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:25.209939    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:20:25.210033 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:25.209997    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs podName:0741a5cc-f80e-49c5-9c57-df5f5ea7710d nodeName:}" failed. No retries permitted until 2026-07-06 14:20:29.209984174 +0000 UTC m=+10.058871123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs") pod "network-metrics-daemon-7m68m" (UID: "0741a5cc-f80e-49c5-9c57-df5f5ea7710d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:20:25.310937 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:25.310890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret\") pod \"global-pull-secret-syncer-49jdc\" (UID: \"1b898534-bd6c-43bf-a49c-0ee858e6fb3f\") " pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:25.311123 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:25.310996    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztkqt\" (UniqueName: \"kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt\") pod \"network-check-target-vvs2w\" (UID: \"f5f065bf-98db-456d-a71d-2b6ddf324436\") " pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:25.311123 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:25.311069    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:20:25.311123 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:25.311094    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:20:25.311123 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:25.311111    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:20:25.311123 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:25.311126    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ztkqt for pod openshift-network-diagnostics/network-check-target-vvs2w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:20:25.311425 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:25.311192    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret podName:1b898534-bd6c-43bf-a49c-0ee858e6fb3f nodeName:}" failed. No retries permitted until 2026-07-06 14:20:29.31113436 +0000 UTC m=+10.160021332 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret") pod "global-pull-secret-syncer-49jdc" (UID: "1b898534-bd6c-43bf-a49c-0ee858e6fb3f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:20:25.311425 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:25.311211    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt podName:f5f065bf-98db-456d-a71d-2b6ddf324436 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:29.311201388 +0000 UTC m=+10.160088339 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ztkqt" (UniqueName: "kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt") pod "network-check-target-vvs2w" (UID: "f5f065bf-98db-456d-a71d-2b6ddf324436") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:20:25.741658 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:25.741244    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:25.741658 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:25.741363    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:25.742346 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:25.742208    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:25.742346 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:25.742309    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:26.740855 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:26.740817    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:26.741076 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:26.740960    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:27.740811 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:27.740509    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:27.741295 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:27.740869    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:27.741367 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:27.741340    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:27.741495 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:27.741460    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:28.740994 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:28.740900    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:28.741489 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:28.741055    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:29.246039 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:29.246002    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs\") pod \"network-metrics-daemon-7m68m\" (UID: \"0741a5cc-f80e-49c5-9c57-df5f5ea7710d\") " pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:29.246229 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:29.246134    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:20:29.246229 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:29.246219    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs podName:0741a5cc-f80e-49c5-9c57-df5f5ea7710d nodeName:}" failed. No retries permitted until 2026-07-06 14:20:37.246204097 +0000 UTC m=+18.095091047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs") pod "network-metrics-daemon-7m68m" (UID: "0741a5cc-f80e-49c5-9c57-df5f5ea7710d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:20:29.346833 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:29.346792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret\") pod \"global-pull-secret-syncer-49jdc\" (UID: \"1b898534-bd6c-43bf-a49c-0ee858e6fb3f\") " pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:29.347018 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:29.346916    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztkqt\" (UniqueName: \"kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt\") pod \"network-check-target-vvs2w\" (UID: \"f5f065bf-98db-456d-a71d-2b6ddf324436\") " pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:29.347018 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:29.346939    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:20:29.347018 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:29.347011    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret podName:1b898534-bd6c-43bf-a49c-0ee858e6fb3f nodeName:}" failed. No retries permitted until 2026-07-06 14:20:37.346991893 +0000 UTC m=+18.195878846 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret") pod "global-pull-secret-syncer-49jdc" (UID: "1b898534-bd6c-43bf-a49c-0ee858e6fb3f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:20:29.347223 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:29.347033    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:20:29.347223 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:29.347054    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:20:29.347223 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:29.347067    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ztkqt for pod openshift-network-diagnostics/network-check-target-vvs2w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:20:29.347223 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:29.347121    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt podName:f5f065bf-98db-456d-a71d-2b6ddf324436 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:37.347105894 +0000 UTC m=+18.195992843 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ztkqt" (UniqueName: "kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt") pod "network-check-target-vvs2w" (UID: "f5f065bf-98db-456d-a71d-2b6ddf324436") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:20:29.741533 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:29.741452    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:29.741924 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:29.741556    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:29.741924 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:29.741604    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:29.741924 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:29.741704    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:30.740466 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:30.740430    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:30.740648 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:30.740585    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:31.743317 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:31.742380    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:31.743317 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:31.742422    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:31.743317 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:31.742521    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:31.743317 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:31.743273    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:32.740624 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:32.740556    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:32.740796 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:32.740691    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:33.740284 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:33.740248    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:33.740740 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:33.740299    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:33.740740 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:33.740403    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:33.740740 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:33.740522    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:33.801244 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:33.801204    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-124.ec2.internal" event={"ID":"1589fdad0eee7678693602cdf14d162f","Type":"ContainerStarted","Data":"ef6bc3d73926cc06212853f26a5223a3163b45cb506574c81dd9a3f91fd58297"}
Jul 06 14:20:33.804006 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:33.803964    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tvb6v" event={"ID":"b5040554-3ad9-44d9-8b09-cba10a5e4198","Type":"ContainerStarted","Data":"64ac0fd5bb2643436f7a450f7b9e5e686538138965c71810a7caa5aae7522e76"}
Jul 06 14:20:33.819808 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:33.819756    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-124.ec2.internal" podStartSLOduration=13.819736781 podStartE2EDuration="13.819736781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:20:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:33.819380749 +0000 UTC m=+14.668267719" watchObservedRunningTime="2026-07-06 14:20:33.819736781 +0000 UTC m=+14.668623753"
Jul 06 14:20:33.838887 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:33.838830    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tvb6v" podStartSLOduration=3.00400859 podStartE2EDuration="13.838811904s" totalImagesPullingTime="10.834803314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:33.83808924 +0000 UTC m=+14.686976212" watchObservedRunningTime="2026-07-06 14:20:33.838811904 +0000 UTC m=+14.687698875"
Jul 06 14:20:34.741138 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:34.740919    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:34.741509 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:34.741227    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:34.808540 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:34.808501    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j" event={"ID":"9b36f481-6b7c-46d2-aedc-4fb7500117ed","Type":"ContainerStarted","Data":"5734ea87aceda3aef35e2d20428658c8a36586a4d01b01523afbaf304c22e0a8"}
Jul 06 14:20:34.810205 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:34.810171    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal" event={"ID":"a00e02199f23972a2bbdd8527950f4e8","Type":"ContainerStarted","Data":"d54612106c69bc8123c78c79ac7f6f059e851997684b583bdc96be7c80518f0c"}
Jul 06 14:20:34.811775 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:34.811748    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vvpws" event={"ID":"11b08486-332e-46a6-a323-0399f4262447","Type":"ContainerStarted","Data":"9ed8bbfe126815bcd626d14f0868792f57bb3dd3ac43b8fb69ad34dee2314f3f"}
Jul 06 14:20:34.813693 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:34.813660    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lpwqt" event={"ID":"7733a06d-9827-44bd-a425-e9a6676753f0","Type":"ContainerStarted","Data":"17eac71e5996af0b90e913572fc455bd195085fd126c506c3d897ed4e3c4c72b"}
Jul 06 14:20:34.815523 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:34.815500    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4pfm" event={"ID":"a7902abd-a9f3-486c-b7e0-6e7135dd4a37","Type":"ContainerStarted","Data":"d72fbe0ff7f4a1512985c1e305c55b5d4cdb99fa946fd1b14aba0578510f7a0c"}
Jul 06 14:20:34.817412 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:34.817389    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mmd82" event={"ID":"6fd2b9fc-8eed-49bc-b589-60e74d28f89c","Type":"ContainerStarted","Data":"72c1556a05322625190428efaaf5d01ef4a6ee56521b2e06a395acdefbf098c9"}
Jul 06 14:20:34.818978 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:34.818933    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zsdxr" event={"ID":"d56c55cf-0128-4fb3-9416-2aa8754c56f6","Type":"ContainerStarted","Data":"878d54b4db58f0bb6550f4639777398d13a6815559fecf1ee527e5fd203e0715"}
Jul 06 14:20:34.852343 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:34.852280    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zsdxr" podStartSLOduration=5.013652767 podStartE2EDuration="15.852259603s" totalImagesPullingTime="10.838606836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:20:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:34.850560949 +0000 UTC m=+15.699447919" watchObservedRunningTime="2026-07-06 14:20:34.852259603 +0000 UTC m=+15.701146575"
Jul 06 14:20:34.901264 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:34.901208    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vvpws" podStartSLOduration=4.0662796 podStartE2EDuration="14.901191094s" totalImagesPullingTime="10.834911494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:34.900076474 +0000 UTC m=+15.748963470" watchObservedRunningTime="2026-07-06 14:20:34.901191094 +0000 UTC m=+15.750078065"
Jul 06 14:20:34.921751 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:34.921697    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mmd82" podStartSLOduration=4.070776849 podStartE2EDuration="14.921684454s" totalImagesPullingTime="10.850907605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:34.921063088 +0000 UTC m=+15.769950058" watchObservedRunningTime="2026-07-06 14:20:34.921684454 +0000 UTC m=+15.770571425"
Jul 06 14:20:34.942514 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:34.942454    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lpwqt" podStartSLOduration=4.091095332 podStartE2EDuration="14.942435187s" totalImagesPullingTime="10.851339855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:34.941546345 +0000 UTC m=+15.790433315" watchObservedRunningTime="2026-07-06 14:20:34.942435187 +0000 UTC m=+15.791322159"
Jul 06 14:20:35.740184 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:35.740132    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:35.740358 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:35.740197    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:35.740358 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:35.740279    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:35.740358 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:35.740334    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:36.740053 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:36.740018    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:36.740668 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:36.740172    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:37.160276 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:37.160187    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mmd82"
Jul 06 14:20:37.161248 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:37.161223    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mmd82"
Jul 06 14:20:37.310715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:37.310677    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs\") pod \"network-metrics-daemon-7m68m\" (UID: \"0741a5cc-f80e-49c5-9c57-df5f5ea7710d\") " pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:37.310886 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:37.310840    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:20:37.310931 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:37.310910    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs podName:0741a5cc-f80e-49c5-9c57-df5f5ea7710d nodeName:}" failed. No retries permitted until 2026-07-06 14:20:53.310891781 +0000 UTC m=+34.159778745 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs") pod "network-metrics-daemon-7m68m" (UID: "0741a5cc-f80e-49c5-9c57-df5f5ea7710d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:20:37.411918 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:37.411829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztkqt\" (UniqueName: \"kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt\") pod \"network-check-target-vvs2w\" (UID: \"f5f065bf-98db-456d-a71d-2b6ddf324436\") " pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:37.411918 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:37.411891    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret\") pod \"global-pull-secret-syncer-49jdc\" (UID: \"1b898534-bd6c-43bf-a49c-0ee858e6fb3f\") " pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:37.412161 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:37.411958    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:20:37.412161 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:37.411986    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:20:37.412161 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:37.411996    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ztkqt for pod openshift-network-diagnostics/network-check-target-vvs2w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:20:37.412161 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:37.412010    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:20:37.412161 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:37.412056    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt podName:f5f065bf-98db-456d-a71d-2b6ddf324436 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:53.412036664 +0000 UTC m=+34.260923616 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ztkqt" (UniqueName: "kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt") pod "network-check-target-vvs2w" (UID: "f5f065bf-98db-456d-a71d-2b6ddf324436") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:20:37.412161 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:37.412078    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret podName:1b898534-bd6c-43bf-a49c-0ee858e6fb3f nodeName:}" failed. No retries permitted until 2026-07-06 14:20:53.412067852 +0000 UTC m=+34.260954806 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret") pod "global-pull-secret-syncer-49jdc" (UID: "1b898534-bd6c-43bf-a49c-0ee858e6fb3f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:20:37.740489 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:37.740405    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:37.741178 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:37.740546    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:37.741178 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:37.740589    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:37.741941 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:37.741887    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:37.827664 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:37.827624    2562 generic.go:356] "Generic (PLEG): container finished" podID="a7902abd-a9f3-486c-b7e0-6e7135dd4a37" containerID="d72fbe0ff7f4a1512985c1e305c55b5d4cdb99fa946fd1b14aba0578510f7a0c" exitCode=0
Jul 06 14:20:37.827813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:37.827717    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4pfm" event={"ID":"a7902abd-a9f3-486c-b7e0-6e7135dd4a37","Type":"ContainerDied","Data":"d72fbe0ff7f4a1512985c1e305c55b5d4cdb99fa946fd1b14aba0578510f7a0c"}
Jul 06 14:20:37.829571 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:37.829482    2562 generic.go:356] "Generic (PLEG): container finished" podID="a00e02199f23972a2bbdd8527950f4e8" containerID="d54612106c69bc8123c78c79ac7f6f059e851997684b583bdc96be7c80518f0c" exitCode=0
Jul 06 14:20:37.829721 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:37.829696    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal" event={"ID":"a00e02199f23972a2bbdd8527950f4e8","Type":"ContainerDied","Data":"d54612106c69bc8123c78c79ac7f6f059e851997684b583bdc96be7c80518f0c"}
Jul 06 14:20:38.403360 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:38.403328    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mmd82"
Jul 06 14:20:38.404210 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:38.404006    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mmd82"
Jul 06 14:20:38.741035 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:38.740960    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:38.741552 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:38.741081    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:39.741895 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:39.741854    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:39.742395 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:39.741978    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:39.742395 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:39.742100    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:39.742395 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:39.742221    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:40.740736 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:40.740700    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:40.741033 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:40.740824    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:41.740342 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:41.740307    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:41.740838 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:41.740350    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:41.740838 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:41.740431    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:41.740838 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:41.740595    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:42.369539 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:42.369323    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 14:20:42.648331 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:42.647984    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T14:20:42.369534546Z","UUID":"f08880e0-5de1-40d4-9864-4c96566e3ac1","Handler":null,"Name":"","Endpoint":""}
Jul 06 14:20:42.649732 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:42.649706    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 14:20:42.649849 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:42.649750    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 14:20:42.740689 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:42.740653    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:42.741185 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:42.740802    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:42.841001 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:42.840964    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dmf4b" event={"ID":"b085f67c-31a3-47bd-8150-b721cc9f0ac9","Type":"ContainerStarted","Data":"7b8c0a82a48b80e8157d39d03558ff07244f5b0db625d9fc1a3d120dd92c917e"}
Jul 06 14:20:42.842823 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:42.842793    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j" event={"ID":"9b36f481-6b7c-46d2-aedc-4fb7500117ed","Type":"ContainerStarted","Data":"2f143c8168510122f6882c6b887379fc402267141a325e88ffc5f1ce2eb51aac"}
Jul 06 14:20:42.844463 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:42.844440    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal" event={"ID":"a00e02199f23972a2bbdd8527950f4e8","Type":"ContainerStarted","Data":"0b0dfec6a716134ba74f690ab4448ec9c4e67f4266b24ae5f6779c983b6bdb13"}
Jul 06 14:20:42.846715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:42.846697    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw" event={"ID":"2c18b158-e302-4ac8-b7a7-ad5faf534c52","Type":"ContainerStarted","Data":"de2d8b385696936719673661e705a6a59af00ce5076c2f5046b7c3697c9a10b3"}
Jul 06 14:20:42.846784 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:42.846748    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw" event={"ID":"2c18b158-e302-4ac8-b7a7-ad5faf534c52","Type":"ContainerStarted","Data":"3bd996907f2d0bc880f47b538a3cbfb4fac85b9034cf309649d4a118d3147d38"}
Jul 06 14:20:42.846784 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:42.846780    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw" event={"ID":"2c18b158-e302-4ac8-b7a7-ad5faf534c52","Type":"ContainerStarted","Data":"bd0e3adcef9f029a5565cb13011d2c0e1f169ea35f3ee475b71fad8a8b7e9162"}
Jul 06 14:20:42.846850 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:42.846808    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw" event={"ID":"2c18b158-e302-4ac8-b7a7-ad5faf534c52","Type":"ContainerStarted","Data":"913afc4ec0a27e042b7dec161c3fdf413bad978afe57dca32660df9aa30fc7f3"}
Jul 06 14:20:42.846850 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:42.846843    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw" event={"ID":"2c18b158-e302-4ac8-b7a7-ad5faf534c52","Type":"ContainerStarted","Data":"2ea8e65b3ec61b357f4e3fdf54cb528004fc2510220567c083e70b6f2aba63a5"}
Jul 06 14:20:42.873718 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:42.873635    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dmf4b" podStartSLOduration=2.550737122 podStartE2EDuration="22.873617418s" totalImagesPullingTime="20.322880296s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:42.872308258 +0000 UTC m=+23.721195230" watchObservedRunningTime="2026-07-06 14:20:42.873617418 +0000 UTC m=+23.722504389"
Jul 06 14:20:42.906637 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:42.906578    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-124.ec2.internal" podStartSLOduration=22.906558563 podStartE2EDuration="22.906558563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:20:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:42.906089462 +0000 UTC m=+23.754976434" watchObservedRunningTime="2026-07-06 14:20:42.906558563 +0000 UTC m=+23.755445536"
Jul 06 14:20:43.740080 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:43.740035    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:43.740080 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:43.740078    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:43.740362 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:43.740189    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:43.740362 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:43.740326    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:43.851428 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:43.851394    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw" event={"ID":"2c18b158-e302-4ac8-b7a7-ad5faf534c52","Type":"ContainerStarted","Data":"05dda8abf57f36c3fcb85122248f0f4fd0a3d0cbd55b78b34c56635cd2b488c4"}
Jul 06 14:20:44.740292 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:44.740257    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:44.740474 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:44.740372    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:44.855982 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:44.855946    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j" event={"ID":"9b36f481-6b7c-46d2-aedc-4fb7500117ed","Type":"ContainerStarted","Data":"3a0f50451956d6db591f1a7c5a761cce4a14c1660c767cbe11937e2bb4eaaa67"}
Jul 06 14:20:44.878213 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:44.878163    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8l2j" podStartSLOduration=5.330033296 podStartE2EDuration="25.878125654s" totalImagesPullingTime="20.548092358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:20:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:44.877636807 +0000 UTC m=+25.726523779" watchObservedRunningTime="2026-07-06 14:20:44.878125654 +0000 UTC m=+25.727012624"
Jul 06 14:20:45.744206 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:45.744171    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:45.744477 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:45.744171    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:45.744477 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:45.744296    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:45.744477 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:45.744351    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:45.861127 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:45.861090    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw" event={"ID":"2c18b158-e302-4ac8-b7a7-ad5faf534c52","Type":"ContainerStarted","Data":"7f21b0acd1fa951f257abdaa974aeea6f11fec141b68aa5e56c615cc5f1c36c2"}
Jul 06 14:20:46.741003 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:46.740968    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:46.741198 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:46.741093    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:47.740139 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:47.740086    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:47.740619 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:47.740265    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:47.740619 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:47.740312    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:47.740619 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:47.740424    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:48.740362 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:48.740176    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:48.740952 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:48.740466    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:48.869450 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:48.869408    2562 generic.go:356] "Generic (PLEG): container finished" podID="a7902abd-a9f3-486c-b7e0-6e7135dd4a37" containerID="6361d1fd32fe898397e5e36951d5222f994fd43bc1693464aede7cdc7d450076" exitCode=0
Jul 06 14:20:48.869632 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:48.869476    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4pfm" event={"ID":"a7902abd-a9f3-486c-b7e0-6e7135dd4a37","Type":"ContainerDied","Data":"6361d1fd32fe898397e5e36951d5222f994fd43bc1693464aede7cdc7d450076"}
Jul 06 14:20:48.873346 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:48.873291    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw" event={"ID":"2c18b158-e302-4ac8-b7a7-ad5faf534c52","Type":"ContainerStarted","Data":"9817797f780ce08dc0bbc1bbd9a9d065bda970a88c0d2c6f671fb86f933e4ab3"}
Jul 06 14:20:48.873606 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:48.873586    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:48.873724 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:48.873663    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:48.873724 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:48.873705    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:48.891449 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:48.891420    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:48.894574 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:48.894558    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:20:48.960658 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:48.960602    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw" podStartSLOduration=9.565668441 podStartE2EDuration="29.960585958s" totalImagesPullingTime="20.394917517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:20:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:48.96032661 +0000 UTC m=+29.809213580" watchObservedRunningTime="2026-07-06 14:20:48.960585958 +0000 UTC m=+29.809472967"
Jul 06 14:20:49.741273 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:49.741237    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:49.741755 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:49.741336    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:49.741755 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:49.741392    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:49.741755 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:49.741456    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:50.314803 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:50.314771    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vvs2w"]
Jul 06 14:20:50.314971 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:50.314864    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:50.314971 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:50.314942    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:50.318942 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:50.318913    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7m68m"]
Jul 06 14:20:50.319108 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:50.319052    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:50.319219 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:50.319200    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:50.319477 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:50.319457    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-49jdc"]
Jul 06 14:20:50.319559 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:50.319545    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:50.319654 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:50.319634    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:50.880276 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:50.880243    2562 generic.go:356] "Generic (PLEG): container finished" podID="a7902abd-a9f3-486c-b7e0-6e7135dd4a37" containerID="5c3160468bbb43ed9e699267f03546c0cc901529544d6b2cf91b0085a3f11236" exitCode=0
Jul 06 14:20:50.880693 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:50.880301    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4pfm" event={"ID":"a7902abd-a9f3-486c-b7e0-6e7135dd4a37","Type":"ContainerDied","Data":"5c3160468bbb43ed9e699267f03546c0cc901529544d6b2cf91b0085a3f11236"}
Jul 06 14:20:51.646449 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:51.646365    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vvpws_11b08486-332e-46a6-a323-0399f4262447/dns-node-resolver/0.log"
Jul 06 14:20:51.740463 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:51.740218    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:51.740638 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:51.740227    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:51.740638 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:51.740594    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:51.740638 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:51.740269    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:51.740788 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:51.740752    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:51.740885 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:51.740832    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:52.608360 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:52.608334    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zsdxr_d56c55cf-0128-4fb3-9416-2aa8754c56f6/node-ca/0.log"
Jul 06 14:20:52.888247 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:52.888170    2562 generic.go:356] "Generic (PLEG): container finished" podID="a7902abd-a9f3-486c-b7e0-6e7135dd4a37" containerID="70e14a475277bfcb87e989882969612e7093f908e7d2d97b9397d71812329619" exitCode=0
Jul 06 14:20:52.888247 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:52.888227    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4pfm" event={"ID":"a7902abd-a9f3-486c-b7e0-6e7135dd4a37","Type":"ContainerDied","Data":"70e14a475277bfcb87e989882969612e7093f908e7d2d97b9397d71812329619"}
Jul 06 14:20:53.326229 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:53.326189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs\") pod \"network-metrics-daemon-7m68m\" (UID: \"0741a5cc-f80e-49c5-9c57-df5f5ea7710d\") " pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:53.326411 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:53.326345    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:20:53.326469 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:53.326412    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs podName:0741a5cc-f80e-49c5-9c57-df5f5ea7710d nodeName:}" failed. No retries permitted until 2026-07-06 14:21:25.326397064 +0000 UTC m=+66.175284013 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs") pod "network-metrics-daemon-7m68m" (UID: "0741a5cc-f80e-49c5-9c57-df5f5ea7710d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:20:53.427086 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:53.427047    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret\") pod \"global-pull-secret-syncer-49jdc\" (UID: \"1b898534-bd6c-43bf-a49c-0ee858e6fb3f\") " pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:53.427253 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:53.427122    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztkqt\" (UniqueName: \"kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt\") pod \"network-check-target-vvs2w\" (UID: \"f5f065bf-98db-456d-a71d-2b6ddf324436\") " pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:53.427253 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:53.427210    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:20:53.427253 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:53.427240    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:20:53.427253 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:53.427255    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:20:53.427418 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:53.427265    2562 projected.go:196] Error preparing data for projected volume kube-api-access-ztkqt for pod openshift-network-diagnostics/network-check-target-vvs2w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:20:53.427418 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:53.427275    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret podName:1b898534-bd6c-43bf-a49c-0ee858e6fb3f nodeName:}" failed. No retries permitted until 2026-07-06 14:21:25.427258473 +0000 UTC m=+66.276145424 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret") pod "global-pull-secret-syncer-49jdc" (UID: "1b898534-bd6c-43bf-a49c-0ee858e6fb3f") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:20:53.427418 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:53.427303    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt podName:f5f065bf-98db-456d-a71d-2b6ddf324436 nodeName:}" failed. No retries permitted until 2026-07-06 14:21:25.427291487 +0000 UTC m=+66.276178452 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ztkqt" (UniqueName: "kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt") pod "network-check-target-vvs2w" (UID: "f5f065bf-98db-456d-a71d-2b6ddf324436") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:20:53.744549 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:53.744514    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:53.745027 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:53.744563    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:53.745027 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:53.744622    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:53.745027 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:53.744632    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:53.745027 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:53.744702    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:53.745027 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:53.744764    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:55.743949 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:55.743922    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:55.744417 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:55.744010    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:55.744417 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:55.744019    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:55.744417 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:55.744106    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:55.744417 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:55.744164    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:55.744417 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:55.744213    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:57.740983 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:57.740947    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:57.741465 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:57.740947    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:57.741465 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:57.741078    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:57.741465 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:57.741165    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:57.741465 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:57.740947    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:57.741465 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:57.741248    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:59.743956 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:59.743928    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:20:59.744436 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:59.743929    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:20:59.744436 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:59.744019    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:20:59.744436 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:59.743929    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:20:59.744436 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:59.744098    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:20:59.744436 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:20:59.744181    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:20:59.909430 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:59.909394    2562 generic.go:356] "Generic (PLEG): container finished" podID="a7902abd-a9f3-486c-b7e0-6e7135dd4a37" containerID="562aa18f0b429419cd3c90ac35607e689970aed7e9686c33220d9f18f4c3bce6" exitCode=0
Jul 06 14:20:59.909578 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:20:59.909456    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4pfm" event={"ID":"a7902abd-a9f3-486c-b7e0-6e7135dd4a37","Type":"ContainerDied","Data":"562aa18f0b429419cd3c90ac35607e689970aed7e9686c33220d9f18f4c3bce6"}
Jul 06 14:21:00.915417 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:00.915380    2562 generic.go:356] "Generic (PLEG): container finished" podID="a7902abd-a9f3-486c-b7e0-6e7135dd4a37" containerID="7136cb41b79e2210204331d2d8722da8dbcad5f94e8bc6f6d589ae986ee64f1b" exitCode=0
Jul 06 14:21:00.915805 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:00.915429    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4pfm" event={"ID":"a7902abd-a9f3-486c-b7e0-6e7135dd4a37","Type":"ContainerDied","Data":"7136cb41b79e2210204331d2d8722da8dbcad5f94e8bc6f6d589ae986ee64f1b"}
Jul 06 14:21:01.743049 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:01.743016    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:21:01.743224 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:01.743168    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:21:01.743224 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:01.743176    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:21:01.743224 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:01.743188    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:21:01.743333 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:01.743247    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:21:01.743333 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:01.743320    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:21:01.920628 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:01.920597    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l4pfm" event={"ID":"a7902abd-a9f3-486c-b7e0-6e7135dd4a37","Type":"ContainerStarted","Data":"60f961bf53a49ec106d370d9c93dfb38292ac19a8f8f27001c6d02c2800e20f7"}
Jul 06 14:21:03.745469 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:03.745434    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:21:03.745933 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:03.745434    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:21:03.745933 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:03.745554    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:21:03.745933 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:03.745434    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:21:03.745933 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:03.745613    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:21:03.745933 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:03.745675    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:21:05.740501 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:05.740463    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:21:05.740956 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:05.740465    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:21:05.740956 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:05.740581    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:21:05.740956 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:05.740685    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:21:05.740956 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:05.740476    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:21:05.740956 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:05.740773    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:21:07.743718 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:07.743530    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:21:07.744119 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:07.743587    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:21:07.744119 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:07.743795    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:21:07.744119 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:07.743587    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:21:07.744119 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:07.743864    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:21:07.744119 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:07.743939    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:21:09.741001 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:09.740964    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:21:09.741489 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:09.741055    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:21:09.741489 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:09.741090    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:21:09.741489 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:09.741095    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:21:09.741489 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:09.741227    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:21:09.741489 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:09.741265    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:21:11.740357 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:11.740324    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:21:11.740357 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:11.740339    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:21:11.740872 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:11.740324    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:21:11.740872 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:11.740415    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvs2w" podUID="f5f065bf-98db-456d-a71d-2b6ddf324436"
Jul 06 14:21:11.740872 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:11.740502    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-49jdc" podUID="1b898534-bd6c-43bf-a49c-0ee858e6fb3f"
Jul 06 14:21:11.740872 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:11.740564    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7m68m" podUID="0741a5cc-f80e-49c5-9c57-df5f5ea7710d"
Jul 06 14:21:12.956501 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:12.956407    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-124.ec2.internal" event="NodeReady"
Jul 06 14:21:12.956958 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:12.956573    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 14:21:13.060077 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.060006    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l4pfm" podStartSLOduration=24.352821101 podStartE2EDuration="54.059987304s" totalImagesPullingTime="29.707166203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:20:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:01.951227877 +0000 UTC m=+42.800114847" watchObservedRunningTime="2026-07-06 14:21:13.059987304 +0000 UTC m=+53.908874278"
Jul 06 14:21:13.060746 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.060728    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xxkrl"]
Jul 06 14:21:13.078756 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.078730    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xxkrl"
Jul 06 14:21:13.087212 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.087190    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 14:21:13.087468 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.087451    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 14:21:13.087533 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.087519    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nzwtp\""
Jul 06 14:21:13.087533 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.087528    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 14:21:13.087979 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.087967    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 14:21:13.099054 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.099031    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lbdzt"]
Jul 06 14:21:13.112792 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.112768    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lbdzt"
Jul 06 14:21:13.122375 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.122351    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 14:21:13.122518 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.122351    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 14:21:13.129431 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.129394    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xxkrl"]
Jul 06 14:21:13.129946 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.129928    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lbdzt"]
Jul 06 14:21:13.130817 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.130785    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 14:21:13.130817 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.130803    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9fk4j\""
Jul 06 14:21:13.179202 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.179171    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vwsz8"]
Jul 06 14:21:13.197463 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.197435    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vwsz8"
Jul 06 14:21:13.209441 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.209387    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 14:21:13.209547 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.209515    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 14:21:13.209663 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.209649    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tng92\""
Jul 06 14:21:13.232229 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.232202    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vwsz8"]
Jul 06 14:21:13.263512 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.263475    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48c0af62-aaab-4a86-915f-88102351eeae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxkrl\" (UID: \"48c0af62-aaab-4a86-915f-88102351eeae\") " pod="openshift-insights/insights-runtime-extractor-xxkrl"
Jul 06 14:21:13.263512 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.263511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s6p6\" (UniqueName: \"kubernetes.io/projected/cde36458-5c24-447e-afa9-a72f3dcff0d7-kube-api-access-4s6p6\") pod \"ingress-canary-lbdzt\" (UID: \"cde36458-5c24-447e-afa9-a72f3dcff0d7\") " pod="openshift-ingress-canary/ingress-canary-lbdzt"
Jul 06 14:21:13.263704 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.263538    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48c0af62-aaab-4a86-915f-88102351eeae-data-volume\") pod \"insights-runtime-extractor-xxkrl\" (UID: \"48c0af62-aaab-4a86-915f-88102351eeae\") " pod="openshift-insights/insights-runtime-extractor-xxkrl"
Jul 06 14:21:13.263704 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.263564    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48c0af62-aaab-4a86-915f-88102351eeae-crio-socket\") pod \"insights-runtime-extractor-xxkrl\" (UID: \"48c0af62-aaab-4a86-915f-88102351eeae\") " pod="openshift-insights/insights-runtime-extractor-xxkrl"
Jul 06 14:21:13.263704 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.263644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7kch\" (UniqueName: \"kubernetes.io/projected/48c0af62-aaab-4a86-915f-88102351eeae-kube-api-access-d7kch\") pod \"insights-runtime-extractor-xxkrl\" (UID: \"48c0af62-aaab-4a86-915f-88102351eeae\") " pod="openshift-insights/insights-runtime-extractor-xxkrl"
Jul 06 14:21:13.263704 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.263668    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cde36458-5c24-447e-afa9-a72f3dcff0d7-cert\") pod \"ingress-canary-lbdzt\" (UID: \"cde36458-5c24-447e-afa9-a72f3dcff0d7\") " pod="openshift-ingress-canary/ingress-canary-lbdzt"
Jul 06 14:21:13.263704 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.263693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48c0af62-aaab-4a86-915f-88102351eeae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxkrl\" (UID: \"48c0af62-aaab-4a86-915f-88102351eeae\") " pod="openshift-insights/insights-runtime-extractor-xxkrl"
Jul 06 14:21:13.364850 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.364804    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a42caec-c09b-4a4e-9d03-5ad9f0398f88-metrics-tls\") pod \"dns-default-vwsz8\" (UID: \"7a42caec-c09b-4a4e-9d03-5ad9f0398f88\") " pod="openshift-dns/dns-default-vwsz8"
Jul 06 14:21:13.364850 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.364855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48c0af62-aaab-4a86-915f-88102351eeae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxkrl\" (UID: \"48c0af62-aaab-4a86-915f-88102351eeae\") " pod="openshift-insights/insights-runtime-extractor-xxkrl"
Jul 06 14:21:13.365030 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.364875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s6p6\" (UniqueName: \"kubernetes.io/projected/cde36458-5c24-447e-afa9-a72f3dcff0d7-kube-api-access-4s6p6\") pod \"ingress-canary-lbdzt\" (UID: \"cde36458-5c24-447e-afa9-a72f3dcff0d7\") " pod="openshift-ingress-canary/ingress-canary-lbdzt"
Jul 06 14:21:13.365030 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.364892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a42caec-c09b-4a4e-9d03-5ad9f0398f88-config-volume\") pod \"dns-default-vwsz8\" (UID: \"7a42caec-c09b-4a4e-9d03-5ad9f0398f88\") " pod="openshift-dns/dns-default-vwsz8"
Jul 06 14:21:13.365030 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.364913    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48c0af62-aaab-4a86-915f-88102351eeae-data-volume\") pod \"insights-runtime-extractor-xxkrl\" (UID: \"48c0af62-aaab-4a86-915f-88102351eeae\") " pod="openshift-insights/insights-runtime-extractor-xxkrl"
Jul 06 14:21:13.365030 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.364928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98zq7\" (UniqueName: \"kubernetes.io/projected/7a42caec-c09b-4a4e-9d03-5ad9f0398f88-kube-api-access-98zq7\") pod \"dns-default-vwsz8\" (UID: \"7a42caec-c09b-4a4e-9d03-5ad9f0398f88\") " pod="openshift-dns/dns-default-vwsz8"
Jul 06 14:21:13.365030 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.364951    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a42caec-c09b-4a4e-9d03-5ad9f0398f88-tmp-dir\") pod \"dns-default-vwsz8\" (UID: \"7a42caec-c09b-4a4e-9d03-5ad9f0398f88\") " pod="openshift-dns/dns-default-vwsz8"
Jul 06 14:21:13.365030 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.365022    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48c0af62-aaab-4a86-915f-88102351eeae-crio-socket\") pod \"insights-runtime-extractor-xxkrl\" (UID: \"48c0af62-aaab-4a86-915f-88102351eeae\") " pod="openshift-insights/insights-runtime-extractor-xxkrl"
Jul 06 14:21:13.365293 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.365077    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7kch\" (UniqueName: \"kubernetes.io/projected/48c0af62-aaab-4a86-915f-88102351eeae-kube-api-access-d7kch\") pod \"insights-runtime-extractor-xxkrl\" (UID: \"48c0af62-aaab-4a86-915f-88102351eeae\") " pod="openshift-insights/insights-runtime-extractor-xxkrl"
Jul 06 14:21:13.365293 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.365093    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cde36458-5c24-447e-afa9-a72f3dcff0d7-cert\") pod \"ingress-canary-lbdzt\" (UID: \"cde36458-5c24-447e-afa9-a72f3dcff0d7\") " pod="openshift-ingress-canary/ingress-canary-lbdzt"
Jul 06 14:21:13.365293 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.365190    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48c0af62-aaab-4a86-915f-88102351eeae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxkrl\" (UID: \"48c0af62-aaab-4a86-915f-88102351eeae\") " pod="openshift-insights/insights-runtime-extractor-xxkrl"
Jul 06 14:21:13.365436 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.365299    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48c0af62-aaab-4a86-915f-88102351eeae-data-volume\") pod \"insights-runtime-extractor-xxkrl\" (UID: \"48c0af62-aaab-4a86-915f-88102351eeae\") " pod="openshift-insights/insights-runtime-extractor-xxkrl"
Jul 06 14:21:13.365436 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.365300    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48c0af62-aaab-4a86-915f-88102351eeae-crio-socket\") pod \"insights-runtime-extractor-xxkrl\" (UID: \"48c0af62-aaab-4a86-915f-88102351eeae\") " pod="openshift-insights/insights-runtime-extractor-xxkrl"
Jul 06 14:21:13.365545 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.365528    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48c0af62-aaab-4a86-915f-88102351eeae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxkrl\" (UID: \"48c0af62-aaab-4a86-915f-88102351eeae\") " pod="openshift-insights/insights-runtime-extractor-xxkrl"
Jul 06 14:21:13.369224 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.369206    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48c0af62-aaab-4a86-915f-88102351eeae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxkrl\" (UID: \"48c0af62-aaab-4a86-915f-88102351eeae\") " pod="openshift-insights/insights-runtime-extractor-xxkrl"
Jul 06 14:21:13.369315 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.369290    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cde36458-5c24-447e-afa9-a72f3dcff0d7-cert\") pod \"ingress-canary-lbdzt\" (UID: \"cde36458-5c24-447e-afa9-a72f3dcff0d7\") " pod="openshift-ingress-canary/ingress-canary-lbdzt"
Jul 06 14:21:13.378028 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.378002    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s6p6\" (UniqueName: \"kubernetes.io/projected/cde36458-5c24-447e-afa9-a72f3dcff0d7-kube-api-access-4s6p6\") pod \"ingress-canary-lbdzt\" (UID: \"cde36458-5c24-447e-afa9-a72f3dcff0d7\") " pod="openshift-ingress-canary/ingress-canary-lbdzt"
Jul 06 14:21:13.378473 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.378451    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7kch\" (UniqueName: \"kubernetes.io/projected/48c0af62-aaab-4a86-915f-88102351eeae-kube-api-access-d7kch\") pod \"insights-runtime-extractor-xxkrl\" (UID: \"48c0af62-aaab-4a86-915f-88102351eeae\") " pod="openshift-insights/insights-runtime-extractor-xxkrl"
Jul 06 14:21:13.387504 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.387480    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xxkrl"
Jul 06 14:21:13.420720 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.420697    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lbdzt"
Jul 06 14:21:13.465744 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.465656    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a42caec-c09b-4a4e-9d03-5ad9f0398f88-metrics-tls\") pod \"dns-default-vwsz8\" (UID: \"7a42caec-c09b-4a4e-9d03-5ad9f0398f88\") " pod="openshift-dns/dns-default-vwsz8"
Jul 06 14:21:13.465744 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.465702    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a42caec-c09b-4a4e-9d03-5ad9f0398f88-config-volume\") pod \"dns-default-vwsz8\" (UID: \"7a42caec-c09b-4a4e-9d03-5ad9f0398f88\") " pod="openshift-dns/dns-default-vwsz8"
Jul 06 14:21:13.465744 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.465722    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98zq7\" (UniqueName: \"kubernetes.io/projected/7a42caec-c09b-4a4e-9d03-5ad9f0398f88-kube-api-access-98zq7\") pod \"dns-default-vwsz8\" (UID: \"7a42caec-c09b-4a4e-9d03-5ad9f0398f88\") " pod="openshift-dns/dns-default-vwsz8"
Jul 06 14:21:13.465744 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.465744    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a42caec-c09b-4a4e-9d03-5ad9f0398f88-tmp-dir\") pod \"dns-default-vwsz8\" (UID: \"7a42caec-c09b-4a4e-9d03-5ad9f0398f88\") " pod="openshift-dns/dns-default-vwsz8"
Jul 06 14:21:13.466116 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.466097    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a42caec-c09b-4a4e-9d03-5ad9f0398f88-tmp-dir\") pod \"dns-default-vwsz8\" (UID: \"7a42caec-c09b-4a4e-9d03-5ad9f0398f88\") " pod="openshift-dns/dns-default-vwsz8"
Jul 06 14:21:13.466293 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.466267    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a42caec-c09b-4a4e-9d03-5ad9f0398f88-config-volume\") pod \"dns-default-vwsz8\" (UID: \"7a42caec-c09b-4a4e-9d03-5ad9f0398f88\") " pod="openshift-dns/dns-default-vwsz8"
Jul 06 14:21:13.468128 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.468084    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a42caec-c09b-4a4e-9d03-5ad9f0398f88-metrics-tls\") pod \"dns-default-vwsz8\" (UID: \"7a42caec-c09b-4a4e-9d03-5ad9f0398f88\") " pod="openshift-dns/dns-default-vwsz8"
Jul 06 14:21:13.474464 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.474436    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98zq7\" (UniqueName: \"kubernetes.io/projected/7a42caec-c09b-4a4e-9d03-5ad9f0398f88-kube-api-access-98zq7\") pod \"dns-default-vwsz8\" (UID: \"7a42caec-c09b-4a4e-9d03-5ad9f0398f88\") " pod="openshift-dns/dns-default-vwsz8"
Jul 06 14:21:13.506951 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.505519    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vwsz8"
Jul 06 14:21:13.621895 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.621860    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lbdzt"]
Jul 06 14:21:13.626405 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.626234    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xxkrl"]
Jul 06 14:21:13.628558 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:21:13.628518    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde36458_5c24_447e_afa9_a72f3dcff0d7.slice/crio-35d2e312e065efc02f3c98cc2bb80d2b77eb5224da5fec6b96811e011678f48e WatchSource:0}: Error finding container 35d2e312e065efc02f3c98cc2bb80d2b77eb5224da5fec6b96811e011678f48e: Status 404 returned error can't find the container with id 35d2e312e065efc02f3c98cc2bb80d2b77eb5224da5fec6b96811e011678f48e
Jul 06 14:21:13.631818 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:21:13.631793    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48c0af62_aaab_4a86_915f_88102351eeae.slice/crio-3059573582a9b6a372aade291a163008e6676ba04bb2c89659693c3f54e34250 WatchSource:0}: Error finding container 3059573582a9b6a372aade291a163008e6676ba04bb2c89659693c3f54e34250: Status 404 returned error can't find the container with id 3059573582a9b6a372aade291a163008e6676ba04bb2c89659693c3f54e34250
Jul 06 14:21:13.694747 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.694710    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vwsz8"]
Jul 06 14:21:13.698918 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:21:13.698891    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a42caec_c09b_4a4e_9d03_5ad9f0398f88.slice/crio-5d35aba9068298fdd5d69f406d13f9d4bdb57f7708a168ce9c548cf008c1de90 WatchSource:0}: Error finding container 5d35aba9068298fdd5d69f406d13f9d4bdb57f7708a168ce9c548cf008c1de90: Status 404 returned error can't find the container with id 5d35aba9068298fdd5d69f406d13f9d4bdb57f7708a168ce9c548cf008c1de90
Jul 06 14:21:13.740914 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.740888    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:21:13.741101 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.740888    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:21:13.741101 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.740902    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:21:13.745227 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.745200    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 14:21:13.745710 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.745685    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 14:21:13.745978 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.745965    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 14:21:13.746043 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.745972    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-74wbt\""
Jul 06 14:21:13.746043 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.745996    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nfstm\""
Jul 06 14:21:13.746384 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.746370    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 14:21:13.949767 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.949724    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vwsz8" event={"ID":"7a42caec-c09b-4a4e-9d03-5ad9f0398f88","Type":"ContainerStarted","Data":"5d35aba9068298fdd5d69f406d13f9d4bdb57f7708a168ce9c548cf008c1de90"}
Jul 06 14:21:13.950897 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.950872    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lbdzt" event={"ID":"cde36458-5c24-447e-afa9-a72f3dcff0d7","Type":"ContainerStarted","Data":"35d2e312e065efc02f3c98cc2bb80d2b77eb5224da5fec6b96811e011678f48e"}
Jul 06 14:21:13.951991 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:13.951967    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxkrl" event={"ID":"48c0af62-aaab-4a86-915f-88102351eeae","Type":"ContainerStarted","Data":"3059573582a9b6a372aade291a163008e6676ba04bb2c89659693c3f54e34250"}
Jul 06 14:21:14.527203 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.526968    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78d4dbff79-24gg6"]
Jul 06 14:21:14.529962 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.528979    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.532581 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.532366    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q962d\""
Jul 06 14:21:14.532581 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.532409    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 14:21:14.535742 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.533699    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 14:21:14.535856 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.535739    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 14:21:14.536062 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.536047    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 14:21:14.536828 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.536287    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 14:21:14.536828 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.536470    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 14:21:14.536828 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.536675    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 14:21:14.543283 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.543176    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78d4dbff79-24gg6"]
Jul 06 14:21:14.677500 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.677464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4eb27c1-8747-4396-9cb7-84f5aedb5509-console-config\") pod \"console-78d4dbff79-24gg6\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") " pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.677664 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.677517    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4eb27c1-8747-4396-9cb7-84f5aedb5509-service-ca\") pod \"console-78d4dbff79-24gg6\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") " pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.677664 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.677553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4eb27c1-8747-4396-9cb7-84f5aedb5509-console-oauth-config\") pod \"console-78d4dbff79-24gg6\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") " pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.677664 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.677579    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4eb27c1-8747-4396-9cb7-84f5aedb5509-oauth-serving-cert\") pod \"console-78d4dbff79-24gg6\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") " pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.677664 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.677607    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj2td\" (UniqueName: \"kubernetes.io/projected/a4eb27c1-8747-4396-9cb7-84f5aedb5509-kube-api-access-qj2td\") pod \"console-78d4dbff79-24gg6\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") " pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.677664 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.677638    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4eb27c1-8747-4396-9cb7-84f5aedb5509-console-serving-cert\") pod \"console-78d4dbff79-24gg6\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") " pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.778892 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.778789    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4eb27c1-8747-4396-9cb7-84f5aedb5509-console-config\") pod \"console-78d4dbff79-24gg6\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") " pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.778892 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.778846    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4eb27c1-8747-4396-9cb7-84f5aedb5509-service-ca\") pod \"console-78d4dbff79-24gg6\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") " pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.778892 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.778877    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4eb27c1-8747-4396-9cb7-84f5aedb5509-console-oauth-config\") pod \"console-78d4dbff79-24gg6\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") " pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.779176 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.778902    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4eb27c1-8747-4396-9cb7-84f5aedb5509-oauth-serving-cert\") pod \"console-78d4dbff79-24gg6\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") " pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.779176 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.778932    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj2td\" (UniqueName: \"kubernetes.io/projected/a4eb27c1-8747-4396-9cb7-84f5aedb5509-kube-api-access-qj2td\") pod \"console-78d4dbff79-24gg6\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") " pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.779176 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.778960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4eb27c1-8747-4396-9cb7-84f5aedb5509-console-serving-cert\") pod \"console-78d4dbff79-24gg6\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") " pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.780434 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.780402    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4eb27c1-8747-4396-9cb7-84f5aedb5509-oauth-serving-cert\") pod \"console-78d4dbff79-24gg6\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") " pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.780541 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.780525    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4eb27c1-8747-4396-9cb7-84f5aedb5509-console-config\") pod \"console-78d4dbff79-24gg6\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") " pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.780579 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.780552    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4eb27c1-8747-4396-9cb7-84f5aedb5509-service-ca\") pod \"console-78d4dbff79-24gg6\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") " pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.781997 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.781978    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4eb27c1-8747-4396-9cb7-84f5aedb5509-console-oauth-config\") pod \"console-78d4dbff79-24gg6\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") " pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.786828 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.786802    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4eb27c1-8747-4396-9cb7-84f5aedb5509-console-serving-cert\") pod \"console-78d4dbff79-24gg6\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") " pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.790686 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.790659    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj2td\" (UniqueName: \"kubernetes.io/projected/a4eb27c1-8747-4396-9cb7-84f5aedb5509-kube-api-access-qj2td\") pod \"console-78d4dbff79-24gg6\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") " pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:14.847756 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:14.847722    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:15.011690 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:15.011658    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78d4dbff79-24gg6"]
Jul 06 14:21:15.016378 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:21:15.016343    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4eb27c1_8747_4396_9cb7_84f5aedb5509.slice/crio-1e6efa3c347eed2f9b59ea5738167a595938ab2bf29535c8fd359da5a6f2cbda WatchSource:0}: Error finding container 1e6efa3c347eed2f9b59ea5738167a595938ab2bf29535c8fd359da5a6f2cbda: Status 404 returned error can't find the container with id 1e6efa3c347eed2f9b59ea5738167a595938ab2bf29535c8fd359da5a6f2cbda
Jul 06 14:21:15.959896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:15.959859    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d4dbff79-24gg6" event={"ID":"a4eb27c1-8747-4396-9cb7-84f5aedb5509","Type":"ContainerStarted","Data":"1e6efa3c347eed2f9b59ea5738167a595938ab2bf29535c8fd359da5a6f2cbda"}
Jul 06 14:21:20.890921 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:20.890846    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gwkjw"
Jul 06 14:21:20.973952 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:20.973913    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lbdzt" event={"ID":"cde36458-5c24-447e-afa9-a72f3dcff0d7","Type":"ContainerStarted","Data":"77c71c409ca4bc964072461ed0d790051b5d20711bd523d9362f009f25df3533"}
Jul 06 14:21:20.975537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:20.975509    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d4dbff79-24gg6" event={"ID":"a4eb27c1-8747-4396-9cb7-84f5aedb5509","Type":"ContainerStarted","Data":"7ecd5ca33744bc4434683a18232f3e59d996a91fd1cce52daaeef35a67c1afa9"}
Jul 06 14:21:20.977178 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:20.977130    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vwsz8" event={"ID":"7a42caec-c09b-4a4e-9d03-5ad9f0398f88","Type":"ContainerStarted","Data":"2252b962e897c99561cd3c3b5deba0152811ce38ff5a3495bb412e893d6099c2"}
Jul 06 14:21:20.977322 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:20.977201    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vwsz8" event={"ID":"7a42caec-c09b-4a4e-9d03-5ad9f0398f88","Type":"ContainerStarted","Data":"ade412c7f59a2846cc149f09db534fddc909481c1bc8bf614ee792a236d00f43"}
Jul 06 14:21:20.977322 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:20.977252    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vwsz8"
Jul 06 14:21:20.978462 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:20.978444    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxkrl" event={"ID":"48c0af62-aaab-4a86-915f-88102351eeae","Type":"ContainerStarted","Data":"4f6c6ebe5580ce8373a31afe643809b705adc2bf0c691adf643df31753c15711"}
Jul 06 14:21:20.993053 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:20.993005    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lbdzt" podStartSLOduration=1.105352863 podStartE2EDuration="7.992989254s" totalImagesPullingTime="6.887636391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:20.992352332 +0000 UTC m=+61.841239303" watchObservedRunningTime="2026-07-06 14:21:20.992989254 +0000 UTC m=+61.841876217"
Jul 06 14:21:21.017718 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.017667    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vwsz8" podStartSLOduration=1.200768668 podStartE2EDuration="8.017649863s" totalImagesPullingTime="6.816881195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:21.017554996 +0000 UTC m=+61.866441966" watchObservedRunningTime="2026-07-06 14:21:21.017649863 +0000 UTC m=+61.866536812"
Jul 06 14:21:21.043042 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.042995    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78d4dbff79-24gg6" podStartSLOduration=1.51252454 podStartE2EDuration="7.0429787s" totalImagesPullingTime="5.53045416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:21.042701609 +0000 UTC m=+61.891588580" watchObservedRunningTime="2026-07-06 14:21:21.0429787 +0000 UTC m=+61.891865670"
Jul 06 14:21:21.370939 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.370905    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt"]
Jul 06 14:21:21.372999 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.372983    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt"
Jul 06 14:21:21.376122 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.376098    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 14:21:21.376401 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.376358    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 14:21:21.376401 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.376371    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 14:21:21.376583 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.376418    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 14:21:21.376583 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.376442    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 14:21:21.376583 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.376460    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jhjwd\""
Jul 06 14:21:21.406301 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.406272    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt"]
Jul 06 14:21:21.434387 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.434354    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0439270e-db0d-4509-8948-317cb1ee9eb2-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-rf2lt\" (UID: \"0439270e-db0d-4509-8948-317cb1ee9eb2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt"
Jul 06 14:21:21.434553 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.434401    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0439270e-db0d-4509-8948-317cb1ee9eb2-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-rf2lt\" (UID: \"0439270e-db0d-4509-8948-317cb1ee9eb2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt"
Jul 06 14:21:21.434553 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.434448    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8p7v\" (UniqueName: \"kubernetes.io/projected/0439270e-db0d-4509-8948-317cb1ee9eb2-kube-api-access-t8p7v\") pod \"prometheus-operator-567f7b8b7c-rf2lt\" (UID: \"0439270e-db0d-4509-8948-317cb1ee9eb2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt"
Jul 06 14:21:21.434553 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.434499    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0439270e-db0d-4509-8948-317cb1ee9eb2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-rf2lt\" (UID: \"0439270e-db0d-4509-8948-317cb1ee9eb2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt"
Jul 06 14:21:21.535249 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.535136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0439270e-db0d-4509-8948-317cb1ee9eb2-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-rf2lt\" (UID: \"0439270e-db0d-4509-8948-317cb1ee9eb2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt"
Jul 06 14:21:21.535249 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.535218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0439270e-db0d-4509-8948-317cb1ee9eb2-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-rf2lt\" (UID: \"0439270e-db0d-4509-8948-317cb1ee9eb2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt"
Jul 06 14:21:21.535249 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.535239    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8p7v\" (UniqueName: \"kubernetes.io/projected/0439270e-db0d-4509-8948-317cb1ee9eb2-kube-api-access-t8p7v\") pod \"prometheus-operator-567f7b8b7c-rf2lt\" (UID: \"0439270e-db0d-4509-8948-317cb1ee9eb2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt"
Jul 06 14:21:21.535460 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.535282    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0439270e-db0d-4509-8948-317cb1ee9eb2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-rf2lt\" (UID: \"0439270e-db0d-4509-8948-317cb1ee9eb2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt"
Jul 06 14:21:21.535460 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:21.535367    2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 06 14:21:21.535460 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:21.535454    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0439270e-db0d-4509-8948-317cb1ee9eb2-prometheus-operator-tls podName:0439270e-db0d-4509-8948-317cb1ee9eb2 nodeName:}" failed. No retries permitted until 2026-07-06 14:21:22.035433168 +0000 UTC m=+62.884320136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/0439270e-db0d-4509-8948-317cb1ee9eb2-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-rf2lt" (UID: "0439270e-db0d-4509-8948-317cb1ee9eb2") : secret "prometheus-operator-tls" not found
Jul 06 14:21:21.535902 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.535881    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0439270e-db0d-4509-8948-317cb1ee9eb2-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-rf2lt\" (UID: \"0439270e-db0d-4509-8948-317cb1ee9eb2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt"
Jul 06 14:21:21.537721 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.537700    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0439270e-db0d-4509-8948-317cb1ee9eb2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-rf2lt\" (UID: \"0439270e-db0d-4509-8948-317cb1ee9eb2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt"
Jul 06 14:21:21.545748 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.545721    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8p7v\" (UniqueName: \"kubernetes.io/projected/0439270e-db0d-4509-8948-317cb1ee9eb2-kube-api-access-t8p7v\") pod \"prometheus-operator-567f7b8b7c-rf2lt\" (UID: \"0439270e-db0d-4509-8948-317cb1ee9eb2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt"
Jul 06 14:21:21.984356 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:21.984268    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxkrl" event={"ID":"48c0af62-aaab-4a86-915f-88102351eeae","Type":"ContainerStarted","Data":"30701bea49ccf4203d45c0e1b5dab5d45ca4025ee07d6b99ddf9c44edbbe09ec"}
Jul 06 14:21:22.039992 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.039959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0439270e-db0d-4509-8948-317cb1ee9eb2-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-rf2lt\" (UID: \"0439270e-db0d-4509-8948-317cb1ee9eb2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt"
Jul 06 14:21:22.042861 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.042835    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0439270e-db0d-4509-8948-317cb1ee9eb2-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-rf2lt\" (UID: \"0439270e-db0d-4509-8948-317cb1ee9eb2\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt"
Jul 06 14:21:22.282350 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.282266    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt"
Jul 06 14:21:22.347499 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.347465    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8786bdfdc-wk7v4"]
Jul 06 14:21:22.350243 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.350214    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.363195 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.363086    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 14:21:22.372497 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.372204    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8786bdfdc-wk7v4"]
Jul 06 14:21:22.434790 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.434657    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt"]
Jul 06 14:21:22.443410 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.443382    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq6pv\" (UniqueName: \"kubernetes.io/projected/d275f915-be0b-429a-81c1-63b2bb09053b-kube-api-access-nq6pv\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.443503 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.443441    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-trusted-ca-bundle\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.443503 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.443483    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-oauth-serving-cert\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.443611 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.443527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d275f915-be0b-429a-81c1-63b2bb09053b-console-serving-cert\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.443611 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.443547    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-service-ca\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.443708 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.443608    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-console-config\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.443708 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.443630    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d275f915-be0b-429a-81c1-63b2bb09053b-console-oauth-config\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.544477 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.544387    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq6pv\" (UniqueName: \"kubernetes.io/projected/d275f915-be0b-429a-81c1-63b2bb09053b-kube-api-access-nq6pv\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.544477 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.544452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-trusted-ca-bundle\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.544477 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.544474    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-oauth-serving-cert\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.544921 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.544508    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d275f915-be0b-429a-81c1-63b2bb09053b-console-serving-cert\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.544921 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.544531    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-service-ca\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.544921 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.544585    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-console-config\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.544921 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.544614    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d275f915-be0b-429a-81c1-63b2bb09053b-console-oauth-config\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.545354 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.545324    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-oauth-serving-cert\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.545586 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.545562    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-service-ca\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.545672 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.545644    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-trusted-ca-bundle\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.545822 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.545797    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-console-config\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.547339 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.547313    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d275f915-be0b-429a-81c1-63b2bb09053b-console-oauth-config\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.547650 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.547598    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d275f915-be0b-429a-81c1-63b2bb09053b-console-serving-cert\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.554055 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.554031    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq6pv\" (UniqueName: \"kubernetes.io/projected/d275f915-be0b-429a-81c1-63b2bb09053b-kube-api-access-nq6pv\") pod \"console-8786bdfdc-wk7v4\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") " pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.661780 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.661520    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:22.825731 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.825650    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8786bdfdc-wk7v4"]
Jul 06 14:21:22.829267 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:21:22.829236    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd275f915_be0b_429a_81c1_63b2bb09053b.slice/crio-542c86f2b86fd254455e892715c80fcaf7d309fe147777659f5b7933eff4c3b8 WatchSource:0}: Error finding container 542c86f2b86fd254455e892715c80fcaf7d309fe147777659f5b7933eff4c3b8: Status 404 returned error can't find the container with id 542c86f2b86fd254455e892715c80fcaf7d309fe147777659f5b7933eff4c3b8
Jul 06 14:21:22.989653 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.989617    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt" event={"ID":"0439270e-db0d-4509-8948-317cb1ee9eb2","Type":"ContainerStarted","Data":"446f332468380ee65a32c1502e13437b5c8b5b2cd47f653bb341beb4553951c1"}
Jul 06 14:21:22.991638 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.991600    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8786bdfdc-wk7v4" event={"ID":"d275f915-be0b-429a-81c1-63b2bb09053b","Type":"ContainerStarted","Data":"12b759cca5bf7e4728fe335ee9b1cc2f8040d38b89e5756d70582787801fbb86"}
Jul 06 14:21:22.991781 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:22.991662    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8786bdfdc-wk7v4" event={"ID":"d275f915-be0b-429a-81c1-63b2bb09053b","Type":"ContainerStarted","Data":"542c86f2b86fd254455e892715c80fcaf7d309fe147777659f5b7933eff4c3b8"}
Jul 06 14:21:23.034199 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:23.034119    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8786bdfdc-wk7v4" podStartSLOduration=1.034095889 podStartE2EDuration="1.034095889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:23.033689196 +0000 UTC m=+63.882576168" watchObservedRunningTime="2026-07-06 14:21:23.034095889 +0000 UTC m=+63.882982862"
Jul 06 14:21:24.848162 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:24.848103    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:24.848563 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:24.848200    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:24.849548 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:24.849506    2562 patch_prober.go:28] interesting pod/console-78d4dbff79-24gg6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body=
Jul 06 14:21:24.849657 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:24.849572    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-78d4dbff79-24gg6" podUID="a4eb27c1-8747-4396-9cb7-84f5aedb5509" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused"
Jul 06 14:21:25.001225 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.001181    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt" event={"ID":"0439270e-db0d-4509-8948-317cb1ee9eb2","Type":"ContainerStarted","Data":"c81d6602efba0146addbf917d7b38875a3e91891dd17718984f1811b1f49e875"}
Jul 06 14:21:25.001378 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.001254    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt" event={"ID":"0439270e-db0d-4509-8948-317cb1ee9eb2","Type":"ContainerStarted","Data":"9df35c7d98e00b59b3500b47363f63db85a8b2ea2f302983cd4bfa5abd3f05ee"}
Jul 06 14:21:25.003083 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.003060    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxkrl" event={"ID":"48c0af62-aaab-4a86-915f-88102351eeae","Type":"ContainerStarted","Data":"5992b4abdd12bdcfe122bc0c55b8069c12666ea782ce96b7be250edf5b397526"}
Jul 06 14:21:25.071916 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.071864    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-rf2lt" podStartSLOduration=2.190335948 podStartE2EDuration="4.071848377s" totalImagesPullingTime="1.881512429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:25.033417283 +0000 UTC m=+65.882304254" watchObservedRunningTime="2026-07-06 14:21:25.071848377 +0000 UTC m=+65.920735347"
Jul 06 14:21:25.369898 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.369863    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs\") pod \"network-metrics-daemon-7m68m\" (UID: \"0741a5cc-f80e-49c5-9c57-df5f5ea7710d\") " pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:21:25.372631 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.372613    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 14:21:25.383039 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.383015    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0741a5cc-f80e-49c5-9c57-df5f5ea7710d-metrics-certs\") pod \"network-metrics-daemon-7m68m\" (UID: \"0741a5cc-f80e-49c5-9c57-df5f5ea7710d\") " pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:21:25.459429 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.459403    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nfstm\""
Jul 06 14:21:25.467596 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.467569    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7m68m"
Jul 06 14:21:25.470733 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.470706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztkqt\" (UniqueName: \"kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt\") pod \"network-check-target-vvs2w\" (UID: \"f5f065bf-98db-456d-a71d-2b6ddf324436\") " pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:21:25.470855 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.470745    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret\") pod \"global-pull-secret-syncer-49jdc\" (UID: \"1b898534-bd6c-43bf-a49c-0ee858e6fb3f\") " pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:21:25.473450 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.473425    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 14:21:25.473564 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.473492    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 14:21:25.484031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.484008    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 14:21:25.484031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.484021    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b898534-bd6c-43bf-a49c-0ee858e6fb3f-original-pull-secret\") pod \"global-pull-secret-syncer-49jdc\" (UID: \"1b898534-bd6c-43bf-a49c-0ee858e6fb3f\") " pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:21:25.494300 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.494271    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztkqt\" (UniqueName: \"kubernetes.io/projected/f5f065bf-98db-456d-a71d-2b6ddf324436-kube-api-access-ztkqt\") pod \"network-check-target-vvs2w\" (UID: \"f5f065bf-98db-456d-a71d-2b6ddf324436\") " pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:21:25.592744 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.592693    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xxkrl" podStartSLOduration=2.088587882 podStartE2EDuration="12.592676151s" totalImagesPullingTime="10.504088269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:21:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:25.073509095 +0000 UTC m=+65.922396066" watchObservedRunningTime="2026-07-06 14:21:25.592676151 +0000 UTC m=+66.441563121"
Jul 06 14:21:25.593460 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.593441    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7m68m"]
Jul 06 14:21:25.596992 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:21:25.596967    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0741a5cc_f80e_49c5_9c57_df5f5ea7710d.slice/crio-6e03b24ff190ad978232f567e98c60c7dcf95e5fa283acb548ab0ec8cd2e896f WatchSource:0}: Error finding container 6e03b24ff190ad978232f567e98c60c7dcf95e5fa283acb548ab0ec8cd2e896f: Status 404 returned error can't find the container with id 6e03b24ff190ad978232f567e98c60c7dcf95e5fa283acb548ab0ec8cd2e896f
Jul 06 14:21:25.751806 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.751775    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-49jdc"
Jul 06 14:21:25.764059 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.764037    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-74wbt\""
Jul 06 14:21:25.772476 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.772440    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:21:25.893684 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.893619    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-49jdc"]
Jul 06 14:21:25.896226 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:21:25.896202    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b898534_bd6c_43bf_a49c_0ee858e6fb3f.slice/crio-0320ba2dc54b732c13347a8ee0a3c8ff49cb5680357fd85efc78ee888fff9822 WatchSource:0}: Error finding container 0320ba2dc54b732c13347a8ee0a3c8ff49cb5680357fd85efc78ee888fff9822: Status 404 returned error can't find the container with id 0320ba2dc54b732c13347a8ee0a3c8ff49cb5680357fd85efc78ee888fff9822
Jul 06 14:21:25.908679 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:25.908655    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vvs2w"]
Jul 06 14:21:25.911808 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:21:25.911781    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f065bf_98db_456d_a71d_2b6ddf324436.slice/crio-fa05dc3461e756e2e0700e2672c3c8cf3cfed4c7dbcb91890feb0adf828a1bac WatchSource:0}: Error finding container fa05dc3461e756e2e0700e2672c3c8cf3cfed4c7dbcb91890feb0adf828a1bac: Status 404 returned error can't find the container with id fa05dc3461e756e2e0700e2672c3c8cf3cfed4c7dbcb91890feb0adf828a1bac
Jul 06 14:21:26.007860 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.007768    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-49jdc" event={"ID":"1b898534-bd6c-43bf-a49c-0ee858e6fb3f","Type":"ContainerStarted","Data":"0320ba2dc54b732c13347a8ee0a3c8ff49cb5680357fd85efc78ee888fff9822"}
Jul 06 14:21:26.008875 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.008850    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vvs2w" event={"ID":"f5f065bf-98db-456d-a71d-2b6ddf324436","Type":"ContainerStarted","Data":"fa05dc3461e756e2e0700e2672c3c8cf3cfed4c7dbcb91890feb0adf828a1bac"}
Jul 06 14:21:26.009927 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.009906    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7m68m" event={"ID":"0741a5cc-f80e-49c5-9c57-df5f5ea7710d","Type":"ContainerStarted","Data":"6e03b24ff190ad978232f567e98c60c7dcf95e5fa283acb548ab0ec8cd2e896f"}
Jul 06 14:21:26.764708 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.764663    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"]
Jul 06 14:21:26.766970 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.766943    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr"]
Jul 06 14:21:26.767103 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.767081    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:26.769789 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.769767    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr"
Jul 06 14:21:26.771182 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.771005    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 06 14:21:26.771182 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.771103    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 06 14:21:26.771528 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.771507    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mpzmn\""
Jul 06 14:21:26.771633 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.771615    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 06 14:21:26.772386 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.772368    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 06 14:21:26.772537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.772523    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 06 14:21:26.772754 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.772738    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-t5z6k\""
Jul 06 14:21:26.781500 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.781291    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5d62d48e-3246-463b-9322-5d28b2b8b1f2-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:26.781500 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.781351    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5d62d48e-3246-463b-9322-5d28b2b8b1f2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:26.781500 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.781407    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5hb7\" (UniqueName: \"kubernetes.io/projected/5d62d48e-3246-463b-9322-5d28b2b8b1f2-kube-api-access-s5hb7\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:26.781500 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.781461    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d62d48e-3246-463b-9322-5d28b2b8b1f2-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:26.781500 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.781499    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d62d48e-3246-463b-9322-5d28b2b8b1f2-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:26.781798 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.781524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d62d48e-3246-463b-9322-5d28b2b8b1f2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:26.784220 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.782962    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-st9pg"]
Jul 06 14:21:26.787239 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.785705    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.789707 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.789273    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 14:21:26.789707 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.789363    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z62w8\""
Jul 06 14:21:26.789707 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.789573    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 14:21:26.789707 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.789673    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 14:21:26.790420 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.790401    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"]
Jul 06 14:21:26.791734 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.791716    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr"]
Jul 06 14:21:26.882384 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.882296    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5d62d48e-3246-463b-9322-5d28b2b8b1f2-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:26.882384 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.882367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f864d58-04b2-4a53-b831-40c2d4afe9ce-metrics-client-ca\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.882772 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.882403    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a4fe22e-7e3d-40b9-b316-ec8e190641fd-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-mnngr\" (UID: \"1a4fe22e-7e3d-40b9-b316-ec8e190641fd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr"
Jul 06 14:21:26.882772 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.882435    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f864d58-04b2-4a53-b831-40c2d4afe9ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.882772 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.882507    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5d62d48e-3246-463b-9322-5d28b2b8b1f2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:26.882772 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.882562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5hb7\" (UniqueName: \"kubernetes.io/projected/5d62d48e-3246-463b-9322-5d28b2b8b1f2-kube-api-access-s5hb7\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:26.882772 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.882612    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f864d58-04b2-4a53-b831-40c2d4afe9ce-node-exporter-tls\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.882772 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.882650    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d62d48e-3246-463b-9322-5d28b2b8b1f2-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:26.882772 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.882673    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bhbk\" (UniqueName: \"kubernetes.io/projected/1a4fe22e-7e3d-40b9-b316-ec8e190641fd-kube-api-access-8bhbk\") pod \"openshift-state-metrics-54cf96dfcf-mnngr\" (UID: \"1a4fe22e-7e3d-40b9-b316-ec8e190641fd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr"
Jul 06 14:21:26.882772 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.882705    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a4fe22e-7e3d-40b9-b316-ec8e190641fd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-mnngr\" (UID: \"1a4fe22e-7e3d-40b9-b316-ec8e190641fd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr"
Jul 06 14:21:26.882772 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.882718    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5d62d48e-3246-463b-9322-5d28b2b8b1f2-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:26.882772 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.882736    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxx6c\" (UniqueName: \"kubernetes.io/projected/1f864d58-04b2-4a53-b831-40c2d4afe9ce-kube-api-access-rxx6c\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.883354 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.882797    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d62d48e-3246-463b-9322-5d28b2b8b1f2-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:26.883354 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.882822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f864d58-04b2-4a53-b831-40c2d4afe9ce-sys\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.883354 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:26.882847    2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 06 14:21:26.883354 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.882851    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d62d48e-3246-463b-9322-5d28b2b8b1f2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:26.883354 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.882890    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a4fe22e-7e3d-40b9-b316-ec8e190641fd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-mnngr\" (UID: \"1a4fe22e-7e3d-40b9-b316-ec8e190641fd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr"
Jul 06 14:21:26.883354 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:26.882910    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d62d48e-3246-463b-9322-5d28b2b8b1f2-kube-state-metrics-tls podName:5d62d48e-3246-463b-9322-5d28b2b8b1f2 nodeName:}" failed. No retries permitted until 2026-07-06 14:21:27.382888505 +0000 UTC m=+68.231775460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5d62d48e-3246-463b-9322-5d28b2b8b1f2-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-6qrrk" (UID: "5d62d48e-3246-463b-9322-5d28b2b8b1f2") : secret "kube-state-metrics-tls" not found
Jul 06 14:21:26.883354 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.883138    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5d62d48e-3246-463b-9322-5d28b2b8b1f2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:26.883354 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.883187    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f864d58-04b2-4a53-b831-40c2d4afe9ce-root\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.883354 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.883221    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f864d58-04b2-4a53-b831-40c2d4afe9ce-node-exporter-wtmp\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.883354 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.883246    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f864d58-04b2-4a53-b831-40c2d4afe9ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.883354 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.883287    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f864d58-04b2-4a53-b831-40c2d4afe9ce-node-exporter-textfile\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.883889 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.883562    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d62d48e-3246-463b-9322-5d28b2b8b1f2-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:26.886355 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.886332    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d62d48e-3246-463b-9322-5d28b2b8b1f2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:26.893819 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.893768    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5hb7\" (UniqueName: \"kubernetes.io/projected/5d62d48e-3246-463b-9322-5d28b2b8b1f2-kube-api-access-s5hb7\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:26.985176 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.985128    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f864d58-04b2-4a53-b831-40c2d4afe9ce-node-exporter-textfile\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.985271 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.985208    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f864d58-04b2-4a53-b831-40c2d4afe9ce-metrics-client-ca\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.985271 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.985237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a4fe22e-7e3d-40b9-b316-ec8e190641fd-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-mnngr\" (UID: \"1a4fe22e-7e3d-40b9-b316-ec8e190641fd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr"
Jul 06 14:21:26.985271 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.985264    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f864d58-04b2-4a53-b831-40c2d4afe9ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.985377 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.985312    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f864d58-04b2-4a53-b831-40c2d4afe9ce-node-exporter-tls\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.985409 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.985373    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bhbk\" (UniqueName: \"kubernetes.io/projected/1a4fe22e-7e3d-40b9-b316-ec8e190641fd-kube-api-access-8bhbk\") pod \"openshift-state-metrics-54cf96dfcf-mnngr\" (UID: \"1a4fe22e-7e3d-40b9-b316-ec8e190641fd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr"
Jul 06 14:21:26.985441 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.985407    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a4fe22e-7e3d-40b9-b316-ec8e190641fd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-mnngr\" (UID: \"1a4fe22e-7e3d-40b9-b316-ec8e190641fd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr"
Jul 06 14:21:26.985441 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.985435    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxx6c\" (UniqueName: \"kubernetes.io/projected/1f864d58-04b2-4a53-b831-40c2d4afe9ce-kube-api-access-rxx6c\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.985505 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.985462    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f864d58-04b2-4a53-b831-40c2d4afe9ce-sys\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.985505 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.985496    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a4fe22e-7e3d-40b9-b316-ec8e190641fd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-mnngr\" (UID: \"1a4fe22e-7e3d-40b9-b316-ec8e190641fd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr"
Jul 06 14:21:26.985564 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.985523    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f864d58-04b2-4a53-b831-40c2d4afe9ce-root\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.985564 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.985545    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f864d58-04b2-4a53-b831-40c2d4afe9ce-node-exporter-wtmp\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.985623 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.985568    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f864d58-04b2-4a53-b831-40c2d4afe9ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.986235 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.986180    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f864d58-04b2-4a53-b831-40c2d4afe9ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.986488 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.986471    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f864d58-04b2-4a53-b831-40c2d4afe9ce-node-exporter-textfile\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.986940 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.986915    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f864d58-04b2-4a53-b831-40c2d4afe9ce-metrics-client-ca\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.988417 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.988390    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a4fe22e-7e3d-40b9-b316-ec8e190641fd-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-mnngr\" (UID: \"1a4fe22e-7e3d-40b9-b316-ec8e190641fd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr"
Jul 06 14:21:26.988542 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.988464    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f864d58-04b2-4a53-b831-40c2d4afe9ce-sys\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.988542 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:26.988536    2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 06 14:21:26.988645 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:26.988595    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a4fe22e-7e3d-40b9-b316-ec8e190641fd-openshift-state-metrics-tls podName:1a4fe22e-7e3d-40b9-b316-ec8e190641fd nodeName:}" failed. No retries permitted until 2026-07-06 14:21:27.488574417 +0000 UTC m=+68.337461366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1a4fe22e-7e3d-40b9-b316-ec8e190641fd-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-mnngr" (UID: "1a4fe22e-7e3d-40b9-b316-ec8e190641fd") : secret "openshift-state-metrics-tls" not found
Jul 06 14:21:26.989012 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.988827    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f864d58-04b2-4a53-b831-40c2d4afe9ce-root\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.989012 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.988959    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f864d58-04b2-4a53-b831-40c2d4afe9ce-node-exporter-wtmp\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.990179 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.990136    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f864d58-04b2-4a53-b831-40c2d4afe9ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.991928 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.991888    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f864d58-04b2-4a53-b831-40c2d4afe9ce-node-exporter-tls\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.991928 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.991906    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a4fe22e-7e3d-40b9-b316-ec8e190641fd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-mnngr\" (UID: \"1a4fe22e-7e3d-40b9-b316-ec8e190641fd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr"
Jul 06 14:21:26.996385 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.996336    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxx6c\" (UniqueName: \"kubernetes.io/projected/1f864d58-04b2-4a53-b831-40c2d4afe9ce-kube-api-access-rxx6c\") pod \"node-exporter-st9pg\" (UID: \"1f864d58-04b2-4a53-b831-40c2d4afe9ce\") " pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:26.996562 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:26.996544    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bhbk\" (UniqueName: \"kubernetes.io/projected/1a4fe22e-7e3d-40b9-b316-ec8e190641fd-kube-api-access-8bhbk\") pod \"openshift-state-metrics-54cf96dfcf-mnngr\" (UID: \"1a4fe22e-7e3d-40b9-b316-ec8e190641fd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr"
Jul 06 14:21:27.022297 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.022262    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7m68m" event={"ID":"0741a5cc-f80e-49c5-9c57-df5f5ea7710d","Type":"ContainerStarted","Data":"04013ef185462dab374ea6cbf7198591e23f8f24a63f728c3bc7c207fff14a88"}
Jul 06 14:21:27.106345 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.106088    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-st9pg"
Jul 06 14:21:27.117486 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:21:27.117454    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f864d58_04b2_4a53_b831_40c2d4afe9ce.slice/crio-0935a23a2e5b789de96e0ff4def6610c9bcf4f1e56feb522ccc27fcf00afe91d WatchSource:0}: Error finding container 0935a23a2e5b789de96e0ff4def6610c9bcf4f1e56feb522ccc27fcf00afe91d: Status 404 returned error can't find the container with id 0935a23a2e5b789de96e0ff4def6610c9bcf4f1e56feb522ccc27fcf00afe91d
Jul 06 14:21:27.389429 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.389331    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d62d48e-3246-463b-9322-5d28b2b8b1f2-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:27.392186 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.392137    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d62d48e-3246-463b-9322-5d28b2b8b1f2-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-6qrrk\" (UID: \"5d62d48e-3246-463b-9322-5d28b2b8b1f2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:27.489787 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.489747    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a4fe22e-7e3d-40b9-b316-ec8e190641fd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-mnngr\" (UID: \"1a4fe22e-7e3d-40b9-b316-ec8e190641fd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr"
Jul 06 14:21:27.492795 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.492765    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a4fe22e-7e3d-40b9-b316-ec8e190641fd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-mnngr\" (UID: \"1a4fe22e-7e3d-40b9-b316-ec8e190641fd\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr"
Jul 06 14:21:27.683194 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.683022    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"
Jul 06 14:21:27.696301 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.696267    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr"
Jul 06 14:21:27.866283 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.865310    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:21:27.869242 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.869215    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.875060 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.872708    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 14:21:27.875060 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.872915    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 14:21:27.875060 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.873092    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 14:21:27.875060 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.873413    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 14:21:27.875060 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.873621    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 14:21:27.875060 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.873792    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 14:21:27.875060 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.874090    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 14:21:27.875060 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.874260    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 14:21:27.875060 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.874385    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 14:21:27.875060 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.874559    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hw5w4\""
Jul 06 14:21:27.887221 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.887086    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:21:27.891355 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.891331    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk"]
Jul 06 14:21:27.893630 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:21:27.893601    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d62d48e_3246_463b_9322_5d28b2b8b1f2.slice/crio-33134a195455a928be96b3c0249055451c4c75bd462c1c7617e4a329269b6c3c WatchSource:0}: Error finding container 33134a195455a928be96b3c0249055451c4c75bd462c1c7617e4a329269b6c3c: Status 404 returned error can't find the container with id 33134a195455a928be96b3c0249055451c4c75bd462c1c7617e4a329269b6c3c
Jul 06 14:21:27.893841 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.893823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9932a76d-f77a-4188-9a5d-8df19d74d0bd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.894179 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.893857    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9932a76d-f77a-4188-9a5d-8df19d74d0bd-config-out\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.894179 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.893887    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.894179 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.893915    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-config-volume\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.894179 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.893941    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-web-config\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.894179 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.893974    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.894179 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.893997    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9932a76d-f77a-4188-9a5d-8df19d74d0bd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.894179 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.894018    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9932a76d-f77a-4188-9a5d-8df19d74d0bd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.894179 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.894042    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9932a76d-f77a-4188-9a5d-8df19d74d0bd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.894179 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.894056    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.894179 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.894090    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.894647 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.894188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxs2f\" (UniqueName: \"kubernetes.io/projected/9932a76d-f77a-4188-9a5d-8df19d74d0bd-kube-api-access-zxs2f\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.894647 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.894213    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.925291 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.925179    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr"]
Jul 06 14:21:27.930554 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:21:27.930522    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a4fe22e_7e3d_40b9_b316_ec8e190641fd.slice/crio-9ae9b81a50c38f357db407054bae74f832e121263cfb7f9ae3daef1ac50f96ee WatchSource:0}: Error finding container 9ae9b81a50c38f357db407054bae74f832e121263cfb7f9ae3daef1ac50f96ee: Status 404 returned error can't find the container with id 9ae9b81a50c38f357db407054bae74f832e121263cfb7f9ae3daef1ac50f96ee
Jul 06 14:21:27.994912 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.994880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9932a76d-f77a-4188-9a5d-8df19d74d0bd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.995073 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.994929    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9932a76d-f77a-4188-9a5d-8df19d74d0bd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.995073 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.994960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9932a76d-f77a-4188-9a5d-8df19d74d0bd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.995073 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.994983    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.995073 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.995018    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.995073 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.995058    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxs2f\" (UniqueName: \"kubernetes.io/projected/9932a76d-f77a-4188-9a5d-8df19d74d0bd-kube-api-access-zxs2f\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.996225 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.995085    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.996225 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.995124    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9932a76d-f77a-4188-9a5d-8df19d74d0bd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.996225 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.995168    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9932a76d-f77a-4188-9a5d-8df19d74d0bd-config-out\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.996225 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.995198    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.996225 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.995228    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-config-volume\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.996225 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.995254    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-web-config\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.996225 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.995281    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.996959 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:27.996929    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9932a76d-f77a-4188-9a5d-8df19d74d0bd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:27.998299 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:27.998257    2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 06 14:21:27.998407 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:27.998334    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-main-tls podName:9932a76d-f77a-4188-9a5d-8df19d74d0bd nodeName:}" failed. No retries permitted until 2026-07-06 14:21:28.498312218 +0000 UTC m=+69.347199180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "9932a76d-f77a-4188-9a5d-8df19d74d0bd") : secret "alertmanager-main-tls" not found
Jul 06 14:21:28.001475 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.001446    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:28.001715 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.001692    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9932a76d-f77a-4188-9a5d-8df19d74d0bd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:28.002171 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.002130    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:28.002247 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.002206    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9932a76d-f77a-4188-9a5d-8df19d74d0bd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:28.002470 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.002447    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9932a76d-f77a-4188-9a5d-8df19d74d0bd-config-out\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:28.002710 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.002670    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:28.003363 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.002988    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-config-volume\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:28.003841 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.003762    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:28.004933 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.004912    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-web-config\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:28.005993 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.005967    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9932a76d-f77a-4188-9a5d-8df19d74d0bd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:28.010456 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.010429    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxs2f\" (UniqueName: \"kubernetes.io/projected/9932a76d-f77a-4188-9a5d-8df19d74d0bd-kube-api-access-zxs2f\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:28.031818 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.031084    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7m68m" event={"ID":"0741a5cc-f80e-49c5-9c57-df5f5ea7710d","Type":"ContainerStarted","Data":"869a382798f6311b89dc28d3293c7c6576560798544e3b38e26a327b291b7b7a"}
Jul 06 14:21:28.033244 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.033210    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk" event={"ID":"5d62d48e-3246-463b-9322-5d28b2b8b1f2","Type":"ContainerStarted","Data":"33134a195455a928be96b3c0249055451c4c75bd462c1c7617e4a329269b6c3c"}
Jul 06 14:21:28.036134 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.036105    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr" event={"ID":"1a4fe22e-7e3d-40b9-b316-ec8e190641fd","Type":"ContainerStarted","Data":"171e7a9abdad43c30f95ace9c515df6ce000b5f43270a55948b06894416c7125"}
Jul 06 14:21:28.036248 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.036185    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr" event={"ID":"1a4fe22e-7e3d-40b9-b316-ec8e190641fd","Type":"ContainerStarted","Data":"9ae9b81a50c38f357db407054bae74f832e121263cfb7f9ae3daef1ac50f96ee"}
Jul 06 14:21:28.038027 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.038003    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-st9pg" event={"ID":"1f864d58-04b2-4a53-b831-40c2d4afe9ce","Type":"ContainerStarted","Data":"0935a23a2e5b789de96e0ff4def6610c9bcf4f1e56feb522ccc27fcf00afe91d"}
Jul 06 14:21:28.053190 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.052536    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7m68m" podStartSLOduration=67.861404857 podStartE2EDuration="1m9.052516017s" totalImagesPullingTime="1.19111116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:20:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:28.052052206 +0000 UTC m=+68.900939180" watchObservedRunningTime="2026-07-06 14:21:28.052516017 +0000 UTC m=+68.901403025"
Jul 06 14:21:28.499687 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.499650    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:28.502330 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.502307    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:28.786893 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:28.786626    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:21:29.049380 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.049277    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr" event={"ID":"1a4fe22e-7e3d-40b9-b316-ec8e190641fd","Type":"ContainerStarted","Data":"6c00c8fac4e1a566a4646430c451bfd06baebfc157c49286a39a638a0db40a91"}
Jul 06 14:21:29.054377 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.053696    2562 generic.go:356] "Generic (PLEG): container finished" podID="1f864d58-04b2-4a53-b831-40c2d4afe9ce" containerID="b71f0ec41206d1012f9b5bc50265d2e125ed692ace5e258556c4dfc294e9035a" exitCode=0
Jul 06 14:21:29.054377 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.053800    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-st9pg" event={"ID":"1f864d58-04b2-4a53-b831-40c2d4afe9ce","Type":"ContainerDied","Data":"b71f0ec41206d1012f9b5bc50265d2e125ed692ace5e258556c4dfc294e9035a"}
Jul 06 14:21:29.874257 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.874217    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8d4778867-7twbx"]
Jul 06 14:21:29.877380 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.877356    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:29.880127 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.880092    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 06 14:21:29.880127 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.880106    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 06 14:21:29.880329 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.880126    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5co5lnk8dmrie\""
Jul 06 14:21:29.880329 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.880106    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 06 14:21:29.880329 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.880111    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 06 14:21:29.880329 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.880106    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qppjn\""
Jul 06 14:21:29.880614 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.880596    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 06 14:21:29.891621 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.891597    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8d4778867-7twbx"]
Jul 06 14:21:29.911529 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.911488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g96m\" (UniqueName: \"kubernetes.io/projected/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-kube-api-access-8g96m\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:29.911689 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.911550    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:29.911689 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.911611    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:29.911689 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.911650    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-secret-thanos-querier-tls\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:29.911689 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.911685    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:29.911937 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.911714    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-secret-grpc-tls\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:29.911937 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.911782    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:29.911937 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:29.911836    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-metrics-client-ca\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:30.013219 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:30.013164    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:30.013375 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:30.013247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-secret-thanos-querier-tls\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:30.013375 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:30.013296    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:30.013375 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:30.013325    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-secret-grpc-tls\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:30.013375 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:30.013363    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:30.013564 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:30.013405    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-metrics-client-ca\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:30.013564 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:30.013440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g96m\" (UniqueName: \"kubernetes.io/projected/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-kube-api-access-8g96m\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:30.013564 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:30.013480    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:30.014051 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:30.013994    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-metrics-client-ca\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:30.016049 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:30.015993    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-secret-thanos-querier-tls\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:30.016459 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:30.016437    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:30.016827 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:30.016801    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:30.016926 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:30.016879    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:30.017323 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:30.017307    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:30.017373 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:30.017313    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-secret-grpc-tls\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:30.022466 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:30.022442    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g96m\" (UniqueName: \"kubernetes.io/projected/3c4e9e65-bc53-4440-bf85-9824b7cfa3e1-kube-api-access-8g96m\") pod \"thanos-querier-8d4778867-7twbx\" (UID: \"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1\") " pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:30.189758 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:30.189662    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:30.986667 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:30.986640    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vwsz8"
Jul 06 14:21:31.058071 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.058038    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5496dc54b8-7xg7r"]
Jul 06 14:21:31.061714 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.061689    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.064168 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.064112    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 06 14:21:31.064422 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.064346    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 06 14:21:31.064422 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.064407    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 06 14:21:31.064600 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.064432    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 14:21:31.064600 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.064496    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xnnsx\""
Jul 06 14:21:31.066212 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.066190    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-b5fl6lvv11gv9\""
Jul 06 14:21:31.073295 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.073269    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5496dc54b8-7xg7r"]
Jul 06 14:21:31.123559 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.123521    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d056f006-e607-4b10-ac31-6be5335cdd30-client-ca-bundle\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.123749 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.123575    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzfst\" (UniqueName: \"kubernetes.io/projected/d056f006-e607-4b10-ac31-6be5335cdd30-kube-api-access-hzfst\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.123749 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.123624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d056f006-e607-4b10-ac31-6be5335cdd30-audit-log\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.123749 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.123687    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d056f006-e607-4b10-ac31-6be5335cdd30-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.123749 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.123717    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d056f006-e607-4b10-ac31-6be5335cdd30-secret-metrics-server-client-certs\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.123919 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.123756    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d056f006-e607-4b10-ac31-6be5335cdd30-secret-metrics-server-tls\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.123919 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.123801    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d056f006-e607-4b10-ac31-6be5335cdd30-metrics-server-audit-profiles\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.224535 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.224496    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d056f006-e607-4b10-ac31-6be5335cdd30-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.225018 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.224549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d056f006-e607-4b10-ac31-6be5335cdd30-secret-metrics-server-client-certs\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.225018 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.224591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d056f006-e607-4b10-ac31-6be5335cdd30-secret-metrics-server-tls\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.225018 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.224638    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d056f006-e607-4b10-ac31-6be5335cdd30-metrics-server-audit-profiles\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.225018 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.224674    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d056f006-e607-4b10-ac31-6be5335cdd30-client-ca-bundle\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.225018 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.224699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzfst\" (UniqueName: \"kubernetes.io/projected/d056f006-e607-4b10-ac31-6be5335cdd30-kube-api-access-hzfst\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.225018 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.224747    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d056f006-e607-4b10-ac31-6be5335cdd30-audit-log\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.225383 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.225183    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d056f006-e607-4b10-ac31-6be5335cdd30-audit-log\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.225383 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.225356    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d056f006-e607-4b10-ac31-6be5335cdd30-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.225712 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.225666    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d056f006-e607-4b10-ac31-6be5335cdd30-metrics-server-audit-profiles\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.227651 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.227629    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d056f006-e607-4b10-ac31-6be5335cdd30-secret-metrics-server-tls\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.227797 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.227779    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d056f006-e607-4b10-ac31-6be5335cdd30-client-ca-bundle\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.228680 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.228657    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d056f006-e607-4b10-ac31-6be5335cdd30-secret-metrics-server-client-certs\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.234914 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.234878    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzfst\" (UniqueName: \"kubernetes.io/projected/d056f006-e607-4b10-ac31-6be5335cdd30-kube-api-access-hzfst\") pod \"metrics-server-5496dc54b8-7xg7r\" (UID: \"d056f006-e607-4b10-ac31-6be5335cdd30\") " pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.375015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.374930    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:31.563119 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.563080    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-cdc2x"]
Jul 06 14:21:31.573745 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.573712    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cdc2x"
Jul 06 14:21:31.576771 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.576576    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-lmsqb\""
Jul 06 14:21:31.578419 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.578387    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-cdc2x"]
Jul 06 14:21:31.578576 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.578521    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 06 14:21:31.626815 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.626723    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsbmv\" (UniqueName: \"kubernetes.io/projected/6823ad0b-05cf-4273-8153-559cf91b6fe9-kube-api-access-qsbmv\") pod \"monitoring-plugin-d5dcff7cf-cdc2x\" (UID: \"6823ad0b-05cf-4273-8153-559cf91b6fe9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cdc2x"
Jul 06 14:21:31.626815 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.626788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6823ad0b-05cf-4273-8153-559cf91b6fe9-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-cdc2x\" (UID: \"6823ad0b-05cf-4273-8153-559cf91b6fe9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cdc2x"
Jul 06 14:21:31.727388 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.727339    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsbmv\" (UniqueName: \"kubernetes.io/projected/6823ad0b-05cf-4273-8153-559cf91b6fe9-kube-api-access-qsbmv\") pod \"monitoring-plugin-d5dcff7cf-cdc2x\" (UID: \"6823ad0b-05cf-4273-8153-559cf91b6fe9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cdc2x"
Jul 06 14:21:31.727573 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.727406    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6823ad0b-05cf-4273-8153-559cf91b6fe9-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-cdc2x\" (UID: \"6823ad0b-05cf-4273-8153-559cf91b6fe9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cdc2x"
Jul 06 14:21:31.730634 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.730600    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6823ad0b-05cf-4273-8153-559cf91b6fe9-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-cdc2x\" (UID: \"6823ad0b-05cf-4273-8153-559cf91b6fe9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cdc2x"
Jul 06 14:21:31.737911 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.737869    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsbmv\" (UniqueName: \"kubernetes.io/projected/6823ad0b-05cf-4273-8153-559cf91b6fe9-kube-api-access-qsbmv\") pod \"monitoring-plugin-d5dcff7cf-cdc2x\" (UID: \"6823ad0b-05cf-4273-8153-559cf91b6fe9\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cdc2x"
Jul 06 14:21:31.886369 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.886279    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cdc2x"
Jul 06 14:21:31.988669 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.988640    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"]
Jul 06 14:21:31.998388 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:31.998363    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.001259 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.001192    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 06 14:21:32.001259 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.001259    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 06 14:21:32.001445 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.001274    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-tgzsv\""
Jul 06 14:21:32.001445 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.001262    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 06 14:21:32.001833 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.001818    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 06 14:21:32.002878 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.002861    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 06 14:21:32.008466 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.008440    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"]
Jul 06 14:21:32.008575 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.008499    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 06 14:21:32.029749 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.029716    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wr74\" (UniqueName: \"kubernetes.io/projected/856454c0-9d89-4109-b616-afe0686391d9-kube-api-access-2wr74\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.029749 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.029754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/856454c0-9d89-4109-b616-afe0686391d9-serving-certs-ca-bundle\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.029961 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.029773    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/856454c0-9d89-4109-b616-afe0686391d9-metrics-client-ca\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.029961 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.029868    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/856454c0-9d89-4109-b616-afe0686391d9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.029961 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.029914    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/856454c0-9d89-4109-b616-afe0686391d9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.030113 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.029968    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/856454c0-9d89-4109-b616-afe0686391d9-secret-telemeter-client\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.030113 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.030053    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/856454c0-9d89-4109-b616-afe0686391d9-federate-client-tls\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.030113 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.030108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/856454c0-9d89-4109-b616-afe0686391d9-telemeter-client-tls\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.131081 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.131047    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/856454c0-9d89-4109-b616-afe0686391d9-federate-client-tls\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.131081 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.131086    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/856454c0-9d89-4109-b616-afe0686391d9-telemeter-client-tls\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.131300 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.131123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wr74\" (UniqueName: \"kubernetes.io/projected/856454c0-9d89-4109-b616-afe0686391d9-kube-api-access-2wr74\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.131300 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.131178    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/856454c0-9d89-4109-b616-afe0686391d9-serving-certs-ca-bundle\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.131300 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.131204    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/856454c0-9d89-4109-b616-afe0686391d9-metrics-client-ca\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.131300 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.131242    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/856454c0-9d89-4109-b616-afe0686391d9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.131300 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.131288    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/856454c0-9d89-4109-b616-afe0686391d9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.131557 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.131324    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/856454c0-9d89-4109-b616-afe0686391d9-secret-telemeter-client\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.132218 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.132193    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/856454c0-9d89-4109-b616-afe0686391d9-metrics-client-ca\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.132356 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.132298    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/856454c0-9d89-4109-b616-afe0686391d9-serving-certs-ca-bundle\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.132477 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.132456    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/856454c0-9d89-4109-b616-afe0686391d9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.133900 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.133868    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/856454c0-9d89-4109-b616-afe0686391d9-telemeter-client-tls\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.134002 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.133974    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/856454c0-9d89-4109-b616-afe0686391d9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.134534 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.134512    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/856454c0-9d89-4109-b616-afe0686391d9-federate-client-tls\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.134691 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.134668    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/856454c0-9d89-4109-b616-afe0686391d9-secret-telemeter-client\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.139800 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.139750    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wr74\" (UniqueName: \"kubernetes.io/projected/856454c0-9d89-4109-b616-afe0686391d9-kube-api-access-2wr74\") pod \"telemeter-client-5c47c55bb-ndvfb\" (UID: \"856454c0-9d89-4109-b616-afe0686391d9\") " pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.308118 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.308096    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"
Jul 06 14:21:32.566682 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.566654    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78d4dbff79-24gg6"]
Jul 06 14:21:32.600561 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.596465    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8d4778867-7twbx"]
Jul 06 14:21:32.606100 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.606074    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d8f9745d7-sqh66"]
Jul 06 14:21:32.651409 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.647323    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d8f9745d7-sqh66"]
Jul 06 14:21:32.651409 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.647375    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5496dc54b8-7xg7r"]
Jul 06 14:21:32.651409 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.647480    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.666397 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.664180    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:32.666397 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.665509    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:21:32.667029 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.666991    2562 patch_prober.go:28] interesting pod/console-8786bdfdc-wk7v4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" start-of-body=
Jul 06 14:21:32.667173 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.667051    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8786bdfdc-wk7v4" podUID="d275f915-be0b-429a-81c1-63b2bb09053b" containerName="console" probeResult="failure" output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused"
Jul 06 14:21:32.668677 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.668594    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-cdc2x"]
Jul 06 14:21:32.715647 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.714725    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c47c55bb-ndvfb"]
Jul 06 14:21:32.721714 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:21:32.721677    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod856454c0_9d89_4109_b616_afe0686391d9.slice/crio-159712723a15da9080b9f6a6a0c4fcfcfef7c113969179db0c24e716c04aaaf2 WatchSource:0}: Error finding container 159712723a15da9080b9f6a6a0c4fcfcfef7c113969179db0c24e716c04aaaf2: Status 404 returned error can't find the container with id 159712723a15da9080b9f6a6a0c4fcfcfef7c113969179db0c24e716c04aaaf2
Jul 06 14:21:32.754661 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.752893    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96qx8\" (UniqueName: \"kubernetes.io/projected/1c73be8b-2763-415d-9023-6657f6e07641-kube-api-access-96qx8\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.754661 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.752939    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c73be8b-2763-415d-9023-6657f6e07641-console-serving-cert\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.754661 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.752970    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-console-config\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.754661 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.753057    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-service-ca\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.754661 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.753102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c73be8b-2763-415d-9023-6657f6e07641-console-oauth-config\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.754661 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.753248    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-trusted-ca-bundle\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.754661 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.753277    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-oauth-serving-cert\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.799845 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.799804    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:21:32.807656 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:21:32.807614    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9932a76d_f77a_4188_9a5d_8df19d74d0bd.slice/crio-1b28e768fc372086092ff8e06288096cf644febdc9d1d82671d880944352704a WatchSource:0}: Error finding container 1b28e768fc372086092ff8e06288096cf644febdc9d1d82671d880944352704a: Status 404 returned error can't find the container with id 1b28e768fc372086092ff8e06288096cf644febdc9d1d82671d880944352704a
Jul 06 14:21:32.857173 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.853865    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c73be8b-2763-415d-9023-6657f6e07641-console-oauth-config\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.857173 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.853938    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-trusted-ca-bundle\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.857173 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.853963    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-oauth-serving-cert\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.857173 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.854011    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96qx8\" (UniqueName: \"kubernetes.io/projected/1c73be8b-2763-415d-9023-6657f6e07641-kube-api-access-96qx8\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.857173 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.854042    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c73be8b-2763-415d-9023-6657f6e07641-console-serving-cert\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.857173 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.854072    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-console-config\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.857173 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.854125    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-service-ca\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.857173 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.854871    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-service-ca\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.857173 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.855715    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-oauth-serving-cert\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.857173 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.856394    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-trusted-ca-bundle\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.857173 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.856415    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-console-config\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.863126 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.860344    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c73be8b-2763-415d-9023-6657f6e07641-console-oauth-config\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.863126 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.861906    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c73be8b-2763-415d-9023-6657f6e07641-console-serving-cert\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.864868 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.864797    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96qx8\" (UniqueName: \"kubernetes.io/projected/1c73be8b-2763-415d-9023-6657f6e07641-kube-api-access-96qx8\") pod \"console-5d8f9745d7-sqh66\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") " pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:32.977750 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:32.977720    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:33.072073 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.072039    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-49jdc" event={"ID":"1b898534-bd6c-43bf-a49c-0ee858e6fb3f","Type":"ContainerStarted","Data":"9bc74e0b0ec97da75942b2f16e57b84919e6f0002e023ae80b84a5d527d3479b"}
Jul 06 14:21:33.074026 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.073995    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vvs2w" event={"ID":"f5f065bf-98db-456d-a71d-2b6ddf324436","Type":"ContainerStarted","Data":"c403ffb0f4757a790c1bf6a6d4fcd6a684d593af25d8f9f895071f70da3e32e2"}
Jul 06 14:21:33.074237 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.074055    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:21:33.077012 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.076965    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk" event={"ID":"5d62d48e-3246-463b-9322-5d28b2b8b1f2","Type":"ContainerStarted","Data":"a1e8a8eb4c44977f5a9b5b5d0a2e4142e90f79acc847413e903a4c23ba2c0932"}
Jul 06 14:21:33.077139 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.077022    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk" event={"ID":"5d62d48e-3246-463b-9322-5d28b2b8b1f2","Type":"ContainerStarted","Data":"916ea49f6e5d1121c7e49d2525442b200aaabcc2ba78e85e7058fedb1d6a9180"}
Jul 06 14:21:33.077139 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.077052    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk" event={"ID":"5d62d48e-3246-463b-9322-5d28b2b8b1f2","Type":"ContainerStarted","Data":"9de91228ae0c5659f3b48899bd5466f2094e8ca96c6a9a44c0c7a57487b24ab9"}
Jul 06 14:21:33.079080 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.079003    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb" event={"ID":"856454c0-9d89-4109-b616-afe0686391d9","Type":"ContainerStarted","Data":"159712723a15da9080b9f6a6a0c4fcfcfef7c113969179db0c24e716c04aaaf2"}
Jul 06 14:21:33.083834 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.083296    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr" event={"ID":"1a4fe22e-7e3d-40b9-b316-ec8e190641fd","Type":"ContainerStarted","Data":"064316a7ec9571333dce2e07c10e7a8a60f4b348aa1ecf90f6c24d72ec561536"}
Jul 06 14:21:33.088831 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.088797    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-st9pg" event={"ID":"1f864d58-04b2-4a53-b831-40c2d4afe9ce","Type":"ContainerStarted","Data":"6dcf19a75fed4820657cf60521e8dc66db16f39a9cdb5677b18e7df21ac0aa33"}
Jul 06 14:21:33.088959 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.088859    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-st9pg" event={"ID":"1f864d58-04b2-4a53-b831-40c2d4afe9ce","Type":"ContainerStarted","Data":"0cfd37d928da4949f502879da08a226ce7e39eec2b994b8456cb48073267b7f9"}
Jul 06 14:21:33.090357 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.090336    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cdc2x" event={"ID":"6823ad0b-05cf-4273-8153-559cf91b6fe9","Type":"ContainerStarted","Data":"d6d52096119d0671bfb775b03a4f046144b7f1853b987264c96f502706dd5281"}
Jul 06 14:21:33.093251 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.093171    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9932a76d-f77a-4188-9a5d-8df19d74d0bd","Type":"ContainerStarted","Data":"1b28e768fc372086092ff8e06288096cf644febdc9d1d82671d880944352704a"}
Jul 06 14:21:33.095913 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.095826    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8d4778867-7twbx" event={"ID":"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1","Type":"ContainerStarted","Data":"358e4037feaa9ef373175be727f317b6b32d4791c75df1a270943dbe98b975d2"}
Jul 06 14:21:33.097485 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.097439    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r" event={"ID":"d056f006-e607-4b10-ac31-6be5335cdd30","Type":"ContainerStarted","Data":"f50d8bf5505277a19919bd4747d3f7c6ff34400a0f9626feadbb4120236e3bf0"}
Jul 06 14:21:33.113112 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.113054    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mnngr" podStartSLOduration=2.8849974830000003 podStartE2EDuration="7.113032714s" totalImagesPullingTime="4.228035231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:33.11230148 +0000 UTC m=+73.961188452" watchObservedRunningTime="2026-07-06 14:21:33.113032714 +0000 UTC m=+73.961919665"
Jul 06 14:21:33.113291 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.113206    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-49jdc" podStartSLOduration=66.66212697899999 podStartE2EDuration="1m13.113199826s" totalImagesPullingTime="6.451072847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:33.091341438 +0000 UTC m=+73.940228410" watchObservedRunningTime="2026-07-06 14:21:33.113199826 +0000 UTC m=+73.962086796"
Jul 06 14:21:33.120664 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.120129    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:21:33.130367 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.130342    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.133128 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.133104    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 14:21:33.133593 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.133567    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 14:21:33.133931 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.133909    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 14:21:33.134524 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.134303    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 14:21:33.134524 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.134311    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 14:21:33.134944 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.134920    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jj8pp\""
Jul 06 14:21:33.135419 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.135398    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 14:21:33.135659 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.135643    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3mkg8ad57rko9\""
Jul 06 14:21:33.135885 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.135870    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 14:21:33.138460 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.137310    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 14:21:33.138460 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.137680    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 14:21:33.138460 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.137893    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 14:21:33.138460 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.138087    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 14:21:33.138460 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.138303    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 14:21:33.138460 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.138341    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 14:21:33.138780 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.138546    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 14:21:33.139269 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.139217    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-st9pg" podStartSLOduration=5.77364557 podStartE2EDuration="7.139198416s" totalImagesPullingTime="1.279790331s" totalInitContainerRuntime="85.762515ms" isStatefulPod=true podCreationTimestamp="2026-07-06 14:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:33.138347417 +0000 UTC m=+73.987234400" watchObservedRunningTime="2026-07-06 14:21:33.139198416 +0000 UTC m=+73.988085385"
Jul 06 14:21:33.146882 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.146790    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:21:33.170273 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.170246    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d8f9745d7-sqh66"]
Jul 06 14:21:33.171656 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.171605    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-6qrrk" podStartSLOduration=2.736608662 podStartE2EDuration="7.171584349s" totalImagesPullingTime="4.434975687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:33.170983272 +0000 UTC m=+74.019870245" watchObservedRunningTime="2026-07-06 14:21:33.171584349 +0000 UTC m=+74.020471322"
Jul 06 14:21:33.174178 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:21:33.174119    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c73be8b_2763_415d_9023_6657f6e07641.slice/crio-cac1854e94457bc4ff65622dcb203da096fce9186f12568e42f2d1077b8a3c64 WatchSource:0}: Error finding container cac1854e94457bc4ff65622dcb203da096fce9186f12568e42f2d1077b8a3c64: Status 404 returned error can't find the container with id cac1854e94457bc4ff65622dcb203da096fce9186f12568e42f2d1077b8a3c64
Jul 06 14:21:33.197168 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.196931    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vvs2w" podStartSLOduration=67.779885265 podStartE2EDuration="1m14.196908164s" totalImagesPullingTime="6.417022899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:20:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:33.196222109 +0000 UTC m=+74.045109071" watchObservedRunningTime="2026-07-06 14:21:33.196908164 +0000 UTC m=+74.045795136"
Jul 06 14:21:33.259928 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.259891    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.260331 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.260313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3c04184-0141-4c2a-b299-72f14b1a92f6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.260482 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.260467    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.260637 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.260622    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.260741 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.260729    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.260844 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.260831    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.260958 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.260945    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.261338 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.261322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.261469 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.261454    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.261581 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.261564    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.261674 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.261662    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.261773 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.261761    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3c04184-0141-4c2a-b299-72f14b1a92f6-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.261881 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.261869    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.261983 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.261970    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.262079 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.262066    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-config\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.262191 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.262177    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.262297 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.262285    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.262403 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.262391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2tbg\" (UniqueName: \"kubernetes.io/projected/f3c04184-0141-4c2a-b299-72f14b1a92f6-kube-api-access-t2tbg\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.262530 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.262517    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.262642 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.262628    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.363703 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.363659    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3c04184-0141-4c2a-b299-72f14b1a92f6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.363716    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.363750    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.363780    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.363805    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.363837    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.363868    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.363896    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.363918    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.363941    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.363969    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3c04184-0141-4c2a-b299-72f14b1a92f6-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.364004    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.364035    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.364062    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-config\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.364091    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.364116    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.364166    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2tbg\" (UniqueName: \"kubernetes.io/projected/f3c04184-0141-4c2a-b299-72f14b1a92f6-kube-api-access-t2tbg\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364898 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.364214    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364898 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.364243    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.364898 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.364288    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.365438 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.365406    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.366411 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.366384    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.368657 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.367576    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-web-config\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.368657 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.367632    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.368657 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.367897    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.371577 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.371548    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.373817 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.373225    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.373817 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.373758    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.373817 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.373791    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.374526 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.374483    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.375405 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.375362    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.377308 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.377275    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.378036 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.377989    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-config\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.378856 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.378809    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.381002 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.380688    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.385108 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.385049    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3c04184-0141-4c2a-b299-72f14b1a92f6-config-out\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.385658 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.385632    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3c04184-0141-4c2a-b299-72f14b1a92f6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.387708 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.387679    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.388589 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.388536    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.390619 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.390597    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2tbg\" (UniqueName: \"kubernetes.io/projected/f3c04184-0141-4c2a-b299-72f14b1a92f6-kube-api-access-t2tbg\") pod \"prometheus-k8s-0\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.447635 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.447224    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:33.658468 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:33.658424    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:21:33.660797 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:21:33.660759    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3c04184_0141_4c2a_b299_72f14b1a92f6.slice/crio-fed38a7f893ddaed8977a9d343f4f42577799449d70dd7cd6fd5edbd44a39ff0 WatchSource:0}: Error finding container fed38a7f893ddaed8977a9d343f4f42577799449d70dd7cd6fd5edbd44a39ff0: Status 404 returned error can't find the container with id fed38a7f893ddaed8977a9d343f4f42577799449d70dd7cd6fd5edbd44a39ff0
Jul 06 14:21:34.110991 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:34.110874    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3c04184-0141-4c2a-b299-72f14b1a92f6","Type":"ContainerStarted","Data":"fed38a7f893ddaed8977a9d343f4f42577799449d70dd7cd6fd5edbd44a39ff0"}
Jul 06 14:21:34.122944 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:34.122840    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8f9745d7-sqh66" event={"ID":"1c73be8b-2763-415d-9023-6657f6e07641","Type":"ContainerStarted","Data":"314776904fc7b6d7d4f4aa16ab2e3e9bbfbd31f653c875dc2d1c1076fe34ed2f"}
Jul 06 14:21:34.122944 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:34.122896    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8f9745d7-sqh66" event={"ID":"1c73be8b-2763-415d-9023-6657f6e07641","Type":"ContainerStarted","Data":"cac1854e94457bc4ff65622dcb203da096fce9186f12568e42f2d1077b8a3c64"}
Jul 06 14:21:34.144531 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:34.144470    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d8f9745d7-sqh66" podStartSLOduration=2.144451082 podStartE2EDuration="2.144451082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:34.143738088 +0000 UTC m=+74.992625056" watchObservedRunningTime="2026-07-06 14:21:34.144451082 +0000 UTC m=+74.993338053"
Jul 06 14:21:37.136395 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:37.136356    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r" event={"ID":"d056f006-e607-4b10-ac31-6be5335cdd30","Type":"ContainerStarted","Data":"be9233c65c7b5ba40f4822f86b195306773a867e77714975ff158c4f68bfd561"}
Jul 06 14:21:37.137945 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:37.137922    2562 generic.go:356] "Generic (PLEG): container finished" podID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerID="1f8b75cbb86ca29b07b3c6142f7f6806d464015270bbcb750ec3ca950a18e2d3" exitCode=0
Jul 06 14:21:37.138058 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:37.137991    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9932a76d-f77a-4188-9a5d-8df19d74d0bd","Type":"ContainerDied","Data":"1f8b75cbb86ca29b07b3c6142f7f6806d464015270bbcb750ec3ca950a18e2d3"}
Jul 06 14:21:37.139501 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:37.139477    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cdc2x" event={"ID":"6823ad0b-05cf-4273-8153-559cf91b6fe9","Type":"ContainerStarted","Data":"870df797f08ac592bd6b0c984c1a3e7cd553d23b7016420ab60ee7139c04af38"}
Jul 06 14:21:37.139668 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:37.139638    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cdc2x"
Jul 06 14:21:37.141301 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:37.141281    2562 generic.go:356] "Generic (PLEG): container finished" podID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerID="201445afc6ed4ff03a14566cb438cca981ec840460c264c486b16403c9cea2cd" exitCode=0
Jul 06 14:21:37.141393 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:37.141364    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3c04184-0141-4c2a-b299-72f14b1a92f6","Type":"ContainerDied","Data":"201445afc6ed4ff03a14566cb438cca981ec840460c264c486b16403c9cea2cd"}
Jul 06 14:21:37.143922 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:37.143897    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb" event={"ID":"856454c0-9d89-4109-b616-afe0686391d9","Type":"ContainerStarted","Data":"e2b8495f67b852aaf50eed70e907235e1a2bf0ecc53db950f93543f006dd7de9"}
Jul 06 14:21:37.144020 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:37.143951    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb" event={"ID":"856454c0-9d89-4109-b616-afe0686391d9","Type":"ContainerStarted","Data":"5b243e5b36ee84c4ca226121c0ccd98f84f2d26f8ee73bd38b699d2363871b7b"}
Jul 06 14:21:37.144020 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:37.143973    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb" event={"ID":"856454c0-9d89-4109-b616-afe0686391d9","Type":"ContainerStarted","Data":"f9bad305f660c030732836907fa45a2e4a657985be01e9d459cfd74c62bcc3d2"}
Jul 06 14:21:37.145445 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:37.145426    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cdc2x"
Jul 06 14:21:37.146283 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:37.146263    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8d4778867-7twbx" event={"ID":"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1","Type":"ContainerStarted","Data":"b6cfe0aa8e551fdbc2efcb117dd8ca83eebe8949a30468fa3a83f29614babc04"}
Jul 06 14:21:37.146366 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:37.146310    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8d4778867-7twbx" event={"ID":"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1","Type":"ContainerStarted","Data":"629fd090dda2aed80392971571a1b2647de6ce7d993e941d050a7b87c351e30a"}
Jul 06 14:21:37.146366 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:37.146344    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8d4778867-7twbx" event={"ID":"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1","Type":"ContainerStarted","Data":"54bf10f9c6eb9f6769bbde222c9af3c5b1be10d796310c674ed60d5b92754b59"}
Jul 06 14:21:37.158274 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:37.158227    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r" podStartSLOduration=2.370445085 podStartE2EDuration="6.158213266s" totalImagesPullingTime="3.787768181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:37.156537627 +0000 UTC m=+78.005424598" watchObservedRunningTime="2026-07-06 14:21:37.158213266 +0000 UTC m=+78.007100216"
Jul 06 14:21:37.182461 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:37.182402    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c47c55bb-ndvfb" podStartSLOduration=2.479075049 podStartE2EDuration="6.182384846s" totalImagesPullingTime="3.703309797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:37.180926958 +0000 UTC m=+78.029813930" watchObservedRunningTime="2026-07-06 14:21:37.182384846 +0000 UTC m=+78.031271816"
Jul 06 14:21:37.270563 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:37.270498    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-cdc2x" podStartSLOduration=2.522905014 podStartE2EDuration="6.27048268s" totalImagesPullingTime="3.747577666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:37.2692732 +0000 UTC m=+78.118160183" watchObservedRunningTime="2026-07-06 14:21:37.27048268 +0000 UTC m=+78.119369650"
Jul 06 14:21:38.008373 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:38.007623    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8786bdfdc-wk7v4"]
Jul 06 14:21:38.160564 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:38.160448    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8d4778867-7twbx" event={"ID":"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1","Type":"ContainerStarted","Data":"8747975309d53bd4167977fea3ad1cf21fd2782b8b031b620ba2b7b859b257c3"}
Jul 06 14:21:38.160564 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:38.160553    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8d4778867-7twbx" event={"ID":"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1","Type":"ContainerStarted","Data":"8560a90fb44cfa4884dfda06d6e280edb0f57aa16e0caf91a8a585a6d4c8889b"}
Jul 06 14:21:38.161046 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:38.160593    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8d4778867-7twbx" event={"ID":"3c4e9e65-bc53-4440-bf85-9824b7cfa3e1","Type":"ContainerStarted","Data":"5b48d0448c10fccf0e025b609d009e9c74c5492e548348e1e936616259e902b2"}
Jul 06 14:21:39.165962 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:39.165922    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:42.182483 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:42.182446    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9932a76d-f77a-4188-9a5d-8df19d74d0bd","Type":"ContainerStarted","Data":"e6cff339739c170d80fa7e5aaa313872ae85118a90c54a2d0cf7420b245826e7"}
Jul 06 14:21:42.182961 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:42.182529    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9932a76d-f77a-4188-9a5d-8df19d74d0bd","Type":"ContainerStarted","Data":"de7c1139ddccf976a610bc981082ce1947c037a81000f4b5b98ac0f08b035027"}
Jul 06 14:21:42.182961 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:42.182563    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9932a76d-f77a-4188-9a5d-8df19d74d0bd","Type":"ContainerStarted","Data":"cbf49f762299122a79237b3654caa509754abf26c51b475010172ffbbe173ff3"}
Jul 06 14:21:42.182961 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:42.182596    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9932a76d-f77a-4188-9a5d-8df19d74d0bd","Type":"ContainerStarted","Data":"7c52ec190a8a5578e5145b444ecba9a4f560d118226ff69ca29176ce9e73e99e"}
Jul 06 14:21:42.182961 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:42.182631    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9932a76d-f77a-4188-9a5d-8df19d74d0bd","Type":"ContainerStarted","Data":"4f3e12217daab94466c06b1638583f7e547dd4cd1c301e69dd17b8e899afd978"}
Jul 06 14:21:42.182961 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:42.182674    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9932a76d-f77a-4188-9a5d-8df19d74d0bd","Type":"ContainerStarted","Data":"52909c467ddd06a1900281ae67ddd94c54128c9691c76c5dfa334178f9b81323"}
Jul 06 14:21:42.185839 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:42.185814    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3c04184-0141-4c2a-b299-72f14b1a92f6","Type":"ContainerStarted","Data":"bee327c28530db73619fd677266db3faa2b23f2f093e2fe358a643635ed4781f"}
Jul 06 14:21:42.185931 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:42.185869    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3c04184-0141-4c2a-b299-72f14b1a92f6","Type":"ContainerStarted","Data":"c50bdde7ef17c486011ff11da9788ef63a865efaad626ec6ad7bf97a217e74f7"}
Jul 06 14:21:42.185931 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:42.185897    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3c04184-0141-4c2a-b299-72f14b1a92f6","Type":"ContainerStarted","Data":"b15d5c798b04ca44d0df4a1b7c253eca9766e8e927d2b23bc59abd7c6e6066b6"}
Jul 06 14:21:42.185931 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:42.185921    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3c04184-0141-4c2a-b299-72f14b1a92f6","Type":"ContainerStarted","Data":"0ea46b75bdb4494cb80ca3de54fceba02090f4535d0f3d733d3b4e7cc803d37a"}
Jul 06 14:21:42.186038 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:42.185943    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3c04184-0141-4c2a-b299-72f14b1a92f6","Type":"ContainerStarted","Data":"b463ed2dc758547fa9b68c09dc8b56e3e723963aa477e357e663fefe20f8907b"}
Jul 06 14:21:42.186038 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:42.185964    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3c04184-0141-4c2a-b299-72f14b1a92f6","Type":"ContainerStarted","Data":"cd286a2d1abef5f7d340b15c95e81b3c7df7f2cc5a0be2ec9d9e775d3d64a2de"}
Jul 06 14:21:42.218826 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:42.218764    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.546278918 podStartE2EDuration="15.218743234s" totalImagesPullingTime="7.635871859s" totalInitContainerRuntime="36.592457ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:42.218057223 +0000 UTC m=+83.066944194" watchObservedRunningTime="2026-07-06 14:21:42.218743234 +0000 UTC m=+83.067630206"
Jul 06 14:21:42.219763 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:42.219726    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8d4778867-7twbx" podStartSLOduration=8.417105921 podStartE2EDuration="13.219716505s" totalImagesPullingTime="4.802610584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:38.185844277 +0000 UTC m=+79.034731249" watchObservedRunningTime="2026-07-06 14:21:42.219716505 +0000 UTC m=+83.068603476"
Jul 06 14:21:42.282286 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:42.282222    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.466926036 podStartE2EDuration="9.28213902s" totalImagesPullingTime="6.778282132s" totalInitContainerRuntime="36.930852ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:21:42.279647585 +0000 UTC m=+83.128534556" watchObservedRunningTime="2026-07-06 14:21:42.28213902 +0000 UTC m=+83.131025984"
Jul 06 14:21:42.978283 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:42.978243    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:42.978450 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:42.978331    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:42.983391 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:42.983364    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:43.194632 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:43.194604    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:21:43.448105 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:43.448013    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:21:45.176538 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:45.176507    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8d4778867-7twbx"
Jul 06 14:21:49.040996 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:49.040963    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d8f9745d7-sqh66"]
Jul 06 14:21:51.375535 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:51.375503    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:51.375993 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:51.375564    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:21:57.610611 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:57.610545    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-78d4dbff79-24gg6" podUID="a4eb27c1-8747-4396-9cb7-84f5aedb5509" containerName="console" containerID="cri-o://7ecd5ca33744bc4434683a18232f3e59d996a91fd1cce52daaeef35a67c1afa9" gracePeriod=15
Jul 06 14:21:57.865060 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:57.864997    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:57.911654 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:57.911625    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4eb27c1-8747-4396-9cb7-84f5aedb5509-service-ca\") pod \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") "
Jul 06 14:21:57.911820 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:57.911684    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4eb27c1-8747-4396-9cb7-84f5aedb5509-console-serving-cert\") pod \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") "
Jul 06 14:21:57.911820 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:57.911702    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4eb27c1-8747-4396-9cb7-84f5aedb5509-console-oauth-config\") pod \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") "
Jul 06 14:21:57.911820 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:57.911800    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4eb27c1-8747-4396-9cb7-84f5aedb5509-console-config\") pod \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") "
Jul 06 14:21:57.911968 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:57.911825    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj2td\" (UniqueName: \"kubernetes.io/projected/a4eb27c1-8747-4396-9cb7-84f5aedb5509-kube-api-access-qj2td\") pod \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") "
Jul 06 14:21:57.911968 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:57.911869    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4eb27c1-8747-4396-9cb7-84f5aedb5509-oauth-serving-cert\") pod \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\" (UID: \"a4eb27c1-8747-4396-9cb7-84f5aedb5509\") "
Jul 06 14:21:57.912219 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:57.912138    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4eb27c1-8747-4396-9cb7-84f5aedb5509-service-ca" (OuterVolumeSpecName: "service-ca") pod "a4eb27c1-8747-4396-9cb7-84f5aedb5509" (UID: "a4eb27c1-8747-4396-9cb7-84f5aedb5509"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:21:57.912314 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:57.912243    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4eb27c1-8747-4396-9cb7-84f5aedb5509-console-config" (OuterVolumeSpecName: "console-config") pod "a4eb27c1-8747-4396-9cb7-84f5aedb5509" (UID: "a4eb27c1-8747-4396-9cb7-84f5aedb5509"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:21:57.912356 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:57.912332    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4eb27c1-8747-4396-9cb7-84f5aedb5509-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a4eb27c1-8747-4396-9cb7-84f5aedb5509" (UID: "a4eb27c1-8747-4396-9cb7-84f5aedb5509"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:21:57.914352 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:57.914326    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4eb27c1-8747-4396-9cb7-84f5aedb5509-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a4eb27c1-8747-4396-9cb7-84f5aedb5509" (UID: "a4eb27c1-8747-4396-9cb7-84f5aedb5509"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:21:57.914664 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:57.914635    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4eb27c1-8747-4396-9cb7-84f5aedb5509-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a4eb27c1-8747-4396-9cb7-84f5aedb5509" (UID: "a4eb27c1-8747-4396-9cb7-84f5aedb5509"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:21:57.914734 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:57.914653    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4eb27c1-8747-4396-9cb7-84f5aedb5509-kube-api-access-qj2td" (OuterVolumeSpecName: "kube-api-access-qj2td") pod "a4eb27c1-8747-4396-9cb7-84f5aedb5509" (UID: "a4eb27c1-8747-4396-9cb7-84f5aedb5509"). InnerVolumeSpecName "kube-api-access-qj2td". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:21:58.012750 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:58.012696    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4eb27c1-8747-4396-9cb7-84f5aedb5509-console-config\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:21:58.012750 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:58.012743    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj2td\" (UniqueName: \"kubernetes.io/projected/a4eb27c1-8747-4396-9cb7-84f5aedb5509-kube-api-access-qj2td\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:21:58.012750 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:58.012758    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4eb27c1-8747-4396-9cb7-84f5aedb5509-oauth-serving-cert\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:21:58.013012 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:58.012770    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4eb27c1-8747-4396-9cb7-84f5aedb5509-service-ca\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:21:58.013012 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:58.012782    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4eb27c1-8747-4396-9cb7-84f5aedb5509-console-serving-cert\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:21:58.013012 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:58.012792    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4eb27c1-8747-4396-9cb7-84f5aedb5509-console-oauth-config\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:21:58.258983 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:58.258946    2562 generic.go:356] "Generic (PLEG): container finished" podID="a4eb27c1-8747-4396-9cb7-84f5aedb5509" containerID="7ecd5ca33744bc4434683a18232f3e59d996a91fd1cce52daaeef35a67c1afa9" exitCode=0
Jul 06 14:21:58.259204 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:58.258991    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d4dbff79-24gg6"
Jul 06 14:21:58.259204 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:58.258997    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d4dbff79-24gg6" event={"ID":"a4eb27c1-8747-4396-9cb7-84f5aedb5509","Type":"ContainerDied","Data":"7ecd5ca33744bc4434683a18232f3e59d996a91fd1cce52daaeef35a67c1afa9"}
Jul 06 14:21:58.259204 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:58.259048    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d4dbff79-24gg6" event={"ID":"a4eb27c1-8747-4396-9cb7-84f5aedb5509","Type":"ContainerDied","Data":"1e6efa3c347eed2f9b59ea5738167a595938ab2bf29535c8fd359da5a6f2cbda"}
Jul 06 14:21:58.259204 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:58.259074    2562 scope.go:117] "RemoveContainer" containerID="7ecd5ca33744bc4434683a18232f3e59d996a91fd1cce52daaeef35a67c1afa9"
Jul 06 14:21:58.269019 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:58.268999    2562 scope.go:117] "RemoveContainer" containerID="7ecd5ca33744bc4434683a18232f3e59d996a91fd1cce52daaeef35a67c1afa9"
Jul 06 14:21:58.269645 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:21:58.269622    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ecd5ca33744bc4434683a18232f3e59d996a91fd1cce52daaeef35a67c1afa9\": container with ID starting with 7ecd5ca33744bc4434683a18232f3e59d996a91fd1cce52daaeef35a67c1afa9 not found: ID does not exist" containerID="7ecd5ca33744bc4434683a18232f3e59d996a91fd1cce52daaeef35a67c1afa9"
Jul 06 14:21:58.269854 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:58.269801    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ecd5ca33744bc4434683a18232f3e59d996a91fd1cce52daaeef35a67c1afa9"} err="failed to get container status \"7ecd5ca33744bc4434683a18232f3e59d996a91fd1cce52daaeef35a67c1afa9\": rpc error: code = NotFound desc = could not find container \"7ecd5ca33744bc4434683a18232f3e59d996a91fd1cce52daaeef35a67c1afa9\": container with ID starting with 7ecd5ca33744bc4434683a18232f3e59d996a91fd1cce52daaeef35a67c1afa9 not found: ID does not exist"
Jul 06 14:21:58.292271 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:58.292241    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78d4dbff79-24gg6"]
Jul 06 14:21:58.293586 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:58.293566    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78d4dbff79-24gg6"]
Jul 06 14:21:59.745791 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:21:59.745761    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4eb27c1-8747-4396-9cb7-84f5aedb5509" path="/var/lib/kubelet/pods/a4eb27c1-8747-4396-9cb7-84f5aedb5509/volumes"
Jul 06 14:22:03.043648 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.043584    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8786bdfdc-wk7v4" podUID="d275f915-be0b-429a-81c1-63b2bb09053b" containerName="console" containerID="cri-o://12b759cca5bf7e4728fe335ee9b1cc2f8040d38b89e5756d70582787801fbb86" gracePeriod=15
Jul 06 14:22:03.286659 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.286627    2562 generic.go:356] "Generic (PLEG): container finished" podID="d275f915-be0b-429a-81c1-63b2bb09053b" containerID="12b759cca5bf7e4728fe335ee9b1cc2f8040d38b89e5756d70582787801fbb86" exitCode=0
Jul 06 14:22:03.286818 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.286697    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8786bdfdc-wk7v4" event={"ID":"d275f915-be0b-429a-81c1-63b2bb09053b","Type":"ContainerDied","Data":"12b759cca5bf7e4728fe335ee9b1cc2f8040d38b89e5756d70582787801fbb86"}
Jul 06 14:22:03.332783 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.332752    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:22:03.463108 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.463072    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nq6pv\" (UniqueName: \"kubernetes.io/projected/d275f915-be0b-429a-81c1-63b2bb09053b-kube-api-access-nq6pv\") pod \"d275f915-be0b-429a-81c1-63b2bb09053b\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") "
Jul 06 14:22:03.463315 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.463131    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d275f915-be0b-429a-81c1-63b2bb09053b-console-serving-cert\") pod \"d275f915-be0b-429a-81c1-63b2bb09053b\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") "
Jul 06 14:22:03.463315 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.463184    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d275f915-be0b-429a-81c1-63b2bb09053b-console-oauth-config\") pod \"d275f915-be0b-429a-81c1-63b2bb09053b\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") "
Jul 06 14:22:03.463315 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.463215    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-trusted-ca-bundle\") pod \"d275f915-be0b-429a-81c1-63b2bb09053b\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") "
Jul 06 14:22:03.463315 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.463236    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-oauth-serving-cert\") pod \"d275f915-be0b-429a-81c1-63b2bb09053b\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") "
Jul 06 14:22:03.463315 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.463277    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-console-config\") pod \"d275f915-be0b-429a-81c1-63b2bb09053b\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") "
Jul 06 14:22:03.463315 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.463310    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-service-ca\") pod \"d275f915-be0b-429a-81c1-63b2bb09053b\" (UID: \"d275f915-be0b-429a-81c1-63b2bb09053b\") "
Jul 06 14:22:03.463694 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.463656    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d275f915-be0b-429a-81c1-63b2bb09053b" (UID: "d275f915-be0b-429a-81c1-63b2bb09053b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:22:03.463694 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.463680    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d275f915-be0b-429a-81c1-63b2bb09053b" (UID: "d275f915-be0b-429a-81c1-63b2bb09053b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:22:03.463879 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.463692    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-console-config" (OuterVolumeSpecName: "console-config") pod "d275f915-be0b-429a-81c1-63b2bb09053b" (UID: "d275f915-be0b-429a-81c1-63b2bb09053b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:22:03.464123 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.464099    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-service-ca" (OuterVolumeSpecName: "service-ca") pod "d275f915-be0b-429a-81c1-63b2bb09053b" (UID: "d275f915-be0b-429a-81c1-63b2bb09053b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:22:03.465506 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.465483    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d275f915-be0b-429a-81c1-63b2bb09053b-kube-api-access-nq6pv" (OuterVolumeSpecName: "kube-api-access-nq6pv") pod "d275f915-be0b-429a-81c1-63b2bb09053b" (UID: "d275f915-be0b-429a-81c1-63b2bb09053b"). InnerVolumeSpecName "kube-api-access-nq6pv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:22:03.465617 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.465596    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d275f915-be0b-429a-81c1-63b2bb09053b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d275f915-be0b-429a-81c1-63b2bb09053b" (UID: "d275f915-be0b-429a-81c1-63b2bb09053b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:03.465665 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.465631    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d275f915-be0b-429a-81c1-63b2bb09053b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d275f915-be0b-429a-81c1-63b2bb09053b" (UID: "d275f915-be0b-429a-81c1-63b2bb09053b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:03.564788 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.564701    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d275f915-be0b-429a-81c1-63b2bb09053b-console-serving-cert\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:03.564788 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.564732    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d275f915-be0b-429a-81c1-63b2bb09053b-console-oauth-config\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:03.564788 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.564743    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-trusted-ca-bundle\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:03.564788 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.564751    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-oauth-serving-cert\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:03.564788 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.564760    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-console-config\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:03.564788 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.564768    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d275f915-be0b-429a-81c1-63b2bb09053b-service-ca\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:03.564788 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:03.564776    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nq6pv\" (UniqueName: \"kubernetes.io/projected/d275f915-be0b-429a-81c1-63b2bb09053b-kube-api-access-nq6pv\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:04.128086 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:04.128056    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vvs2w"
Jul 06 14:22:04.291998 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:04.291959    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8786bdfdc-wk7v4" event={"ID":"d275f915-be0b-429a-81c1-63b2bb09053b","Type":"ContainerDied","Data":"542c86f2b86fd254455e892715c80fcaf7d309fe147777659f5b7933eff4c3b8"}
Jul 06 14:22:04.291998 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:04.291990    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8786bdfdc-wk7v4"
Jul 06 14:22:04.292219 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:04.292022    2562 scope.go:117] "RemoveContainer" containerID="12b759cca5bf7e4728fe335ee9b1cc2f8040d38b89e5756d70582787801fbb86"
Jul 06 14:22:04.310720 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:04.310690    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8786bdfdc-wk7v4"]
Jul 06 14:22:04.312975 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:04.312952    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8786bdfdc-wk7v4"]
Jul 06 14:22:05.746041 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:05.746009    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d275f915-be0b-429a-81c1-63b2bb09053b" path="/var/lib/kubelet/pods/d275f915-be0b-429a-81c1-63b2bb09053b/volumes"
Jul 06 14:22:11.380610 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:11.380579    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:22:11.384461 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:11.384425    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5496dc54b8-7xg7r"
Jul 06 14:22:14.063919 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.063854    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d8f9745d7-sqh66" podUID="1c73be8b-2763-415d-9023-6657f6e07641" containerName="console" containerID="cri-o://314776904fc7b6d7d4f4aa16ab2e3e9bbfbd31f653c875dc2d1c1076fe34ed2f" gracePeriod=15
Jul 06 14:22:14.305843 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.305819    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:22:14.336236 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.336128    2562 generic.go:356] "Generic (PLEG): container finished" podID="1c73be8b-2763-415d-9023-6657f6e07641" containerID="314776904fc7b6d7d4f4aa16ab2e3e9bbfbd31f653c875dc2d1c1076fe34ed2f" exitCode=0
Jul 06 14:22:14.336236 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.336197    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8f9745d7-sqh66"
Jul 06 14:22:14.336236 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.336221    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8f9745d7-sqh66" event={"ID":"1c73be8b-2763-415d-9023-6657f6e07641","Type":"ContainerDied","Data":"314776904fc7b6d7d4f4aa16ab2e3e9bbfbd31f653c875dc2d1c1076fe34ed2f"}
Jul 06 14:22:14.336559 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.336283    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8f9745d7-sqh66" event={"ID":"1c73be8b-2763-415d-9023-6657f6e07641","Type":"ContainerDied","Data":"cac1854e94457bc4ff65622dcb203da096fce9186f12568e42f2d1077b8a3c64"}
Jul 06 14:22:14.336559 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.336310    2562 scope.go:117] "RemoveContainer" containerID="314776904fc7b6d7d4f4aa16ab2e3e9bbfbd31f653c875dc2d1c1076fe34ed2f"
Jul 06 14:22:14.346542 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.346522    2562 scope.go:117] "RemoveContainer" containerID="314776904fc7b6d7d4f4aa16ab2e3e9bbfbd31f653c875dc2d1c1076fe34ed2f"
Jul 06 14:22:14.346902 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:22:14.346883    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"314776904fc7b6d7d4f4aa16ab2e3e9bbfbd31f653c875dc2d1c1076fe34ed2f\": container with ID starting with 314776904fc7b6d7d4f4aa16ab2e3e9bbfbd31f653c875dc2d1c1076fe34ed2f not found: ID does not exist" containerID="314776904fc7b6d7d4f4aa16ab2e3e9bbfbd31f653c875dc2d1c1076fe34ed2f"
Jul 06 14:22:14.346950 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.346912    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"314776904fc7b6d7d4f4aa16ab2e3e9bbfbd31f653c875dc2d1c1076fe34ed2f"} err="failed to get container status \"314776904fc7b6d7d4f4aa16ab2e3e9bbfbd31f653c875dc2d1c1076fe34ed2f\": rpc error: code = NotFound desc = could not find container \"314776904fc7b6d7d4f4aa16ab2e3e9bbfbd31f653c875dc2d1c1076fe34ed2f\": container with ID starting with 314776904fc7b6d7d4f4aa16ab2e3e9bbfbd31f653c875dc2d1c1076fe34ed2f not found: ID does not exist"
Jul 06 14:22:14.465048 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.465009    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-service-ca\") pod \"1c73be8b-2763-415d-9023-6657f6e07641\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") "
Jul 06 14:22:14.465048 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.465054    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-console-config\") pod \"1c73be8b-2763-415d-9023-6657f6e07641\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") "
Jul 06 14:22:14.465328 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.465090    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-oauth-serving-cert\") pod \"1c73be8b-2763-415d-9023-6657f6e07641\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") "
Jul 06 14:22:14.465328 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.465167    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96qx8\" (UniqueName: \"kubernetes.io/projected/1c73be8b-2763-415d-9023-6657f6e07641-kube-api-access-96qx8\") pod \"1c73be8b-2763-415d-9023-6657f6e07641\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") "
Jul 06 14:22:14.465328 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.465183    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-trusted-ca-bundle\") pod \"1c73be8b-2763-415d-9023-6657f6e07641\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") "
Jul 06 14:22:14.465328 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.465205    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c73be8b-2763-415d-9023-6657f6e07641-console-serving-cert\") pod \"1c73be8b-2763-415d-9023-6657f6e07641\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") "
Jul 06 14:22:14.465328 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.465228    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c73be8b-2763-415d-9023-6657f6e07641-console-oauth-config\") pod \"1c73be8b-2763-415d-9023-6657f6e07641\" (UID: \"1c73be8b-2763-415d-9023-6657f6e07641\") "
Jul 06 14:22:14.465611 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.465587    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-service-ca" (OuterVolumeSpecName: "service-ca") pod "1c73be8b-2763-415d-9023-6657f6e07641" (UID: "1c73be8b-2763-415d-9023-6657f6e07641"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:22:14.465684 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.465640    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-console-config" (OuterVolumeSpecName: "console-config") pod "1c73be8b-2763-415d-9023-6657f6e07641" (UID: "1c73be8b-2763-415d-9023-6657f6e07641"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:22:14.465684 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.465649    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1c73be8b-2763-415d-9023-6657f6e07641" (UID: "1c73be8b-2763-415d-9023-6657f6e07641"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:22:14.465684 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.465658    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1c73be8b-2763-415d-9023-6657f6e07641" (UID: "1c73be8b-2763-415d-9023-6657f6e07641"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:22:14.467647 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.467616    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c73be8b-2763-415d-9023-6657f6e07641-kube-api-access-96qx8" (OuterVolumeSpecName: "kube-api-access-96qx8") pod "1c73be8b-2763-415d-9023-6657f6e07641" (UID: "1c73be8b-2763-415d-9023-6657f6e07641"). InnerVolumeSpecName "kube-api-access-96qx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:22:14.467647 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.467617    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c73be8b-2763-415d-9023-6657f6e07641-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1c73be8b-2763-415d-9023-6657f6e07641" (UID: "1c73be8b-2763-415d-9023-6657f6e07641"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:14.467780 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.467652    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c73be8b-2763-415d-9023-6657f6e07641-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1c73be8b-2763-415d-9023-6657f6e07641" (UID: "1c73be8b-2763-415d-9023-6657f6e07641"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:14.566689 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.566650    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96qx8\" (UniqueName: \"kubernetes.io/projected/1c73be8b-2763-415d-9023-6657f6e07641-kube-api-access-96qx8\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:14.566689 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.566682    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-trusted-ca-bundle\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:14.566689 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.566692    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c73be8b-2763-415d-9023-6657f6e07641-console-serving-cert\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:14.566689 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.566700    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c73be8b-2763-415d-9023-6657f6e07641-console-oauth-config\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:14.566942 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.566710    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-service-ca\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:14.566942 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.566718    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-console-config\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:14.566942 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.566726    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c73be8b-2763-415d-9023-6657f6e07641-oauth-serving-cert\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:14.657631 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.657603    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d8f9745d7-sqh66"]
Jul 06 14:22:14.661116 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:14.661092    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d8f9745d7-sqh66"]
Jul 06 14:22:15.746210 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:15.746176    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c73be8b-2763-415d-9023-6657f6e07641" path="/var/lib/kubelet/pods/1c73be8b-2763-415d-9023-6657f6e07641/volumes"
Jul 06 14:22:33.448452 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:33.448409    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:33.473538 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:33.473510    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:34.442661 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:34.442637    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:47.374998 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:47.374962    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:22:47.375462 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:47.375300    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="alertmanager" containerID="cri-o://52909c467ddd06a1900281ae67ddd94c54128c9691c76c5dfa334178f9b81323" gracePeriod=120
Jul 06 14:22:47.375462 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:47.375375    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="kube-rbac-proxy-metric" containerID="cri-o://de7c1139ddccf976a610bc981082ce1947c037a81000f4b5b98ac0f08b035027" gracePeriod=120
Jul 06 14:22:47.375462 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:47.375411    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="kube-rbac-proxy" containerID="cri-o://cbf49f762299122a79237b3654caa509754abf26c51b475010172ffbbe173ff3" gracePeriod=120
Jul 06 14:22:47.375462 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:47.375410    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="kube-rbac-proxy-web" containerID="cri-o://7c52ec190a8a5578e5145b444ecba9a4f560d118226ff69ca29176ce9e73e99e" gracePeriod=120
Jul 06 14:22:47.375669 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:47.375478    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="config-reloader" containerID="cri-o://4f3e12217daab94466c06b1638583f7e547dd4cd1c301e69dd17b8e899afd978" gracePeriod=120
Jul 06 14:22:47.375669 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:47.375519    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="prom-label-proxy" containerID="cri-o://e6cff339739c170d80fa7e5aaa313872ae85118a90c54a2d0cf7420b245826e7" gracePeriod=120
Jul 06 14:22:48.484313 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.484279    2562 generic.go:356] "Generic (PLEG): container finished" podID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerID="e6cff339739c170d80fa7e5aaa313872ae85118a90c54a2d0cf7420b245826e7" exitCode=0
Jul 06 14:22:48.484313 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.484303    2562 generic.go:356] "Generic (PLEG): container finished" podID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerID="de7c1139ddccf976a610bc981082ce1947c037a81000f4b5b98ac0f08b035027" exitCode=0
Jul 06 14:22:48.484313 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.484312    2562 generic.go:356] "Generic (PLEG): container finished" podID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerID="cbf49f762299122a79237b3654caa509754abf26c51b475010172ffbbe173ff3" exitCode=0
Jul 06 14:22:48.484313 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.484321    2562 generic.go:356] "Generic (PLEG): container finished" podID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerID="4f3e12217daab94466c06b1638583f7e547dd4cd1c301e69dd17b8e899afd978" exitCode=0
Jul 06 14:22:48.484313 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.484328    2562 generic.go:356] "Generic (PLEG): container finished" podID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerID="52909c467ddd06a1900281ae67ddd94c54128c9691c76c5dfa334178f9b81323" exitCode=0
Jul 06 14:22:48.484991 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.484347    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9932a76d-f77a-4188-9a5d-8df19d74d0bd","Type":"ContainerDied","Data":"e6cff339739c170d80fa7e5aaa313872ae85118a90c54a2d0cf7420b245826e7"}
Jul 06 14:22:48.484991 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.484412    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9932a76d-f77a-4188-9a5d-8df19d74d0bd","Type":"ContainerDied","Data":"de7c1139ddccf976a610bc981082ce1947c037a81000f4b5b98ac0f08b035027"}
Jul 06 14:22:48.484991 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.484440    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9932a76d-f77a-4188-9a5d-8df19d74d0bd","Type":"ContainerDied","Data":"cbf49f762299122a79237b3654caa509754abf26c51b475010172ffbbe173ff3"}
Jul 06 14:22:48.484991 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.484465    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9932a76d-f77a-4188-9a5d-8df19d74d0bd","Type":"ContainerDied","Data":"4f3e12217daab94466c06b1638583f7e547dd4cd1c301e69dd17b8e899afd978"}
Jul 06 14:22:48.484991 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.484488    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9932a76d-f77a-4188-9a5d-8df19d74d0bd","Type":"ContainerDied","Data":"52909c467ddd06a1900281ae67ddd94c54128c9691c76c5dfa334178f9b81323"}
Jul 06 14:22:48.625455 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.625430    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:48.768475 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.768422    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9932a76d-f77a-4188-9a5d-8df19d74d0bd-alertmanager-trusted-ca-bundle\") pod \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") "
Jul 06 14:22:48.768659 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.768521    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-config-volume\") pod \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") "
Jul 06 14:22:48.768659 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.768569    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9932a76d-f77a-4188-9a5d-8df19d74d0bd-alertmanager-main-db\") pod \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") "
Jul 06 14:22:48.768659 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.768593    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-cluster-tls-config\") pod \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") "
Jul 06 14:22:48.768659 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.768627    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9932a76d-f77a-4188-9a5d-8df19d74d0bd-config-out\") pod \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") "
Jul 06 14:22:48.768659 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.768651    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-kube-rbac-proxy\") pod \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") "
Jul 06 14:22:48.768893 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.768690    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-web-config\") pod \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") "
Jul 06 14:22:48.768893 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.768726    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") "
Jul 06 14:22:48.768893 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.768764    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-main-tls\") pod \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") "
Jul 06 14:22:48.768893 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.768826    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9932a76d-f77a-4188-9a5d-8df19d74d0bd-metrics-client-ca\") pod \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") "
Jul 06 14:22:48.768893 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.768860    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9932a76d-f77a-4188-9a5d-8df19d74d0bd-tls-assets\") pod \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") "
Jul 06 14:22:48.769139 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.768894    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxs2f\" (UniqueName: \"kubernetes.io/projected/9932a76d-f77a-4188-9a5d-8df19d74d0bd-kube-api-access-zxs2f\") pod \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") "
Jul 06 14:22:48.769139 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.768901    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9932a76d-f77a-4188-9a5d-8df19d74d0bd-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9932a76d-f77a-4188-9a5d-8df19d74d0bd" (UID: "9932a76d-f77a-4188-9a5d-8df19d74d0bd"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:22:48.769139 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.768924    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-kube-rbac-proxy-web\") pod \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\" (UID: \"9932a76d-f77a-4188-9a5d-8df19d74d0bd\") "
Jul 06 14:22:48.769139 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.768923    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9932a76d-f77a-4188-9a5d-8df19d74d0bd-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9932a76d-f77a-4188-9a5d-8df19d74d0bd" (UID: "9932a76d-f77a-4188-9a5d-8df19d74d0bd"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:22:48.769399 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.769213    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9932a76d-f77a-4188-9a5d-8df19d74d0bd-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:48.769399 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.769234    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9932a76d-f77a-4188-9a5d-8df19d74d0bd-alertmanager-main-db\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:48.769993 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.769868    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9932a76d-f77a-4188-9a5d-8df19d74d0bd-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9932a76d-f77a-4188-9a5d-8df19d74d0bd" (UID: "9932a76d-f77a-4188-9a5d-8df19d74d0bd"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:22:48.771980 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.771953    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-config-volume" (OuterVolumeSpecName: "config-volume") pod "9932a76d-f77a-4188-9a5d-8df19d74d0bd" (UID: "9932a76d-f77a-4188-9a5d-8df19d74d0bd"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:48.772244 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.772210    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9932a76d-f77a-4188-9a5d-8df19d74d0bd-config-out" (OuterVolumeSpecName: "config-out") pod "9932a76d-f77a-4188-9a5d-8df19d74d0bd" (UID: "9932a76d-f77a-4188-9a5d-8df19d74d0bd"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:22:48.772362 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.772297    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9932a76d-f77a-4188-9a5d-8df19d74d0bd" (UID: "9932a76d-f77a-4188-9a5d-8df19d74d0bd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:48.772514 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.772492    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9932a76d-f77a-4188-9a5d-8df19d74d0bd" (UID: "9932a76d-f77a-4188-9a5d-8df19d74d0bd"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:48.772794 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.772754    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9932a76d-f77a-4188-9a5d-8df19d74d0bd" (UID: "9932a76d-f77a-4188-9a5d-8df19d74d0bd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:48.772874 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.772815    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9932a76d-f77a-4188-9a5d-8df19d74d0bd" (UID: "9932a76d-f77a-4188-9a5d-8df19d74d0bd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:48.773955 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.773935    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9932a76d-f77a-4188-9a5d-8df19d74d0bd-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9932a76d-f77a-4188-9a5d-8df19d74d0bd" (UID: "9932a76d-f77a-4188-9a5d-8df19d74d0bd"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:22:48.774729 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.774665    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9932a76d-f77a-4188-9a5d-8df19d74d0bd-kube-api-access-zxs2f" (OuterVolumeSpecName: "kube-api-access-zxs2f") pod "9932a76d-f77a-4188-9a5d-8df19d74d0bd" (UID: "9932a76d-f77a-4188-9a5d-8df19d74d0bd"). InnerVolumeSpecName "kube-api-access-zxs2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:22:48.776260 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.776229    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9932a76d-f77a-4188-9a5d-8df19d74d0bd" (UID: "9932a76d-f77a-4188-9a5d-8df19d74d0bd"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:48.783011 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.782981    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-web-config" (OuterVolumeSpecName: "web-config") pod "9932a76d-f77a-4188-9a5d-8df19d74d0bd" (UID: "9932a76d-f77a-4188-9a5d-8df19d74d0bd"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:48.870554 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.870515    2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-config-volume\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:48.870554 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.870547    2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-cluster-tls-config\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:48.870554 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.870557    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9932a76d-f77a-4188-9a5d-8df19d74d0bd-config-out\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:48.870554 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.870567    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:48.870832 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.870576    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-web-config\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:48.870832 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.870585    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:48.870832 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.870594    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-main-tls\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:48.870832 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.870604    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9932a76d-f77a-4188-9a5d-8df19d74d0bd-metrics-client-ca\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:48.870832 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.870612    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9932a76d-f77a-4188-9a5d-8df19d74d0bd-tls-assets\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:48.870832 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.870620    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxs2f\" (UniqueName: \"kubernetes.io/projected/9932a76d-f77a-4188-9a5d-8df19d74d0bd-kube-api-access-zxs2f\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:48.870832 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:48.870627    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9932a76d-f77a-4188-9a5d-8df19d74d0bd-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:49.491661 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.491626    2562 generic.go:356] "Generic (PLEG): container finished" podID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerID="7c52ec190a8a5578e5145b444ecba9a4f560d118226ff69ca29176ce9e73e99e" exitCode=0
Jul 06 14:22:49.492028 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.491691    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9932a76d-f77a-4188-9a5d-8df19d74d0bd","Type":"ContainerDied","Data":"7c52ec190a8a5578e5145b444ecba9a4f560d118226ff69ca29176ce9e73e99e"}
Jul 06 14:22:49.492028 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.491727    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.492028 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.491772    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9932a76d-f77a-4188-9a5d-8df19d74d0bd","Type":"ContainerDied","Data":"1b28e768fc372086092ff8e06288096cf644febdc9d1d82671d880944352704a"}
Jul 06 14:22:49.492028 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.491804    2562 scope.go:117] "RemoveContainer" containerID="e6cff339739c170d80fa7e5aaa313872ae85118a90c54a2d0cf7420b245826e7"
Jul 06 14:22:49.499787 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.499656    2562 scope.go:117] "RemoveContainer" containerID="de7c1139ddccf976a610bc981082ce1947c037a81000f4b5b98ac0f08b035027"
Jul 06 14:22:49.508753 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.508715    2562 scope.go:117] "RemoveContainer" containerID="cbf49f762299122a79237b3654caa509754abf26c51b475010172ffbbe173ff3"
Jul 06 14:22:49.516402 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.516367    2562 scope.go:117] "RemoveContainer" containerID="7c52ec190a8a5578e5145b444ecba9a4f560d118226ff69ca29176ce9e73e99e"
Jul 06 14:22:49.520425 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.520400    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:22:49.525128 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.525037    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:22:49.525215 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.525180    2562 scope.go:117] "RemoveContainer" containerID="4f3e12217daab94466c06b1638583f7e547dd4cd1c301e69dd17b8e899afd978"
Jul 06 14:22:49.532828 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.532811    2562 scope.go:117] "RemoveContainer" containerID="52909c467ddd06a1900281ae67ddd94c54128c9691c76c5dfa334178f9b81323"
Jul 06 14:22:49.540104 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.540083    2562 scope.go:117] "RemoveContainer" containerID="1f8b75cbb86ca29b07b3c6142f7f6806d464015270bbcb750ec3ca950a18e2d3"
Jul 06 14:22:49.547528 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.547510    2562 scope.go:117] "RemoveContainer" containerID="e6cff339739c170d80fa7e5aaa313872ae85118a90c54a2d0cf7420b245826e7"
Jul 06 14:22:49.547821 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:22:49.547800    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6cff339739c170d80fa7e5aaa313872ae85118a90c54a2d0cf7420b245826e7\": container with ID starting with e6cff339739c170d80fa7e5aaa313872ae85118a90c54a2d0cf7420b245826e7 not found: ID does not exist" containerID="e6cff339739c170d80fa7e5aaa313872ae85118a90c54a2d0cf7420b245826e7"
Jul 06 14:22:49.547877 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.547831    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6cff339739c170d80fa7e5aaa313872ae85118a90c54a2d0cf7420b245826e7"} err="failed to get container status \"e6cff339739c170d80fa7e5aaa313872ae85118a90c54a2d0cf7420b245826e7\": rpc error: code = NotFound desc = could not find container \"e6cff339739c170d80fa7e5aaa313872ae85118a90c54a2d0cf7420b245826e7\": container with ID starting with e6cff339739c170d80fa7e5aaa313872ae85118a90c54a2d0cf7420b245826e7 not found: ID does not exist"
Jul 06 14:22:49.547877 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.547852    2562 scope.go:117] "RemoveContainer" containerID="de7c1139ddccf976a610bc981082ce1947c037a81000f4b5b98ac0f08b035027"
Jul 06 14:22:49.548100 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:22:49.548087    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de7c1139ddccf976a610bc981082ce1947c037a81000f4b5b98ac0f08b035027\": container with ID starting with de7c1139ddccf976a610bc981082ce1947c037a81000f4b5b98ac0f08b035027 not found: ID does not exist" containerID="de7c1139ddccf976a610bc981082ce1947c037a81000f4b5b98ac0f08b035027"
Jul 06 14:22:49.548158 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.548104    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de7c1139ddccf976a610bc981082ce1947c037a81000f4b5b98ac0f08b035027"} err="failed to get container status \"de7c1139ddccf976a610bc981082ce1947c037a81000f4b5b98ac0f08b035027\": rpc error: code = NotFound desc = could not find container \"de7c1139ddccf976a610bc981082ce1947c037a81000f4b5b98ac0f08b035027\": container with ID starting with de7c1139ddccf976a610bc981082ce1947c037a81000f4b5b98ac0f08b035027 not found: ID does not exist"
Jul 06 14:22:49.548158 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.548117    2562 scope.go:117] "RemoveContainer" containerID="cbf49f762299122a79237b3654caa509754abf26c51b475010172ffbbe173ff3"
Jul 06 14:22:49.548389 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:22:49.548372    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbf49f762299122a79237b3654caa509754abf26c51b475010172ffbbe173ff3\": container with ID starting with cbf49f762299122a79237b3654caa509754abf26c51b475010172ffbbe173ff3 not found: ID does not exist" containerID="cbf49f762299122a79237b3654caa509754abf26c51b475010172ffbbe173ff3"
Jul 06 14:22:49.548426 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.548393    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbf49f762299122a79237b3654caa509754abf26c51b475010172ffbbe173ff3"} err="failed to get container status \"cbf49f762299122a79237b3654caa509754abf26c51b475010172ffbbe173ff3\": rpc error: code = NotFound desc = could not find container \"cbf49f762299122a79237b3654caa509754abf26c51b475010172ffbbe173ff3\": container with ID starting with cbf49f762299122a79237b3654caa509754abf26c51b475010172ffbbe173ff3 not found: ID does not exist"
Jul 06 14:22:49.548426 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.548409    2562 scope.go:117] "RemoveContainer" containerID="7c52ec190a8a5578e5145b444ecba9a4f560d118226ff69ca29176ce9e73e99e"
Jul 06 14:22:49.548642 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:22:49.548623    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c52ec190a8a5578e5145b444ecba9a4f560d118226ff69ca29176ce9e73e99e\": container with ID starting with 7c52ec190a8a5578e5145b444ecba9a4f560d118226ff69ca29176ce9e73e99e not found: ID does not exist" containerID="7c52ec190a8a5578e5145b444ecba9a4f560d118226ff69ca29176ce9e73e99e"
Jul 06 14:22:49.548685 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.548647    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c52ec190a8a5578e5145b444ecba9a4f560d118226ff69ca29176ce9e73e99e"} err="failed to get container status \"7c52ec190a8a5578e5145b444ecba9a4f560d118226ff69ca29176ce9e73e99e\": rpc error: code = NotFound desc = could not find container \"7c52ec190a8a5578e5145b444ecba9a4f560d118226ff69ca29176ce9e73e99e\": container with ID starting with 7c52ec190a8a5578e5145b444ecba9a4f560d118226ff69ca29176ce9e73e99e not found: ID does not exist"
Jul 06 14:22:49.548685 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.548661    2562 scope.go:117] "RemoveContainer" containerID="4f3e12217daab94466c06b1638583f7e547dd4cd1c301e69dd17b8e899afd978"
Jul 06 14:22:49.548870 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:22:49.548853    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f3e12217daab94466c06b1638583f7e547dd4cd1c301e69dd17b8e899afd978\": container with ID starting with 4f3e12217daab94466c06b1638583f7e547dd4cd1c301e69dd17b8e899afd978 not found: ID does not exist" containerID="4f3e12217daab94466c06b1638583f7e547dd4cd1c301e69dd17b8e899afd978"
Jul 06 14:22:49.548918 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.548875    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f3e12217daab94466c06b1638583f7e547dd4cd1c301e69dd17b8e899afd978"} err="failed to get container status \"4f3e12217daab94466c06b1638583f7e547dd4cd1c301e69dd17b8e899afd978\": rpc error: code = NotFound desc = could not find container \"4f3e12217daab94466c06b1638583f7e547dd4cd1c301e69dd17b8e899afd978\": container with ID starting with 4f3e12217daab94466c06b1638583f7e547dd4cd1c301e69dd17b8e899afd978 not found: ID does not exist"
Jul 06 14:22:49.548918 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.548899    2562 scope.go:117] "RemoveContainer" containerID="52909c467ddd06a1900281ae67ddd94c54128c9691c76c5dfa334178f9b81323"
Jul 06 14:22:49.549199 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:22:49.549181    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52909c467ddd06a1900281ae67ddd94c54128c9691c76c5dfa334178f9b81323\": container with ID starting with 52909c467ddd06a1900281ae67ddd94c54128c9691c76c5dfa334178f9b81323 not found: ID does not exist" containerID="52909c467ddd06a1900281ae67ddd94c54128c9691c76c5dfa334178f9b81323"
Jul 06 14:22:49.549275 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.549202    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52909c467ddd06a1900281ae67ddd94c54128c9691c76c5dfa334178f9b81323"} err="failed to get container status \"52909c467ddd06a1900281ae67ddd94c54128c9691c76c5dfa334178f9b81323\": rpc error: code = NotFound desc = could not find container \"52909c467ddd06a1900281ae67ddd94c54128c9691c76c5dfa334178f9b81323\": container with ID starting with 52909c467ddd06a1900281ae67ddd94c54128c9691c76c5dfa334178f9b81323 not found: ID does not exist"
Jul 06 14:22:49.549275 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.549214    2562 scope.go:117] "RemoveContainer" containerID="1f8b75cbb86ca29b07b3c6142f7f6806d464015270bbcb750ec3ca950a18e2d3"
Jul 06 14:22:49.549438 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:22:49.549420    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f8b75cbb86ca29b07b3c6142f7f6806d464015270bbcb750ec3ca950a18e2d3\": container with ID starting with 1f8b75cbb86ca29b07b3c6142f7f6806d464015270bbcb750ec3ca950a18e2d3 not found: ID does not exist" containerID="1f8b75cbb86ca29b07b3c6142f7f6806d464015270bbcb750ec3ca950a18e2d3"
Jul 06 14:22:49.549507 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.549441    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f8b75cbb86ca29b07b3c6142f7f6806d464015270bbcb750ec3ca950a18e2d3"} err="failed to get container status \"1f8b75cbb86ca29b07b3c6142f7f6806d464015270bbcb750ec3ca950a18e2d3\": rpc error: code = NotFound desc = could not find container \"1f8b75cbb86ca29b07b3c6142f7f6806d464015270bbcb750ec3ca950a18e2d3\": container with ID starting with 1f8b75cbb86ca29b07b3c6142f7f6806d464015270bbcb750ec3ca950a18e2d3 not found: ID does not exist"
Jul 06 14:22:49.558480 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558456    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:22:49.558786 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558773    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="config-reloader"
Jul 06 14:22:49.558832 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558789    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="config-reloader"
Jul 06 14:22:49.558832 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558799    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4eb27c1-8747-4396-9cb7-84f5aedb5509" containerName="console"
Jul 06 14:22:49.558832 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558805    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4eb27c1-8747-4396-9cb7-84f5aedb5509" containerName="console"
Jul 06 14:22:49.558832 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558813    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="alertmanager"
Jul 06 14:22:49.558832 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558818    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="alertmanager"
Jul 06 14:22:49.558832 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558830    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="init-config-reloader"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558836    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="init-config-reloader"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558842    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="kube-rbac-proxy-metric"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558847    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="kube-rbac-proxy-metric"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558853    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="kube-rbac-proxy-web"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558859    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="kube-rbac-proxy-web"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558867    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="kube-rbac-proxy"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558872    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="kube-rbac-proxy"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558878    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c73be8b-2763-415d-9023-6657f6e07641" containerName="console"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558883    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c73be8b-2763-415d-9023-6657f6e07641" containerName="console"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558889    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="prom-label-proxy"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558894    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="prom-label-proxy"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558899    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d275f915-be0b-429a-81c1-63b2bb09053b" containerName="console"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558905    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d275f915-be0b-429a-81c1-63b2bb09053b" containerName="console"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558943    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="alertmanager"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558952    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c73be8b-2763-415d-9023-6657f6e07641" containerName="console"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558958    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d275f915-be0b-429a-81c1-63b2bb09053b" containerName="console"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558963    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="kube-rbac-proxy-web"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558968    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="kube-rbac-proxy-metric"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558974    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4eb27c1-8747-4396-9cb7-84f5aedb5509" containerName="console"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558978    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="config-reloader"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558982    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="kube-rbac-proxy"
Jul 06 14:22:49.559015 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.558989    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" containerName="prom-label-proxy"
Jul 06 14:22:49.562926 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.562904    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.567182 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.567166    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 14:22:49.567459 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.567439    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 14:22:49.567544 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.567478    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hw5w4\""
Jul 06 14:22:49.567600 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.567566    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 14:22:49.567739 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.567723    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 14:22:49.567997 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.567974    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 14:22:49.568275 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.568090    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 14:22:49.568661 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.568641    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 14:22:49.569008 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.568971    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 14:22:49.572790 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.572772    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 14:22:49.587643 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.587614    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:22:49.675955 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.675914    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-config-volume\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.675955 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.675953    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.676205 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.675976    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.676205 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.676043    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.676205 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.676078    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb6f5d2e-3706-4db7-931f-76b526cf1d12-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.676205 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.676103    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bwcj\" (UniqueName: \"kubernetes.io/projected/fb6f5d2e-3706-4db7-931f-76b526cf1d12-kube-api-access-8bwcj\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.676410 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.676207    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.676410 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.676237    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.676410 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.676262    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb6f5d2e-3706-4db7-931f-76b526cf1d12-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.676410 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.676304    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb6f5d2e-3706-4db7-931f-76b526cf1d12-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.676410 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.676355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb6f5d2e-3706-4db7-931f-76b526cf1d12-config-out\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.676410 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.676384    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-web-config\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.676627 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.676418    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb6f5d2e-3706-4db7-931f-76b526cf1d12-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.745739 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.745706    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9932a76d-f77a-4188-9a5d-8df19d74d0bd" path="/var/lib/kubelet/pods/9932a76d-f77a-4188-9a5d-8df19d74d0bd/volumes"
Jul 06 14:22:49.777467 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.777428    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.777467 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.777464    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.777695 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.777481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb6f5d2e-3706-4db7-931f-76b526cf1d12-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.777695 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.777507    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb6f5d2e-3706-4db7-931f-76b526cf1d12-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.777695 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.777551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb6f5d2e-3706-4db7-931f-76b526cf1d12-config-out\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.777695 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.777576    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-web-config\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.777695 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.777608    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb6f5d2e-3706-4db7-931f-76b526cf1d12-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.777695 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.777662    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-config-volume\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.777695 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.777685    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.778034 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.777715    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.778034 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.777749    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.778034 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.777775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb6f5d2e-3706-4db7-931f-76b526cf1d12-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.778034 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.777805    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bwcj\" (UniqueName: \"kubernetes.io/projected/fb6f5d2e-3706-4db7-931f-76b526cf1d12-kube-api-access-8bwcj\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.778034 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.777985    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb6f5d2e-3706-4db7-931f-76b526cf1d12-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.778783 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.778468    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb6f5d2e-3706-4db7-931f-76b526cf1d12-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.781026 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.780990    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-web-config\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.781578 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.781310    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb6f5d2e-3706-4db7-931f-76b526cf1d12-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.781578 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.781307    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.781578 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.781395    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb6f5d2e-3706-4db7-931f-76b526cf1d12-config-out\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.781578 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.781538    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.781814 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.781714    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.781814 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.781725    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb6f5d2e-3706-4db7-931f-76b526cf1d12-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.782024 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.782003    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-config-volume\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.782740 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.782716    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.783504 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.783481    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb6f5d2e-3706-4db7-931f-76b526cf1d12-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.787843 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.787821    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bwcj\" (UniqueName: \"kubernetes.io/projected/fb6f5d2e-3706-4db7-931f-76b526cf1d12-kube-api-access-8bwcj\") pod \"alertmanager-main-0\" (UID: \"fb6f5d2e-3706-4db7-931f-76b526cf1d12\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:49.872937 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:49.872900    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:22:50.019675 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:50.019600    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:22:50.022564 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:22:50.022536    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb6f5d2e_3706_4db7_931f_76b526cf1d12.slice/crio-0d69a39af2862fbc577088cc547b7b720c8a5925cc355381bd8bf8a57f9e81b6 WatchSource:0}: Error finding container 0d69a39af2862fbc577088cc547b7b720c8a5925cc355381bd8bf8a57f9e81b6: Status 404 returned error can't find the container with id 0d69a39af2862fbc577088cc547b7b720c8a5925cc355381bd8bf8a57f9e81b6
Jul 06 14:22:50.498455 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:50.498420    2562 generic.go:356] "Generic (PLEG): container finished" podID="fb6f5d2e-3706-4db7-931f-76b526cf1d12" containerID="2616f1c68b3c4ad5a43722d338a7cffe6e42140f8f65216ef3d619866723aa03" exitCode=0
Jul 06 14:22:50.498843 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:50.498507    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb6f5d2e-3706-4db7-931f-76b526cf1d12","Type":"ContainerDied","Data":"2616f1c68b3c4ad5a43722d338a7cffe6e42140f8f65216ef3d619866723aa03"}
Jul 06 14:22:50.498843 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:50.498575    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb6f5d2e-3706-4db7-931f-76b526cf1d12","Type":"ContainerStarted","Data":"0d69a39af2862fbc577088cc547b7b720c8a5925cc355381bd8bf8a57f9e81b6"}
Jul 06 14:22:51.507246 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:51.507205    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb6f5d2e-3706-4db7-931f-76b526cf1d12","Type":"ContainerStarted","Data":"0aca3acc16f249502fba690e3eeaee50ad75f563dab4c0088cb5963f11f4dd99"}
Jul 06 14:22:51.507725 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:51.507272    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb6f5d2e-3706-4db7-931f-76b526cf1d12","Type":"ContainerStarted","Data":"e93ebdd650232987de01ebffdbfecdafa3db5701581949477aee93f0cfde594e"}
Jul 06 14:22:51.507725 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:51.507298    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb6f5d2e-3706-4db7-931f-76b526cf1d12","Type":"ContainerStarted","Data":"596a59a9bdd6a4475ae8b62159365f5e6f8eacb4b66bebe39c3af608c75c2eb8"}
Jul 06 14:22:51.507725 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:51.507323    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb6f5d2e-3706-4db7-931f-76b526cf1d12","Type":"ContainerStarted","Data":"352036c262029eec2215a2343bf9260ca50b45ed3fac9baad123854b312769b6"}
Jul 06 14:22:51.507725 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:51.507345    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb6f5d2e-3706-4db7-931f-76b526cf1d12","Type":"ContainerStarted","Data":"c188bddf20aa24bd92dc35d1f0b2991175bdf7b8a0d0e23cd4bf74a3fa932e47"}
Jul 06 14:22:51.507725 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:51.507370    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb6f5d2e-3706-4db7-931f-76b526cf1d12","Type":"ContainerStarted","Data":"5dce97b5d57b92e1a74aa0de4f667d0c937a801f3ae87be2ea807a6e94a013d0"}
Jul 06 14:22:51.545417 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:51.545348    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.531355289 podStartE2EDuration="2.545327082s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.971793ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:22:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:22:51.54429172 +0000 UTC m=+152.393178692" watchObservedRunningTime="2026-07-06 14:22:51.545327082 +0000 UTC m=+152.394214053"
Jul 06 14:22:51.755758 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:51.753760    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:22:51.755758 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:51.754127    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="prometheus" containerID="cri-o://cd286a2d1abef5f7d340b15c95e81b3c7df7f2cc5a0be2ec9d9e775d3d64a2de" gracePeriod=600
Jul 06 14:22:51.755758 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:51.754514    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://bee327c28530db73619fd677266db3faa2b23f2f093e2fe358a643635ed4781f" gracePeriod=600
Jul 06 14:22:51.755758 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:51.754638    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="kube-rbac-proxy" containerID="cri-o://c50bdde7ef17c486011ff11da9788ef63a865efaad626ec6ad7bf97a217e74f7" gracePeriod=600
Jul 06 14:22:51.755758 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:51.754721    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="kube-rbac-proxy-web" containerID="cri-o://b15d5c798b04ca44d0df4a1b7c253eca9766e8e927d2b23bc59abd7c6e6066b6" gracePeriod=600
Jul 06 14:22:51.755758 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:51.754815    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="thanos-sidecar" containerID="cri-o://0ea46b75bdb4494cb80ca3de54fceba02090f4535d0f3d733d3b4e7cc803d37a" gracePeriod=600
Jul 06 14:22:51.755758 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:51.754893    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="config-reloader" containerID="cri-o://b463ed2dc758547fa9b68c09dc8b56e3e723963aa477e357e663fefe20f8907b" gracePeriod=600
Jul 06 14:22:52.515692 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:52.515656    2562 generic.go:356] "Generic (PLEG): container finished" podID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerID="bee327c28530db73619fd677266db3faa2b23f2f093e2fe358a643635ed4781f" exitCode=0
Jul 06 14:22:52.515692 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:52.515681    2562 generic.go:356] "Generic (PLEG): container finished" podID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerID="c50bdde7ef17c486011ff11da9788ef63a865efaad626ec6ad7bf97a217e74f7" exitCode=0
Jul 06 14:22:52.515692 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:52.515687    2562 generic.go:356] "Generic (PLEG): container finished" podID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerID="0ea46b75bdb4494cb80ca3de54fceba02090f4535d0f3d733d3b4e7cc803d37a" exitCode=0
Jul 06 14:22:52.515692 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:52.515694    2562 generic.go:356] "Generic (PLEG): container finished" podID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerID="b463ed2dc758547fa9b68c09dc8b56e3e723963aa477e357e663fefe20f8907b" exitCode=0
Jul 06 14:22:52.515692 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:52.515699    2562 generic.go:356] "Generic (PLEG): container finished" podID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerID="cd286a2d1abef5f7d340b15c95e81b3c7df7f2cc5a0be2ec9d9e775d3d64a2de" exitCode=0
Jul 06 14:22:52.516200 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:52.515722    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3c04184-0141-4c2a-b299-72f14b1a92f6","Type":"ContainerDied","Data":"bee327c28530db73619fd677266db3faa2b23f2f093e2fe358a643635ed4781f"}
Jul 06 14:22:52.516200 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:52.515785    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3c04184-0141-4c2a-b299-72f14b1a92f6","Type":"ContainerDied","Data":"c50bdde7ef17c486011ff11da9788ef63a865efaad626ec6ad7bf97a217e74f7"}
Jul 06 14:22:52.516200 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:52.515813    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3c04184-0141-4c2a-b299-72f14b1a92f6","Type":"ContainerDied","Data":"0ea46b75bdb4494cb80ca3de54fceba02090f4535d0f3d733d3b4e7cc803d37a"}
Jul 06 14:22:52.516200 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:52.515837    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3c04184-0141-4c2a-b299-72f14b1a92f6","Type":"ContainerDied","Data":"b463ed2dc758547fa9b68c09dc8b56e3e723963aa477e357e663fefe20f8907b"}
Jul 06 14:22:52.516200 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:52.515863    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3c04184-0141-4c2a-b299-72f14b1a92f6","Type":"ContainerDied","Data":"cd286a2d1abef5f7d340b15c95e81b3c7df7f2cc5a0be2ec9d9e775d3d64a2de"}
Jul 06 14:22:53.017665 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.017641    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.112234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.110776    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-prometheus-k8s-tls\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.112234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.110844    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-configmap-kubelet-serving-ca-bundle\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.112234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.110942    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-thanos-prometheus-http-client-file\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.112234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.110977    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.112234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.111025    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-metrics-client-certs\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.112234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.111071    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-kube-rbac-proxy\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.112234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.111116    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-db\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.112234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.111169    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-configmap-serving-certs-ca-bundle\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.112234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.111207    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3c04184-0141-4c2a-b299-72f14b1a92f6-tls-assets\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.112234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.111238    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-grpc-tls\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.112234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.111263    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-rulefiles-0\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.112234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.111301    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-rulefiles-1\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.112234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.111336    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.112234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.111364    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-configmap-metrics-client-ca\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.112234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.111393    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3c04184-0141-4c2a-b299-72f14b1a92f6-config-out\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.112234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.111445    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-rulefiles-2\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.112234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.111488    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-web-config\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.112234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.111524    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-trusted-ca-bundle\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.113111 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.111553    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-config\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.113111 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.111596    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2tbg\" (UniqueName: \"kubernetes.io/projected/f3c04184-0141-4c2a-b299-72f14b1a92f6-kube-api-access-t2tbg\") pod \"f3c04184-0141-4c2a-b299-72f14b1a92f6\" (UID: \"f3c04184-0141-4c2a-b299-72f14b1a92f6\") "
Jul 06 14:22:53.116062 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.116025    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:22:53.116899 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.116856    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:22:53.117006 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.116976    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3c04184-0141-4c2a-b299-72f14b1a92f6-kube-api-access-t2tbg" (OuterVolumeSpecName: "kube-api-access-t2tbg") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "kube-api-access-t2tbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:22:53.117788 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.117165    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:22:53.117788 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.117536    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:22:53.117788 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.117693    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:22:53.117996 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.117822    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:22:53.118505 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.118204    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:22:53.118613 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.118595    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:53.119000 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.118956    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-config" (OuterVolumeSpecName: "config") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:53.119726 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.119699    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:22:53.120033 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.120002    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:53.120252 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.120221    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:53.120531 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.120505    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3c04184-0141-4c2a-b299-72f14b1a92f6-config-out" (OuterVolumeSpecName: "config-out") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:22:53.121054 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.121016    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3c04184-0141-4c2a-b299-72f14b1a92f6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:22:53.121178 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.121128    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:53.121285 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.121216    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:53.121578 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.121554    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:53.122017 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.121983    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:53.131159 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.131126    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-web-config" (OuterVolumeSpecName: "web-config") pod "f3c04184-0141-4c2a-b299-72f14b1a92f6" (UID: "f3c04184-0141-4c2a-b299-72f14b1a92f6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:22:53.212801 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212767    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-db\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.212801 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212799    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.212801 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212810    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3c04184-0141-4c2a-b299-72f14b1a92f6-tls-assets\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.213031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212819    2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-grpc-tls\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.213031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212827    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.213031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212836    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.213031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212845    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.213031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212853    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-configmap-metrics-client-ca\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.213031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212861    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3c04184-0141-4c2a-b299-72f14b1a92f6-config-out\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.213031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212870    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.213031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212877    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-web-config\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.213031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212893    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.213031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212903    2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-config\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.213031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212910    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2tbg\" (UniqueName: \"kubernetes.io/projected/f3c04184-0141-4c2a-b299-72f14b1a92f6-kube-api-access-t2tbg\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.213031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212918    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.213031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212926    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3c04184-0141-4c2a-b299-72f14b1a92f6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.213031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212935    2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.213031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212943    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.213031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212952    2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-metrics-client-certs\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.213031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.212960    2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3c04184-0141-4c2a-b299-72f14b1a92f6-secret-kube-rbac-proxy\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:22:53.522744 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.522704    2562 generic.go:356] "Generic (PLEG): container finished" podID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerID="b15d5c798b04ca44d0df4a1b7c253eca9766e8e927d2b23bc59abd7c6e6066b6" exitCode=0
Jul 06 14:22:53.523108 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.522777    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3c04184-0141-4c2a-b299-72f14b1a92f6","Type":"ContainerDied","Data":"b15d5c798b04ca44d0df4a1b7c253eca9766e8e927d2b23bc59abd7c6e6066b6"}
Jul 06 14:22:53.523108 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.522815    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.523108 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.522887    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f3c04184-0141-4c2a-b299-72f14b1a92f6","Type":"ContainerDied","Data":"fed38a7f893ddaed8977a9d343f4f42577799449d70dd7cd6fd5edbd44a39ff0"}
Jul 06 14:22:53.523108 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.522937    2562 scope.go:117] "RemoveContainer" containerID="bee327c28530db73619fd677266db3faa2b23f2f093e2fe358a643635ed4781f"
Jul 06 14:22:53.530880 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.530803    2562 scope.go:117] "RemoveContainer" containerID="c50bdde7ef17c486011ff11da9788ef63a865efaad626ec6ad7bf97a217e74f7"
Jul 06 14:22:53.537912 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.537892    2562 scope.go:117] "RemoveContainer" containerID="b15d5c798b04ca44d0df4a1b7c253eca9766e8e927d2b23bc59abd7c6e6066b6"
Jul 06 14:22:53.544724 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.544707    2562 scope.go:117] "RemoveContainer" containerID="0ea46b75bdb4494cb80ca3de54fceba02090f4535d0f3d733d3b4e7cc803d37a"
Jul 06 14:22:53.551608 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.551592    2562 scope.go:117] "RemoveContainer" containerID="b463ed2dc758547fa9b68c09dc8b56e3e723963aa477e357e663fefe20f8907b"
Jul 06 14:22:53.555496 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.555475    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:22:53.558885 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.558871    2562 scope.go:117] "RemoveContainer" containerID="cd286a2d1abef5f7d340b15c95e81b3c7df7f2cc5a0be2ec9d9e775d3d64a2de"
Jul 06 14:22:53.562788 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.562769    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:22:53.566708 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.566692    2562 scope.go:117] "RemoveContainer" containerID="201445afc6ed4ff03a14566cb438cca981ec840460c264c486b16403c9cea2cd"
Jul 06 14:22:53.573608 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.573590    2562 scope.go:117] "RemoveContainer" containerID="bee327c28530db73619fd677266db3faa2b23f2f093e2fe358a643635ed4781f"
Jul 06 14:22:53.573866 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:22:53.573840    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bee327c28530db73619fd677266db3faa2b23f2f093e2fe358a643635ed4781f\": container with ID starting with bee327c28530db73619fd677266db3faa2b23f2f093e2fe358a643635ed4781f not found: ID does not exist" containerID="bee327c28530db73619fd677266db3faa2b23f2f093e2fe358a643635ed4781f"
Jul 06 14:22:53.573914 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.573875    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bee327c28530db73619fd677266db3faa2b23f2f093e2fe358a643635ed4781f"} err="failed to get container status \"bee327c28530db73619fd677266db3faa2b23f2f093e2fe358a643635ed4781f\": rpc error: code = NotFound desc = could not find container \"bee327c28530db73619fd677266db3faa2b23f2f093e2fe358a643635ed4781f\": container with ID starting with bee327c28530db73619fd677266db3faa2b23f2f093e2fe358a643635ed4781f not found: ID does not exist"
Jul 06 14:22:53.573914 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.573893    2562 scope.go:117] "RemoveContainer" containerID="c50bdde7ef17c486011ff11da9788ef63a865efaad626ec6ad7bf97a217e74f7"
Jul 06 14:22:53.574105 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:22:53.574089    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c50bdde7ef17c486011ff11da9788ef63a865efaad626ec6ad7bf97a217e74f7\": container with ID starting with c50bdde7ef17c486011ff11da9788ef63a865efaad626ec6ad7bf97a217e74f7 not found: ID does not exist" containerID="c50bdde7ef17c486011ff11da9788ef63a865efaad626ec6ad7bf97a217e74f7"
Jul 06 14:22:53.574162 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.574110    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50bdde7ef17c486011ff11da9788ef63a865efaad626ec6ad7bf97a217e74f7"} err="failed to get container status \"c50bdde7ef17c486011ff11da9788ef63a865efaad626ec6ad7bf97a217e74f7\": rpc error: code = NotFound desc = could not find container \"c50bdde7ef17c486011ff11da9788ef63a865efaad626ec6ad7bf97a217e74f7\": container with ID starting with c50bdde7ef17c486011ff11da9788ef63a865efaad626ec6ad7bf97a217e74f7 not found: ID does not exist"
Jul 06 14:22:53.574162 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.574130    2562 scope.go:117] "RemoveContainer" containerID="b15d5c798b04ca44d0df4a1b7c253eca9766e8e927d2b23bc59abd7c6e6066b6"
Jul 06 14:22:53.574409 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:22:53.574393    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b15d5c798b04ca44d0df4a1b7c253eca9766e8e927d2b23bc59abd7c6e6066b6\": container with ID starting with b15d5c798b04ca44d0df4a1b7c253eca9766e8e927d2b23bc59abd7c6e6066b6 not found: ID does not exist" containerID="b15d5c798b04ca44d0df4a1b7c253eca9766e8e927d2b23bc59abd7c6e6066b6"
Jul 06 14:22:53.574451 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.574419    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b15d5c798b04ca44d0df4a1b7c253eca9766e8e927d2b23bc59abd7c6e6066b6"} err="failed to get container status \"b15d5c798b04ca44d0df4a1b7c253eca9766e8e927d2b23bc59abd7c6e6066b6\": rpc error: code = NotFound desc = could not find container \"b15d5c798b04ca44d0df4a1b7c253eca9766e8e927d2b23bc59abd7c6e6066b6\": container with ID starting with b15d5c798b04ca44d0df4a1b7c253eca9766e8e927d2b23bc59abd7c6e6066b6 not found: ID does not exist"
Jul 06 14:22:53.574451 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.574433    2562 scope.go:117] "RemoveContainer" containerID="0ea46b75bdb4494cb80ca3de54fceba02090f4535d0f3d733d3b4e7cc803d37a"
Jul 06 14:22:53.574664 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:22:53.574645    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ea46b75bdb4494cb80ca3de54fceba02090f4535d0f3d733d3b4e7cc803d37a\": container with ID starting with 0ea46b75bdb4494cb80ca3de54fceba02090f4535d0f3d733d3b4e7cc803d37a not found: ID does not exist" containerID="0ea46b75bdb4494cb80ca3de54fceba02090f4535d0f3d733d3b4e7cc803d37a"
Jul 06 14:22:53.574704 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.574669    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ea46b75bdb4494cb80ca3de54fceba02090f4535d0f3d733d3b4e7cc803d37a"} err="failed to get container status \"0ea46b75bdb4494cb80ca3de54fceba02090f4535d0f3d733d3b4e7cc803d37a\": rpc error: code = NotFound desc = could not find container \"0ea46b75bdb4494cb80ca3de54fceba02090f4535d0f3d733d3b4e7cc803d37a\": container with ID starting with 0ea46b75bdb4494cb80ca3de54fceba02090f4535d0f3d733d3b4e7cc803d37a not found: ID does not exist"
Jul 06 14:22:53.574704 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.574686    2562 scope.go:117] "RemoveContainer" containerID="b463ed2dc758547fa9b68c09dc8b56e3e723963aa477e357e663fefe20f8907b"
Jul 06 14:22:53.574928 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:22:53.574910    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b463ed2dc758547fa9b68c09dc8b56e3e723963aa477e357e663fefe20f8907b\": container with ID starting with b463ed2dc758547fa9b68c09dc8b56e3e723963aa477e357e663fefe20f8907b not found: ID does not exist" containerID="b463ed2dc758547fa9b68c09dc8b56e3e723963aa477e357e663fefe20f8907b"
Jul 06 14:22:53.574982 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.574932    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b463ed2dc758547fa9b68c09dc8b56e3e723963aa477e357e663fefe20f8907b"} err="failed to get container status \"b463ed2dc758547fa9b68c09dc8b56e3e723963aa477e357e663fefe20f8907b\": rpc error: code = NotFound desc = could not find container \"b463ed2dc758547fa9b68c09dc8b56e3e723963aa477e357e663fefe20f8907b\": container with ID starting with b463ed2dc758547fa9b68c09dc8b56e3e723963aa477e357e663fefe20f8907b not found: ID does not exist"
Jul 06 14:22:53.574982 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.574945    2562 scope.go:117] "RemoveContainer" containerID="cd286a2d1abef5f7d340b15c95e81b3c7df7f2cc5a0be2ec9d9e775d3d64a2de"
Jul 06 14:22:53.575189 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:22:53.575171    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd286a2d1abef5f7d340b15c95e81b3c7df7f2cc5a0be2ec9d9e775d3d64a2de\": container with ID starting with cd286a2d1abef5f7d340b15c95e81b3c7df7f2cc5a0be2ec9d9e775d3d64a2de not found: ID does not exist" containerID="cd286a2d1abef5f7d340b15c95e81b3c7df7f2cc5a0be2ec9d9e775d3d64a2de"
Jul 06 14:22:53.575241 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.575191    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd286a2d1abef5f7d340b15c95e81b3c7df7f2cc5a0be2ec9d9e775d3d64a2de"} err="failed to get container status \"cd286a2d1abef5f7d340b15c95e81b3c7df7f2cc5a0be2ec9d9e775d3d64a2de\": rpc error: code = NotFound desc = could not find container \"cd286a2d1abef5f7d340b15c95e81b3c7df7f2cc5a0be2ec9d9e775d3d64a2de\": container with ID starting with cd286a2d1abef5f7d340b15c95e81b3c7df7f2cc5a0be2ec9d9e775d3d64a2de not found: ID does not exist"
Jul 06 14:22:53.575241 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.575205    2562 scope.go:117] "RemoveContainer" containerID="201445afc6ed4ff03a14566cb438cca981ec840460c264c486b16403c9cea2cd"
Jul 06 14:22:53.575441 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:22:53.575426    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"201445afc6ed4ff03a14566cb438cca981ec840460c264c486b16403c9cea2cd\": container with ID starting with 201445afc6ed4ff03a14566cb438cca981ec840460c264c486b16403c9cea2cd not found: ID does not exist" containerID="201445afc6ed4ff03a14566cb438cca981ec840460c264c486b16403c9cea2cd"
Jul 06 14:22:53.575481 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.575443    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"201445afc6ed4ff03a14566cb438cca981ec840460c264c486b16403c9cea2cd"} err="failed to get container status \"201445afc6ed4ff03a14566cb438cca981ec840460c264c486b16403c9cea2cd\": rpc error: code = NotFound desc = could not find container \"201445afc6ed4ff03a14566cb438cca981ec840460c264c486b16403c9cea2cd\": container with ID starting with 201445afc6ed4ff03a14566cb438cca981ec840460c264c486b16403c9cea2cd not found: ID does not exist"
Jul 06 14:22:53.603845 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.603814    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:22:53.604120 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604109    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="prometheus"
Jul 06 14:22:53.604188 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604122    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="prometheus"
Jul 06 14:22:53.604188 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604134    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="kube-rbac-proxy-thanos"
Jul 06 14:22:53.604188 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604140    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="kube-rbac-proxy-thanos"
Jul 06 14:22:53.604188 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604166    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="kube-rbac-proxy-web"
Jul 06 14:22:53.604188 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604171    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="kube-rbac-proxy-web"
Jul 06 14:22:53.604188 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604180    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="init-config-reloader"
Jul 06 14:22:53.604188 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604185    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="init-config-reloader"
Jul 06 14:22:53.604376 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604193    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="kube-rbac-proxy"
Jul 06 14:22:53.604376 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604198    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="kube-rbac-proxy"
Jul 06 14:22:53.604376 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604208    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="config-reloader"
Jul 06 14:22:53.604376 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604213    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="config-reloader"
Jul 06 14:22:53.604376 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604219    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="thanos-sidecar"
Jul 06 14:22:53.604376 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604224    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="thanos-sidecar"
Jul 06 14:22:53.604376 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604268    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="kube-rbac-proxy-thanos"
Jul 06 14:22:53.604376 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604276    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="prometheus"
Jul 06 14:22:53.604376 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604283    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="thanos-sidecar"
Jul 06 14:22:53.604376 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604288    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="kube-rbac-proxy-web"
Jul 06 14:22:53.604376 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604293    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="kube-rbac-proxy"
Jul 06 14:22:53.604376 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.604300    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" containerName="config-reloader"
Jul 06 14:22:53.606541 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.606525    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.609305 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.609280    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 14:22:53.609621 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.609551    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 14:22:53.609621 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.609578    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 14:22:53.609621 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.609605    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 14:22:53.609946 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.609846    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3mkg8ad57rko9\""
Jul 06 14:22:53.609946 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.609859    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 14:22:53.610066 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.610047    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 14:22:53.610127 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.610065    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 14:22:53.610127 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.610105    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 14:22:53.610329 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.610191    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 14:22:53.610329 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.610223    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 14:22:53.610473 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.610374    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 14:22:53.610473 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.610407    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jj8pp\""
Jul 06 14:22:53.611335 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.611316    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 14:22:53.612623 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.612588    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 14:22:53.616726 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.616708    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 14:22:53.626725 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.626690    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:22:53.717853 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.717759    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.717853 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.717800    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.717853 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.717820    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.718132 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.717896    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-config-out\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.718132 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.717957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-config\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.718132 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.717981    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.718132 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.718012    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbq8q\" (UniqueName: \"kubernetes.io/projected/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-kube-api-access-kbq8q\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.718132 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.718062    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.718132 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.718085    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.718132 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.718108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.718493 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.718134    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.718493 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.718196    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-web-config\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.718493 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.718237    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.718493 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.718264    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.718493 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.718302    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.718493 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.718328    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.718493 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.718375    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.718493 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.718399    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.718493 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.718423    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.718493 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.718458    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.745731 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.745690    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3c04184-0141-4c2a-b299-72f14b1a92f6" path="/var/lib/kubelet/pods/f3c04184-0141-4c2a-b299-72f14b1a92f6/volumes"
Jul 06 14:22:53.818910 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.818872    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.818910 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.818911    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.819180 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.818936    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.819180 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.818959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.819180 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.818982    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-web-config\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.819180 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.819010    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.819180 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.819035    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.819180 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.819068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.819180 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.819092    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.819180 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.819177    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.819622 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.819202    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.819622 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.819228    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.819622 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.819267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.819622 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.819316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.819622 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.819355    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.819622 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.819385    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.819622 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.819424    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-config-out\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.819622 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.819463    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-config\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.819622 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.819489    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.819622 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.819523    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbq8q\" (UniqueName: \"kubernetes.io/projected/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-kube-api-access-kbq8q\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.820031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.819813    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.820031 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.819813    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.820158 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.820030    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.820867 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.820841    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.821030 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.820843    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.821360 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.821330    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.822045 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.822021    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.822405 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.822321    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.822505 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.822482    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.822747 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.822713    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.823368 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.823014    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-web-config\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.824280 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.824249    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.824375 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.824294    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.825050 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.824920    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-config-out\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.825050 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.825001    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.825258 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.825089    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.825323 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.825276    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.826005 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.825980    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-config\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.826103 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.826033    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.829299 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.829281    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbq8q\" (UniqueName: \"kubernetes.io/projected/991e7eaf-0cf0-4ef9-a2ad-5799c0294be3-kube-api-access-kbq8q\") pod \"prometheus-k8s-0\" (UID: \"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:53.917422 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:53.917379    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:22:54.078420 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:54.078389    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:22:54.081964 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:22:54.081938    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod991e7eaf_0cf0_4ef9_a2ad_5799c0294be3.slice/crio-8db7591102b56fd68377bcda6350b46d518f756a3a552b2114bf38524ddf057f WatchSource:0}: Error finding container 8db7591102b56fd68377bcda6350b46d518f756a3a552b2114bf38524ddf057f: Status 404 returned error can't find the container with id 8db7591102b56fd68377bcda6350b46d518f756a3a552b2114bf38524ddf057f
Jul 06 14:22:54.529388 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:54.529356    2562 generic.go:356] "Generic (PLEG): container finished" podID="991e7eaf-0cf0-4ef9-a2ad-5799c0294be3" containerID="8d8426eda4371a38d6ec6c71d403b2d7ddc9ccdc0c01662cc139e3214aa2fec9" exitCode=0
Jul 06 14:22:54.529782 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:54.529443    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3","Type":"ContainerDied","Data":"8d8426eda4371a38d6ec6c71d403b2d7ddc9ccdc0c01662cc139e3214aa2fec9"}
Jul 06 14:22:54.529782 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:54.529503    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3","Type":"ContainerStarted","Data":"8db7591102b56fd68377bcda6350b46d518f756a3a552b2114bf38524ddf057f"}
Jul 06 14:22:55.536474 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:55.536443    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3","Type":"ContainerStarted","Data":"05806e7e7b9aadcbb3ac6216045c739647cd1f5148dc8d4a4613d2af85118f75"}
Jul 06 14:22:55.536833 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:55.536536    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3","Type":"ContainerStarted","Data":"0607d9ddf4e9bf40b9df683f43a1da2c2cfe7b13ce2df46c3799793f39fe993b"}
Jul 06 14:22:55.536833 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:55.536562    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3","Type":"ContainerStarted","Data":"90688dc97402c1635a2cf02537a372c3914e48154a0f9b7e17789527934031e0"}
Jul 06 14:22:55.536833 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:55.536588    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3","Type":"ContainerStarted","Data":"d9ec0c536786477367a47a364795f9d5bfc306f95319d45c998ed2d7b4e84481"}
Jul 06 14:22:55.536833 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:55.536611    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3","Type":"ContainerStarted","Data":"5a6a2db882d2fafddf0772416002c3b20fef15fa578deb7c64e6f2dbe04e2982"}
Jul 06 14:22:55.536833 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:55.536634    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"991e7eaf-0cf0-4ef9-a2ad-5799c0294be3","Type":"ContainerStarted","Data":"4c0e30b37efd8f48e2924a9a21e5f4c54b51b16875d288a6e056955a083c662e"}
Jul 06 14:22:55.576801 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:55.576745    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.558950687 podStartE2EDuration="2.57670015s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.749463ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:22:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:22:55.573382446 +0000 UTC m=+156.422269417" watchObservedRunningTime="2026-07-06 14:22:55.57670015 +0000 UTC m=+156.425587123"
Jul 06 14:22:58.917839 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:22:58.917797    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:23:53.918234 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:23:53.918187    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:23:53.934469 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:23:53.934439    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:23:54.780976 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:23:54.780947    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:24:07.458746 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:07.458707    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m448c"]
Jul 06 14:24:07.461582 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:07.461562    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-m448c"
Jul 06 14:24:07.464244 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:07.464221    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 14:24:07.464347 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:07.464283    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-sdj8c\""
Jul 06 14:24:07.465214 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:07.465196    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 14:24:07.473616 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:07.473592    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m448c"]
Jul 06 14:24:07.552603 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:07.552567    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/344d7468-3503-4cb6-8e3c-edf2840e37f9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m448c\" (UID: \"344d7468-3503-4cb6-8e3c-edf2840e37f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m448c"
Jul 06 14:24:07.552603 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:07.552605    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk2lk\" (UniqueName: \"kubernetes.io/projected/344d7468-3503-4cb6-8e3c-edf2840e37f9-kube-api-access-mk2lk\") pod \"cert-manager-webhook-6486ffd997-m448c\" (UID: \"344d7468-3503-4cb6-8e3c-edf2840e37f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m448c"
Jul 06 14:24:07.654014 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:07.653975    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/344d7468-3503-4cb6-8e3c-edf2840e37f9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m448c\" (UID: \"344d7468-3503-4cb6-8e3c-edf2840e37f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m448c"
Jul 06 14:24:07.654170 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:07.654018    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk2lk\" (UniqueName: \"kubernetes.io/projected/344d7468-3503-4cb6-8e3c-edf2840e37f9-kube-api-access-mk2lk\") pod \"cert-manager-webhook-6486ffd997-m448c\" (UID: \"344d7468-3503-4cb6-8e3c-edf2840e37f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m448c"
Jul 06 14:24:07.663485 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:07.663459    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/344d7468-3503-4cb6-8e3c-edf2840e37f9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-m448c\" (UID: \"344d7468-3503-4cb6-8e3c-edf2840e37f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m448c"
Jul 06 14:24:07.663609 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:07.663526    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk2lk\" (UniqueName: \"kubernetes.io/projected/344d7468-3503-4cb6-8e3c-edf2840e37f9-kube-api-access-mk2lk\") pod \"cert-manager-webhook-6486ffd997-m448c\" (UID: \"344d7468-3503-4cb6-8e3c-edf2840e37f9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-m448c"
Jul 06 14:24:07.779590 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:07.779557    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-m448c"
Jul 06 14:24:07.913633 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:07.913602    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-m448c"]
Jul 06 14:24:07.916638 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:24:07.916606    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod344d7468_3503_4cb6_8e3c_edf2840e37f9.slice/crio-338d6beda6fd4e3470317cd0640a07f4e170962ee5e4ed3f3f8a8f3b2509ab16 WatchSource:0}: Error finding container 338d6beda6fd4e3470317cd0640a07f4e170962ee5e4ed3f3f8a8f3b2509ab16: Status 404 returned error can't find the container with id 338d6beda6fd4e3470317cd0640a07f4e170962ee5e4ed3f3f8a8f3b2509ab16
Jul 06 14:24:08.824487 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:08.824442    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-m448c" event={"ID":"344d7468-3503-4cb6-8e3c-edf2840e37f9","Type":"ContainerStarted","Data":"338d6beda6fd4e3470317cd0640a07f4e170962ee5e4ed3f3f8a8f3b2509ab16"}
Jul 06 14:24:11.840104 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:11.840066    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-m448c" event={"ID":"344d7468-3503-4cb6-8e3c-edf2840e37f9","Type":"ContainerStarted","Data":"c017cff3b6674e229bd84edb5cc94081ec04f06343cac7b2299366675403d58b"}
Jul 06 14:24:11.840501 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:11.840138    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-m448c"
Jul 06 14:24:11.868638 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:11.868581    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-m448c" podStartSLOduration=1.534267731 podStartE2EDuration="4.868564919s" totalImagesPullingTime="3.334297188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:11.861280272 +0000 UTC m=+232.710167242" watchObservedRunningTime="2026-07-06 14:24:11.868564919 +0000 UTC m=+232.717451889"
Jul 06 14:24:16.815257 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:16.815219    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9b7nr"]
Jul 06 14:24:16.818804 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:16.818786    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9b7nr"
Jul 06 14:24:16.821376 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:16.821354    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8bcjs\""
Jul 06 14:24:16.827788 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:16.827757    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9b7nr"]
Jul 06 14:24:16.941433 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:16.941395    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4cfd\" (UniqueName: \"kubernetes.io/projected/123462ef-c5d3-4c27-80ff-9b6f9d878c7f-kube-api-access-m4cfd\") pod \"cert-manager-55b4d954d5-9b7nr\" (UID: \"123462ef-c5d3-4c27-80ff-9b6f9d878c7f\") " pod="cert-manager/cert-manager-55b4d954d5-9b7nr"
Jul 06 14:24:16.941606 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:16.941466    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/123462ef-c5d3-4c27-80ff-9b6f9d878c7f-bound-sa-token\") pod \"cert-manager-55b4d954d5-9b7nr\" (UID: \"123462ef-c5d3-4c27-80ff-9b6f9d878c7f\") " pod="cert-manager/cert-manager-55b4d954d5-9b7nr"
Jul 06 14:24:17.042865 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:17.042829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/123462ef-c5d3-4c27-80ff-9b6f9d878c7f-bound-sa-token\") pod \"cert-manager-55b4d954d5-9b7nr\" (UID: \"123462ef-c5d3-4c27-80ff-9b6f9d878c7f\") " pod="cert-manager/cert-manager-55b4d954d5-9b7nr"
Jul 06 14:24:17.043032 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:17.042905    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4cfd\" (UniqueName: \"kubernetes.io/projected/123462ef-c5d3-4c27-80ff-9b6f9d878c7f-kube-api-access-m4cfd\") pod \"cert-manager-55b4d954d5-9b7nr\" (UID: \"123462ef-c5d3-4c27-80ff-9b6f9d878c7f\") " pod="cert-manager/cert-manager-55b4d954d5-9b7nr"
Jul 06 14:24:17.054614 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:17.054587    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/123462ef-c5d3-4c27-80ff-9b6f9d878c7f-bound-sa-token\") pod \"cert-manager-55b4d954d5-9b7nr\" (UID: \"123462ef-c5d3-4c27-80ff-9b6f9d878c7f\") " pod="cert-manager/cert-manager-55b4d954d5-9b7nr"
Jul 06 14:24:17.054762 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:17.054709    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4cfd\" (UniqueName: \"kubernetes.io/projected/123462ef-c5d3-4c27-80ff-9b6f9d878c7f-kube-api-access-m4cfd\") pod \"cert-manager-55b4d954d5-9b7nr\" (UID: \"123462ef-c5d3-4c27-80ff-9b6f9d878c7f\") " pod="cert-manager/cert-manager-55b4d954d5-9b7nr"
Jul 06 14:24:17.129415 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:17.129326    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9b7nr"
Jul 06 14:24:17.268589 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:17.268559    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9b7nr"]
Jul 06 14:24:17.271100 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:24:17.271073    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod123462ef_c5d3_4c27_80ff_9b6f9d878c7f.slice/crio-98843f52b280d953648a52fa2f1d43c1d1bf935f36696aa4feb0006a0b69c108 WatchSource:0}: Error finding container 98843f52b280d953648a52fa2f1d43c1d1bf935f36696aa4feb0006a0b69c108: Status 404 returned error can't find the container with id 98843f52b280d953648a52fa2f1d43c1d1bf935f36696aa4feb0006a0b69c108
Jul 06 14:24:17.846014 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:17.845974    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-m448c"
Jul 06 14:24:17.866360 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:17.866325    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9b7nr" event={"ID":"123462ef-c5d3-4c27-80ff-9b6f9d878c7f","Type":"ContainerStarted","Data":"1f578c82f27f4fbc51002444196400c774982cf2ce66453e1071724ae07fab32"}
Jul 06 14:24:17.866360 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:17.866364    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9b7nr" event={"ID":"123462ef-c5d3-4c27-80ff-9b6f9d878c7f","Type":"ContainerStarted","Data":"98843f52b280d953648a52fa2f1d43c1d1bf935f36696aa4feb0006a0b69c108"}
Jul 06 14:24:17.899394 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:17.899339    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9b7nr" podStartSLOduration=1.899319295 podStartE2EDuration="1.899319295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:24:17.897036775 +0000 UTC m=+238.745923746" watchObservedRunningTime="2026-07-06 14:24:17.899319295 +0000 UTC m=+238.748206266"
Jul 06 14:24:54.972336 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:54.972302    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"]
Jul 06 14:24:54.976988 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:54.976964    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"
Jul 06 14:24:54.981176 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:54.981136    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 14:24:54.982269 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:54.982247    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 14:24:54.982397 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:54.982271    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:24:54.982397 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:54.982283    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 14:24:54.982397 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:54.982253    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6fhvm\""
Jul 06 14:24:54.982397 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:54.982251    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 14:24:54.992787 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:54.992761    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"]
Jul 06 14:24:55.080923 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.080887    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/696978a9-e46a-4931-b44a-074ce9e19fa8-cert\") pod \"lws-controller-manager-7d677d8c9-2kpz2\" (UID: \"696978a9-e46a-4931-b44a-074ce9e19fa8\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"
Jul 06 14:24:55.081122 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.080982    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phmb4\" (UniqueName: \"kubernetes.io/projected/696978a9-e46a-4931-b44a-074ce9e19fa8-kube-api-access-phmb4\") pod \"lws-controller-manager-7d677d8c9-2kpz2\" (UID: \"696978a9-e46a-4931-b44a-074ce9e19fa8\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"
Jul 06 14:24:55.081122 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.081034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/696978a9-e46a-4931-b44a-074ce9e19fa8-metrics-cert\") pod \"lws-controller-manager-7d677d8c9-2kpz2\" (UID: \"696978a9-e46a-4931-b44a-074ce9e19fa8\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"
Jul 06 14:24:55.081122 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.081092    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/696978a9-e46a-4931-b44a-074ce9e19fa8-manager-config\") pod \"lws-controller-manager-7d677d8c9-2kpz2\" (UID: \"696978a9-e46a-4931-b44a-074ce9e19fa8\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"
Jul 06 14:24:55.182009 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.181972    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phmb4\" (UniqueName: \"kubernetes.io/projected/696978a9-e46a-4931-b44a-074ce9e19fa8-kube-api-access-phmb4\") pod \"lws-controller-manager-7d677d8c9-2kpz2\" (UID: \"696978a9-e46a-4931-b44a-074ce9e19fa8\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"
Jul 06 14:24:55.182009 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.182011    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/696978a9-e46a-4931-b44a-074ce9e19fa8-metrics-cert\") pod \"lws-controller-manager-7d677d8c9-2kpz2\" (UID: \"696978a9-e46a-4931-b44a-074ce9e19fa8\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"
Jul 06 14:24:55.182260 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.182034    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/696978a9-e46a-4931-b44a-074ce9e19fa8-manager-config\") pod \"lws-controller-manager-7d677d8c9-2kpz2\" (UID: \"696978a9-e46a-4931-b44a-074ce9e19fa8\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"
Jul 06 14:24:55.182260 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.182063    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/696978a9-e46a-4931-b44a-074ce9e19fa8-cert\") pod \"lws-controller-manager-7d677d8c9-2kpz2\" (UID: \"696978a9-e46a-4931-b44a-074ce9e19fa8\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"
Jul 06 14:24:55.182713 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.182683    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/696978a9-e46a-4931-b44a-074ce9e19fa8-manager-config\") pod \"lws-controller-manager-7d677d8c9-2kpz2\" (UID: \"696978a9-e46a-4931-b44a-074ce9e19fa8\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"
Jul 06 14:24:55.184792 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.184763    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/696978a9-e46a-4931-b44a-074ce9e19fa8-cert\") pod \"lws-controller-manager-7d677d8c9-2kpz2\" (UID: \"696978a9-e46a-4931-b44a-074ce9e19fa8\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"
Jul 06 14:24:55.184894 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.184847    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/696978a9-e46a-4931-b44a-074ce9e19fa8-metrics-cert\") pod \"lws-controller-manager-7d677d8c9-2kpz2\" (UID: \"696978a9-e46a-4931-b44a-074ce9e19fa8\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"
Jul 06 14:24:55.191629 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.191606    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phmb4\" (UniqueName: \"kubernetes.io/projected/696978a9-e46a-4931-b44a-074ce9e19fa8-kube-api-access-phmb4\") pod \"lws-controller-manager-7d677d8c9-2kpz2\" (UID: \"696978a9-e46a-4931-b44a-074ce9e19fa8\") " pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"
Jul 06 14:24:55.286670 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.286634    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"
Jul 06 14:24:55.432831 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.432789    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"]
Jul 06 14:24:55.435609 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:24:55.435583    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod696978a9_e46a_4931_b44a_074ce9e19fa8.slice/crio-400fabfceb819c55f48756132f4c14c40dc205871d2ed3a5c68e0d1362f63699 WatchSource:0}: Error finding container 400fabfceb819c55f48756132f4c14c40dc205871d2ed3a5c68e0d1362f63699: Status 404 returned error can't find the container with id 400fabfceb819c55f48756132f4c14c40dc205871d2ed3a5c68e0d1362f63699
Jul 06 14:24:55.672830 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.672745    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"]
Jul 06 14:24:55.676122 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.676095    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:24:55.679467 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.679432    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 14:24:55.679702 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.679483    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 14:24:55.679777 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.679722    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 14:24:55.680276 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.680257    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gdtdc\""
Jul 06 14:24:55.685375 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.685357    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 14:24:55.690771 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.690749    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"]
Jul 06 14:24:55.787082 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.787047    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqzfj\" (UniqueName: \"kubernetes.io/projected/244dd0ac-e39b-4814-912d-2d88f79463cd-kube-api-access-cqzfj\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc\" (UID: \"244dd0ac-e39b-4814-912d-2d88f79463cd\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:24:55.787082 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.787100    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/244dd0ac-e39b-4814-912d-2d88f79463cd-tmp\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc\" (UID: \"244dd0ac-e39b-4814-912d-2d88f79463cd\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:24:55.787333 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.787132    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/244dd0ac-e39b-4814-912d-2d88f79463cd-webhook-cert\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc\" (UID: \"244dd0ac-e39b-4814-912d-2d88f79463cd\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:24:55.787333 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.787183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/244dd0ac-e39b-4814-912d-2d88f79463cd-manifests\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc\" (UID: \"244dd0ac-e39b-4814-912d-2d88f79463cd\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:24:55.787333 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.787199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/244dd0ac-e39b-4814-912d-2d88f79463cd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc\" (UID: \"244dd0ac-e39b-4814-912d-2d88f79463cd\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:24:55.887649 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.887591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/244dd0ac-e39b-4814-912d-2d88f79463cd-webhook-cert\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc\" (UID: \"244dd0ac-e39b-4814-912d-2d88f79463cd\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:24:55.887649 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.887658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/244dd0ac-e39b-4814-912d-2d88f79463cd-manifests\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc\" (UID: \"244dd0ac-e39b-4814-912d-2d88f79463cd\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:24:55.887844 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.887676    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/244dd0ac-e39b-4814-912d-2d88f79463cd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc\" (UID: \"244dd0ac-e39b-4814-912d-2d88f79463cd\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:24:55.887844 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.887724    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqzfj\" (UniqueName: \"kubernetes.io/projected/244dd0ac-e39b-4814-912d-2d88f79463cd-kube-api-access-cqzfj\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc\" (UID: \"244dd0ac-e39b-4814-912d-2d88f79463cd\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:24:55.887844 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.887783    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/244dd0ac-e39b-4814-912d-2d88f79463cd-tmp\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc\" (UID: \"244dd0ac-e39b-4814-912d-2d88f79463cd\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:24:55.888252 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.888228    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/244dd0ac-e39b-4814-912d-2d88f79463cd-manifests\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc\" (UID: \"244dd0ac-e39b-4814-912d-2d88f79463cd\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:24:55.890136 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.890113    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/244dd0ac-e39b-4814-912d-2d88f79463cd-tmp\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc\" (UID: \"244dd0ac-e39b-4814-912d-2d88f79463cd\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:24:55.890359 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.890342    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/244dd0ac-e39b-4814-912d-2d88f79463cd-webhook-cert\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc\" (UID: \"244dd0ac-e39b-4814-912d-2d88f79463cd\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:24:55.890403 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.890358    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/244dd0ac-e39b-4814-912d-2d88f79463cd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc\" (UID: \"244dd0ac-e39b-4814-912d-2d88f79463cd\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:24:55.900711 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.900684    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqzfj\" (UniqueName: \"kubernetes.io/projected/244dd0ac-e39b-4814-912d-2d88f79463cd-kube-api-access-cqzfj\") pod \"opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc\" (UID: \"244dd0ac-e39b-4814-912d-2d88f79463cd\") " pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:24:55.988399 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:55.988372    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:24:56.024933 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:56.024894    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2" event={"ID":"696978a9-e46a-4931-b44a-074ce9e19fa8","Type":"ContainerStarted","Data":"400fabfceb819c55f48756132f4c14c40dc205871d2ed3a5c68e0d1362f63699"}
Jul 06 14:24:56.132079 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:56.132045    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"]
Jul 06 14:24:56.135045 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:24:56.135020    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod244dd0ac_e39b_4814_912d_2d88f79463cd.slice/crio-85216cb36633e8774e5638418b9faf24944ca0cd7d2feebfe4bb89367c6ab776 WatchSource:0}: Error finding container 85216cb36633e8774e5638418b9faf24944ca0cd7d2feebfe4bb89367c6ab776: Status 404 returned error can't find the container with id 85216cb36633e8774e5638418b9faf24944ca0cd7d2feebfe4bb89367c6ab776
Jul 06 14:24:57.033435 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:24:57.033374    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc" event={"ID":"244dd0ac-e39b-4814-912d-2d88f79463cd","Type":"ContainerStarted","Data":"85216cb36633e8774e5638418b9faf24944ca0cd7d2feebfe4bb89367c6ab776"}
Jul 06 14:25:00.050655 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:00.050546    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2" event={"ID":"696978a9-e46a-4931-b44a-074ce9e19fa8","Type":"ContainerStarted","Data":"c79d548af290ab69e0b7811c1ebd29fc73746ab758e69e7cfcd7ff88c5ffd05b"}
Jul 06 14:25:00.051075 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:00.050723    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"
Jul 06 14:25:00.052106 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:00.052085    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc" event={"ID":"244dd0ac-e39b-4814-912d-2d88f79463cd","Type":"ContainerStarted","Data":"bd51e63699c9b5620cbace2f5b5b70eec24be9abfb37e7e46d01da9ec71f5080"}
Jul 06 14:25:00.091635 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:00.091573    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2" podStartSLOduration=1.781171179 podStartE2EDuration="6.091555062s" totalImagesPullingTime="4.310383883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:00.089686062 +0000 UTC m=+280.938573033" watchObservedRunningTime="2026-07-06 14:25:00.091555062 +0000 UTC m=+280.940442033"
Jul 06 14:25:01.057889 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:01.057851    2562 generic.go:356] "Generic (PLEG): container finished" podID="244dd0ac-e39b-4814-912d-2d88f79463cd" containerID="bd51e63699c9b5620cbace2f5b5b70eec24be9abfb37e7e46d01da9ec71f5080" exitCode=0
Jul 06 14:25:01.058318 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:01.057943    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc" event={"ID":"244dd0ac-e39b-4814-912d-2d88f79463cd","Type":"ContainerDied","Data":"bd51e63699c9b5620cbace2f5b5b70eec24be9abfb37e7e46d01da9ec71f5080"}
Jul 06 14:25:02.065124 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:02.065081    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc" event={"ID":"244dd0ac-e39b-4814-912d-2d88f79463cd","Type":"ContainerStarted","Data":"4e77aa04f172f895030e68ca1f0cb41befec448d971590ab07df4c8f353c4894"}
Jul 06 14:25:02.065803 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:02.065172    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:25:02.089779 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:02.089723    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc" podStartSLOduration=1.7173247740000002 podStartE2EDuration="7.089706203s" totalImagesPullingTime="4.273043348s" totalInitContainerRuntime="1.099338081s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:24:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:02.088251664 +0000 UTC m=+282.937138637" watchObservedRunningTime="2026-07-06 14:25:02.089706203 +0000 UTC m=+282.938593174"
Jul 06 14:25:11.060202 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:11.060170    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d677d8c9-2kpz2"
Jul 06 14:25:13.071304 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:13.071267    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc"
Jul 06 14:25:19.594126 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:19.594091    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 14:25:25.436288 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:25.436246    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-64c7864974-sfvtr"]
Jul 06 14:25:25.441230 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:25.439641    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64c7864974-sfvtr"
Jul 06 14:25:25.444855 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:25.444828    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-s2gjs\""
Jul 06 14:25:25.445269 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:25.445248    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 14:25:25.445381 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:25.445249    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 14:25:25.445949 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:25.445927    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 14:25:25.446224 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:25.446208    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 14:25:25.479460 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:25.479426    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64c7864974-sfvtr"]
Jul 06 14:25:25.570571 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:25.570527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5888a1b-6dd0-40b3-aa5c-f1c18d458061-tmp\") pod \"kube-auth-proxy-64c7864974-sfvtr\" (UID: \"a5888a1b-6dd0-40b3-aa5c-f1c18d458061\") " pod="openshift-ingress/kube-auth-proxy-64c7864974-sfvtr"
Jul 06 14:25:25.570755 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:25.570577    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mwrw\" (UniqueName: \"kubernetes.io/projected/a5888a1b-6dd0-40b3-aa5c-f1c18d458061-kube-api-access-4mwrw\") pod \"kube-auth-proxy-64c7864974-sfvtr\" (UID: \"a5888a1b-6dd0-40b3-aa5c-f1c18d458061\") " pod="openshift-ingress/kube-auth-proxy-64c7864974-sfvtr"
Jul 06 14:25:25.570755 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:25.570704    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5888a1b-6dd0-40b3-aa5c-f1c18d458061-tls-certs\") pod \"kube-auth-proxy-64c7864974-sfvtr\" (UID: \"a5888a1b-6dd0-40b3-aa5c-f1c18d458061\") " pod="openshift-ingress/kube-auth-proxy-64c7864974-sfvtr"
Jul 06 14:25:25.672229 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:25.672193    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5888a1b-6dd0-40b3-aa5c-f1c18d458061-tmp\") pod \"kube-auth-proxy-64c7864974-sfvtr\" (UID: \"a5888a1b-6dd0-40b3-aa5c-f1c18d458061\") " pod="openshift-ingress/kube-auth-proxy-64c7864974-sfvtr"
Jul 06 14:25:25.672419 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:25.672247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mwrw\" (UniqueName: \"kubernetes.io/projected/a5888a1b-6dd0-40b3-aa5c-f1c18d458061-kube-api-access-4mwrw\") pod \"kube-auth-proxy-64c7864974-sfvtr\" (UID: \"a5888a1b-6dd0-40b3-aa5c-f1c18d458061\") " pod="openshift-ingress/kube-auth-proxy-64c7864974-sfvtr"
Jul 06 14:25:25.672419 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:25.672351    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5888a1b-6dd0-40b3-aa5c-f1c18d458061-tls-certs\") pod \"kube-auth-proxy-64c7864974-sfvtr\" (UID: \"a5888a1b-6dd0-40b3-aa5c-f1c18d458061\") " pod="openshift-ingress/kube-auth-proxy-64c7864974-sfvtr"
Jul 06 14:25:25.672501 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:25:25.672480    2562 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 06 14:25:25.672554 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:25:25.672543    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5888a1b-6dd0-40b3-aa5c-f1c18d458061-tls-certs podName:a5888a1b-6dd0-40b3-aa5c-f1c18d458061 nodeName:}" failed. No retries permitted until 2026-07-06 14:25:26.172521483 +0000 UTC m=+307.021408446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a5888a1b-6dd0-40b3-aa5c-f1c18d458061-tls-certs") pod "kube-auth-proxy-64c7864974-sfvtr" (UID: "a5888a1b-6dd0-40b3-aa5c-f1c18d458061") : secret "kube-auth-proxy-tls" not found
Jul 06 14:25:25.674573 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:25.674550    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5888a1b-6dd0-40b3-aa5c-f1c18d458061-tmp\") pod \"kube-auth-proxy-64c7864974-sfvtr\" (UID: \"a5888a1b-6dd0-40b3-aa5c-f1c18d458061\") " pod="openshift-ingress/kube-auth-proxy-64c7864974-sfvtr"
Jul 06 14:25:25.702585 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:25.702505    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mwrw\" (UniqueName: \"kubernetes.io/projected/a5888a1b-6dd0-40b3-aa5c-f1c18d458061-kube-api-access-4mwrw\") pod \"kube-auth-proxy-64c7864974-sfvtr\" (UID: \"a5888a1b-6dd0-40b3-aa5c-f1c18d458061\") " pod="openshift-ingress/kube-auth-proxy-64c7864974-sfvtr"
Jul 06 14:25:26.177548 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:26.177509    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5888a1b-6dd0-40b3-aa5c-f1c18d458061-tls-certs\") pod \"kube-auth-proxy-64c7864974-sfvtr\" (UID: \"a5888a1b-6dd0-40b3-aa5c-f1c18d458061\") " pod="openshift-ingress/kube-auth-proxy-64c7864974-sfvtr"
Jul 06 14:25:26.180193 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:26.180166    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5888a1b-6dd0-40b3-aa5c-f1c18d458061-tls-certs\") pod \"kube-auth-proxy-64c7864974-sfvtr\" (UID: \"a5888a1b-6dd0-40b3-aa5c-f1c18d458061\") " pod="openshift-ingress/kube-auth-proxy-64c7864974-sfvtr"
Jul 06 14:25:26.353288 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:26.353250    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64c7864974-sfvtr"
Jul 06 14:25:26.502114 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:26.501931    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64c7864974-sfvtr"]
Jul 06 14:25:26.505466 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:25:26.505437    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5888a1b_6dd0_40b3_aa5c_f1c18d458061.slice/crio-3e0b0a079a8fb5c792ff3970c72bbbb547c2d0faec157c95ec07cb4b16777a53 WatchSource:0}: Error finding container 3e0b0a079a8fb5c792ff3970c72bbbb547c2d0faec157c95ec07cb4b16777a53: Status 404 returned error can't find the container with id 3e0b0a079a8fb5c792ff3970c72bbbb547c2d0faec157c95ec07cb4b16777a53
Jul 06 14:25:26.507280 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:26.507261    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:25:27.188128 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:27.188090    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64c7864974-sfvtr" event={"ID":"a5888a1b-6dd0-40b3-aa5c-f1c18d458061","Type":"ContainerStarted","Data":"3e0b0a079a8fb5c792ff3970c72bbbb547c2d0faec157c95ec07cb4b16777a53"}
Jul 06 14:25:30.202634 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:30.202549    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64c7864974-sfvtr" event={"ID":"a5888a1b-6dd0-40b3-aa5c-f1c18d458061","Type":"ContainerStarted","Data":"11ff380e08f642a387b35f75b1360c544ba4ddf12d2b6f28e53b5da5be781d6b"}
Jul 06 14:25:30.247731 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:25:30.247676    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-64c7864974-sfvtr" podStartSLOduration=1.8163674909999998 podStartE2EDuration="5.247655256s" totalImagesPullingTime="3.431287765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:30.246382124 +0000 UTC m=+311.095269098" watchObservedRunningTime="2026-07-06 14:25:30.247655256 +0000 UTC m=+311.096542226"
Jul 06 14:27:02.509230 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:02.509187    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8skn"]
Jul 06 14:27:02.511609 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:02.511593    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8skn"
Jul 06 14:27:02.514358 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:02.514327    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7h7kf\""
Jul 06 14:27:02.514358 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:02.514330    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 06 14:27:02.514566 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:02.514457    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 14:27:02.515194 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:02.515180    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 14:27:02.524177 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:02.524131    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8skn"]
Jul 06 14:27:02.630650 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:02.630578    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54f9v\" (UniqueName: \"kubernetes.io/projected/68d57c5f-6198-44f7-92c8-7c93c50180d1-kube-api-access-54f9v\") pod \"dns-operator-controller-manager-864dd78c4c-z8skn\" (UID: \"68d57c5f-6198-44f7-92c8-7c93c50180d1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8skn"
Jul 06 14:27:02.731706 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:02.731665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54f9v\" (UniqueName: \"kubernetes.io/projected/68d57c5f-6198-44f7-92c8-7c93c50180d1-kube-api-access-54f9v\") pod \"dns-operator-controller-manager-864dd78c4c-z8skn\" (UID: \"68d57c5f-6198-44f7-92c8-7c93c50180d1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8skn"
Jul 06 14:27:02.744547 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:02.744509    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54f9v\" (UniqueName: \"kubernetes.io/projected/68d57c5f-6198-44f7-92c8-7c93c50180d1-kube-api-access-54f9v\") pod \"dns-operator-controller-manager-864dd78c4c-z8skn\" (UID: \"68d57c5f-6198-44f7-92c8-7c93c50180d1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8skn"
Jul 06 14:27:02.822190 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:02.822077    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8skn"
Jul 06 14:27:02.966764 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:02.966727    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8skn"]
Jul 06 14:27:02.970479 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:27:02.970445    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d57c5f_6198_44f7_92c8_7c93c50180d1.slice/crio-ae224185cb82b9c2328b6566293d7d93960232a3f683bb0446d5c57bc31b2951 WatchSource:0}: Error finding container ae224185cb82b9c2328b6566293d7d93960232a3f683bb0446d5c57bc31b2951: Status 404 returned error can't find the container with id ae224185cb82b9c2328b6566293d7d93960232a3f683bb0446d5c57bc31b2951
Jul 06 14:27:03.458304 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:03.458272    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-z69sf"]
Jul 06 14:27:03.461824 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:03.461808    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z69sf"
Jul 06 14:27:03.470323 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:03.470301    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7h9gg\""
Jul 06 14:27:03.470465 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:03.470333    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 06 14:27:03.476878 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:03.476850    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 06 14:27:03.499235 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:03.499200    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-z69sf"]
Jul 06 14:27:03.633358 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:03.633328    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8skn" event={"ID":"68d57c5f-6198-44f7-92c8-7c93c50180d1","Type":"ContainerStarted","Data":"ae224185cb82b9c2328b6566293d7d93960232a3f683bb0446d5c57bc31b2951"}
Jul 06 14:27:03.640746 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:03.640711    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffa0524c-118f-4fa1-a5c7-f58de1788dcd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-z69sf\" (UID: \"ffa0524c-118f-4fa1-a5c7-f58de1788dcd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z69sf"
Jul 06 14:27:03.640916 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:03.640775    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ffa0524c-118f-4fa1-a5c7-f58de1788dcd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-z69sf\" (UID: \"ffa0524c-118f-4fa1-a5c7-f58de1788dcd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z69sf"
Jul 06 14:27:03.640916 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:03.640893    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4zk7\" (UniqueName: \"kubernetes.io/projected/ffa0524c-118f-4fa1-a5c7-f58de1788dcd-kube-api-access-j4zk7\") pod \"kuadrant-console-plugin-66b5774985-z69sf\" (UID: \"ffa0524c-118f-4fa1-a5c7-f58de1788dcd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z69sf"
Jul 06 14:27:03.742330 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:03.742279    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ffa0524c-118f-4fa1-a5c7-f58de1788dcd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-z69sf\" (UID: \"ffa0524c-118f-4fa1-a5c7-f58de1788dcd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z69sf"
Jul 06 14:27:03.742530 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:03.742376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4zk7\" (UniqueName: \"kubernetes.io/projected/ffa0524c-118f-4fa1-a5c7-f58de1788dcd-kube-api-access-j4zk7\") pod \"kuadrant-console-plugin-66b5774985-z69sf\" (UID: \"ffa0524c-118f-4fa1-a5c7-f58de1788dcd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z69sf"
Jul 06 14:27:03.742530 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:03.742473    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffa0524c-118f-4fa1-a5c7-f58de1788dcd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-z69sf\" (UID: \"ffa0524c-118f-4fa1-a5c7-f58de1788dcd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z69sf"
Jul 06 14:27:03.742642 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:27:03.742598    2562 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 06 14:27:03.742694 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:27:03.742679    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffa0524c-118f-4fa1-a5c7-f58de1788dcd-plugin-serving-cert podName:ffa0524c-118f-4fa1-a5c7-f58de1788dcd nodeName:}" failed. No retries permitted until 2026-07-06 14:27:04.242658417 +0000 UTC m=+405.091545367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/ffa0524c-118f-4fa1-a5c7-f58de1788dcd-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-z69sf" (UID: "ffa0524c-118f-4fa1-a5c7-f58de1788dcd") : secret "plugin-serving-cert" not found
Jul 06 14:27:03.742939 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:03.742913    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ffa0524c-118f-4fa1-a5c7-f58de1788dcd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-z69sf\" (UID: \"ffa0524c-118f-4fa1-a5c7-f58de1788dcd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z69sf"
Jul 06 14:27:03.757426 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:03.757387    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4zk7\" (UniqueName: \"kubernetes.io/projected/ffa0524c-118f-4fa1-a5c7-f58de1788dcd-kube-api-access-j4zk7\") pod \"kuadrant-console-plugin-66b5774985-z69sf\" (UID: \"ffa0524c-118f-4fa1-a5c7-f58de1788dcd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z69sf"
Jul 06 14:27:04.247885 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:04.247840    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffa0524c-118f-4fa1-a5c7-f58de1788dcd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-z69sf\" (UID: \"ffa0524c-118f-4fa1-a5c7-f58de1788dcd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z69sf"
Jul 06 14:27:04.250743 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:04.250717    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffa0524c-118f-4fa1-a5c7-f58de1788dcd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-z69sf\" (UID: \"ffa0524c-118f-4fa1-a5c7-f58de1788dcd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z69sf"
Jul 06 14:27:04.371473 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:04.371433    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z69sf"
Jul 06 14:27:04.517075 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:04.517011    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-z69sf"]
Jul 06 14:27:04.519600 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:27:04.519574    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffa0524c_118f_4fa1_a5c7_f58de1788dcd.slice/crio-eb3249d1c67ebd59b449298fccbe30d28224a3c5189687dd834b081731b9bd3f WatchSource:0}: Error finding container eb3249d1c67ebd59b449298fccbe30d28224a3c5189687dd834b081731b9bd3f: Status 404 returned error can't find the container with id eb3249d1c67ebd59b449298fccbe30d28224a3c5189687dd834b081731b9bd3f
Jul 06 14:27:04.639606 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:04.639565    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z69sf" event={"ID":"ffa0524c-118f-4fa1-a5c7-f58de1788dcd","Type":"ContainerStarted","Data":"eb3249d1c67ebd59b449298fccbe30d28224a3c5189687dd834b081731b9bd3f"}
Jul 06 14:27:05.646666 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:05.646630    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8skn" event={"ID":"68d57c5f-6198-44f7-92c8-7c93c50180d1","Type":"ContainerStarted","Data":"67477229c3ea5065e1779e638664dda974e2157e8b357e56d6ddc63f6dc8fc1a"}
Jul 06 14:27:05.647179 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:05.646768    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8skn"
Jul 06 14:27:05.667360 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:05.667078    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8skn" podStartSLOduration=1.652517092 podStartE2EDuration="3.667060912s" totalImagesPullingTime="2.01454382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:27:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:27:05.665740307 +0000 UTC m=+406.514627278" watchObservedRunningTime="2026-07-06 14:27:05.667060912 +0000 UTC m=+406.515947886"
Jul 06 14:27:14.067842 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:14.067800    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2nwb"]
Jul 06 14:27:14.077660 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:14.077632    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2nwb"
Jul 06 14:27:14.089187 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:14.089134    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-psqvr\""
Jul 06 14:27:14.101650 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:14.101617    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2nwb"]
Jul 06 14:27:14.101996 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:27:14.101961    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-2bxvp], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-2bxvp]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2nwb" podUID="4a3acbab-d218-4aca-9881-02b83de8df19"
Jul 06 14:27:14.121896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:14.121863    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2nwb"]
Jul 06 14:27:14.194725 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:27:14.194657    2562 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4a3acbab-d218-4aca-9881-02b83de8df19\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-06T14:27:14Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-06T14:27:14Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-06T14:27:14Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-06T14:27:14Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/kuadrant/kuadrant-operator:v1.4.2\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/kuadrant\\\",\\\"name\\\":\\\"extensions-socket-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2bxvp\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.135.124\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.135.124\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-06T14:27:14Z\\\"}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-86878c769f-q2nwb\": pods \"kuadrant-operator-controller-manager-86878c769f-q2nwb\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2nwb"
Jul 06 14:27:14.395987 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:14.395911    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm749"]
Jul 06 14:27:14.401688 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:14.401657    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm749"
Jul 06 14:27:14.405460 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:14.405429    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6cpnc\""
Jul 06 14:27:14.446390 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:14.446352    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv5ml\" (UniqueName: \"kubernetes.io/projected/f9309411-fc65-412a-b53d-b5acfd154b99-kube-api-access-xv5ml\") pod \"limitador-operator-controller-manager-859d7b78bd-qm749\" (UID: \"f9309411-fc65-412a-b53d-b5acfd154b99\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm749"
Jul 06 14:27:14.453099 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:14.453063    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm749"]
Jul 06 14:27:14.480799 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:27:14.480750    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-q2nwb\" is forbidden: User \"system:node:ip-10-0-135-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-124.ec2.internal' and this object" podUID="4a3acbab-d218-4aca-9881-02b83de8df19" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2nwb"
Jul 06 14:27:14.547394 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:14.547353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv5ml\" (UniqueName: \"kubernetes.io/projected/f9309411-fc65-412a-b53d-b5acfd154b99-kube-api-access-xv5ml\") pod \"limitador-operator-controller-manager-859d7b78bd-qm749\" (UID: \"f9309411-fc65-412a-b53d-b5acfd154b99\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm749"
Jul 06 14:27:14.561813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:14.561759    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv5ml\" (UniqueName: \"kubernetes.io/projected/f9309411-fc65-412a-b53d-b5acfd154b99-kube-api-access-xv5ml\") pod \"limitador-operator-controller-manager-859d7b78bd-qm749\" (UID: \"f9309411-fc65-412a-b53d-b5acfd154b99\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm749"
Jul 06 14:27:14.697698 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:14.697626    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2nwb"
Jul 06 14:27:14.700130 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:27:14.700088    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-q2nwb\" is forbidden: User \"system:node:ip-10-0-135-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-124.ec2.internal' and this object" podUID="4a3acbab-d218-4aca-9881-02b83de8df19" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2nwb"
Jul 06 14:27:14.713178 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:14.713131    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2nwb"
Jul 06 14:27:14.714939 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:14.714910    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm749"
Jul 06 14:27:14.715627 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:27:14.715591    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-q2nwb\" is forbidden: User \"system:node:ip-10-0-135-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-124.ec2.internal' and this object" podUID="4a3acbab-d218-4aca-9881-02b83de8df19" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2nwb"
Jul 06 14:27:15.702062 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:15.702030    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2nwb"
Jul 06 14:27:15.708585 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:27:15.708547    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-q2nwb\" is forbidden: User \"system:node:ip-10-0-135-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-124.ec2.internal' and this object" podUID="4a3acbab-d218-4aca-9881-02b83de8df19" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2nwb"
Jul 06 14:27:15.713376 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:27:15.713344    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-q2nwb\" is forbidden: User \"system:node:ip-10-0-135-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-124.ec2.internal' and this object" podUID="4a3acbab-d218-4aca-9881-02b83de8df19" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q2nwb"
Jul 06 14:27:15.747451 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:15.747422    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a3acbab-d218-4aca-9881-02b83de8df19" path="/var/lib/kubelet/pods/4a3acbab-d218-4aca-9881-02b83de8df19/volumes"
Jul 06 14:27:16.655372 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:16.655339    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-z8skn"
Jul 06 14:27:27.295183 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:27.295132    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm749"]
Jul 06 14:27:27.492894 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:27:27.492854    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9309411_fc65_412a_b53d_b5acfd154b99.slice/crio-a1162876f4a553515242aed06af1d1b220cc22813e350c6a3ed92c8a69d59991 WatchSource:0}: Error finding container a1162876f4a553515242aed06af1d1b220cc22813e350c6a3ed92c8a69d59991: Status 404 returned error can't find the container with id a1162876f4a553515242aed06af1d1b220cc22813e350c6a3ed92c8a69d59991
Jul 06 14:27:27.776105 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:27.776018    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z69sf" event={"ID":"ffa0524c-118f-4fa1-a5c7-f58de1788dcd","Type":"ContainerStarted","Data":"7f367f0309a399c3a69b0eaf67e86a703674a3c3d686fc6d5aae3c8035d73b8a"}
Jul 06 14:27:27.777278 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:27.777247    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm749" event={"ID":"f9309411-fc65-412a-b53d-b5acfd154b99","Type":"ContainerStarted","Data":"a1162876f4a553515242aed06af1d1b220cc22813e350c6a3ed92c8a69d59991"}
Jul 06 14:27:27.808905 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:27.808851    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-z69sf" podStartSLOduration=1.778064071 podStartE2EDuration="24.80882242s" totalImagesPullingTime="23.030758349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:27:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:27:27.80843766 +0000 UTC m=+428.657324631" watchObservedRunningTime="2026-07-06 14:27:27.80882242 +0000 UTC m=+428.657709391"
Jul 06 14:27:31.799787 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:31.799729    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm749" event={"ID":"f9309411-fc65-412a-b53d-b5acfd154b99","Type":"ContainerStarted","Data":"eee80a4a5503f9e520420388f022a665e430bb3aa02dad4ce936d52fe52a1d57"}
Jul 06 14:27:31.800217 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:31.799854    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm749"
Jul 06 14:27:31.833976 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:31.833918    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm749" podStartSLOduration=14.097260756 podStartE2EDuration="17.833901887s" totalImagesPullingTime="3.736641131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:27:31.832776478 +0000 UTC m=+432.681663453" watchObservedRunningTime="2026-07-06 14:27:31.833901887 +0000 UTC m=+432.682788858"
Jul 06 14:27:42.807082 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:42.807001    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qm749"
Jul 06 14:27:54.251283 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:54.251250    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-vvbps"]
Jul 06 14:27:54.380932 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:54.380889    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vvbps"]
Jul 06 14:27:54.381130 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:54.381025    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vvbps"
Jul 06 14:27:54.385568 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:54.385544    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6h22t\""
Jul 06 14:27:54.421417 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:54.421380    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qskr2\" (UniqueName: \"kubernetes.io/projected/1fde4ac6-8267-4728-b6ea-30a500b2717d-kube-api-access-qskr2\") pod \"authorino-75d556bd77-vvbps\" (UID: \"1fde4ac6-8267-4728-b6ea-30a500b2717d\") " pod="kuadrant-system/authorino-75d556bd77-vvbps"
Jul 06 14:27:54.522671 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:54.522593    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qskr2\" (UniqueName: \"kubernetes.io/projected/1fde4ac6-8267-4728-b6ea-30a500b2717d-kube-api-access-qskr2\") pod \"authorino-75d556bd77-vvbps\" (UID: \"1fde4ac6-8267-4728-b6ea-30a500b2717d\") " pod="kuadrant-system/authorino-75d556bd77-vvbps"
Jul 06 14:27:54.537319 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:54.537256    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qskr2\" (UniqueName: \"kubernetes.io/projected/1fde4ac6-8267-4728-b6ea-30a500b2717d-kube-api-access-qskr2\") pod \"authorino-75d556bd77-vvbps\" (UID: \"1fde4ac6-8267-4728-b6ea-30a500b2717d\") " pod="kuadrant-system/authorino-75d556bd77-vvbps"
Jul 06 14:27:54.692423 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:54.690626    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vvbps"
Jul 06 14:27:54.958468 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:54.958437    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vvbps"]
Jul 06 14:27:54.961931 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:27:54.961905    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fde4ac6_8267_4728_b6ea_30a500b2717d.slice/crio-09994e0d85ffe36c2723ba51db5163a7b614a4b3d2b0c89e9fbb9532fa094918 WatchSource:0}: Error finding container 09994e0d85ffe36c2723ba51db5163a7b614a4b3d2b0c89e9fbb9532fa094918: Status 404 returned error can't find the container with id 09994e0d85ffe36c2723ba51db5163a7b614a4b3d2b0c89e9fbb9532fa094918
Jul 06 14:27:55.920009 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:55.919963    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vvbps" event={"ID":"1fde4ac6-8267-4728-b6ea-30a500b2717d","Type":"ContainerStarted","Data":"09994e0d85ffe36c2723ba51db5163a7b614a4b3d2b0c89e9fbb9532fa094918"}
Jul 06 14:27:58.937503 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:58.937468    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vvbps" event={"ID":"1fde4ac6-8267-4728-b6ea-30a500b2717d","Type":"ContainerStarted","Data":"c361330ed967da6ffe7258151ed87011377dcf5bab83c0a557d9680b827cf23a"}
Jul 06 14:27:58.954980 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:27:58.954923    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-vvbps" podStartSLOduration=1.851506777 podStartE2EDuration="4.954905779s" totalImagesPullingTime="3.103399002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:27:58.95355377 +0000 UTC m=+459.802440741" watchObservedRunningTime="2026-07-06 14:27:58.954905779 +0000 UTC m=+459.803792749"
Jul 06 14:28:29.958624 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:28:29.958589    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vvbps"]
Jul 06 14:28:29.959206 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:28:29.958756    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-vvbps" podUID="1fde4ac6-8267-4728-b6ea-30a500b2717d" containerName="authorino" containerID="cri-o://c361330ed967da6ffe7258151ed87011377dcf5bab83c0a557d9680b827cf23a" gracePeriod=30
Jul 06 14:28:30.081757 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:28:30.081726    2562 generic.go:356] "Generic (PLEG): container finished" podID="1fde4ac6-8267-4728-b6ea-30a500b2717d" containerID="c361330ed967da6ffe7258151ed87011377dcf5bab83c0a557d9680b827cf23a" exitCode=0
Jul 06 14:28:30.081907 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:28:30.081808    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vvbps" event={"ID":"1fde4ac6-8267-4728-b6ea-30a500b2717d","Type":"ContainerDied","Data":"c361330ed967da6ffe7258151ed87011377dcf5bab83c0a557d9680b827cf23a"}
Jul 06 14:28:30.208081 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:28:30.208049    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vvbps"
Jul 06 14:28:30.253308 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:28:30.253270    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qskr2\" (UniqueName: \"kubernetes.io/projected/1fde4ac6-8267-4728-b6ea-30a500b2717d-kube-api-access-qskr2\") pod \"1fde4ac6-8267-4728-b6ea-30a500b2717d\" (UID: \"1fde4ac6-8267-4728-b6ea-30a500b2717d\") "
Jul 06 14:28:30.255684 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:28:30.255652    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fde4ac6-8267-4728-b6ea-30a500b2717d-kube-api-access-qskr2" (OuterVolumeSpecName: "kube-api-access-qskr2") pod "1fde4ac6-8267-4728-b6ea-30a500b2717d" (UID: "1fde4ac6-8267-4728-b6ea-30a500b2717d"). InnerVolumeSpecName "kube-api-access-qskr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:28:30.353935 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:28:30.353897    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qskr2\" (UniqueName: \"kubernetes.io/projected/1fde4ac6-8267-4728-b6ea-30a500b2717d-kube-api-access-qskr2\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:28:31.087772 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:28:31.087739    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vvbps"
Jul 06 14:28:31.088249 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:28:31.087784    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vvbps" event={"ID":"1fde4ac6-8267-4728-b6ea-30a500b2717d","Type":"ContainerDied","Data":"09994e0d85ffe36c2723ba51db5163a7b614a4b3d2b0c89e9fbb9532fa094918"}
Jul 06 14:28:31.088249 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:28:31.087835    2562 scope.go:117] "RemoveContainer" containerID="c361330ed967da6ffe7258151ed87011377dcf5bab83c0a557d9680b827cf23a"
Jul 06 14:28:31.109464 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:28:31.109441    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vvbps"]
Jul 06 14:28:31.112127 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:28:31.112106    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vvbps"]
Jul 06 14:28:31.746073 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:28:31.746040    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fde4ac6-8267-4728-b6ea-30a500b2717d" path="/var/lib/kubelet/pods/1fde4ac6-8267-4728-b6ea-30a500b2717d/volumes"
Jul 06 14:29:43.740514 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.740474    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"]
Jul 06 14:29:43.740973 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.740847    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fde4ac6-8267-4728-b6ea-30a500b2717d" containerName="authorino"
Jul 06 14:29:43.740973 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.740858    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fde4ac6-8267-4728-b6ea-30a500b2717d" containerName="authorino"
Jul 06 14:29:43.740973 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.740937    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fde4ac6-8267-4728-b6ea-30a500b2717d" containerName="authorino"
Jul 06 14:29:43.743937 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.743914    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:43.748095 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.748074    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pgwdp\""
Jul 06 14:29:43.748250 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.748232    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 14:29:43.749081 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.749058    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 14:29:43.749207 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.749084    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 06 14:29:43.777492 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.777458    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"]
Jul 06 14:29:43.816508 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.816467    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fef66f7-97f3-4124-94e8-d53365c88db5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mmgm4\" (UID: \"0fef66f7-97f3-4124-94e8-d53365c88db5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:43.816710 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.816538    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fef66f7-97f3-4124-94e8-d53365c88db5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mmgm4\" (UID: \"0fef66f7-97f3-4124-94e8-d53365c88db5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:43.816710 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.816564    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fef66f7-97f3-4124-94e8-d53365c88db5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mmgm4\" (UID: \"0fef66f7-97f3-4124-94e8-d53365c88db5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:43.816710 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.816617    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-726f2\" (UniqueName: \"kubernetes.io/projected/0fef66f7-97f3-4124-94e8-d53365c88db5-kube-api-access-726f2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mmgm4\" (UID: \"0fef66f7-97f3-4124-94e8-d53365c88db5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:43.816710 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.816658    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fef66f7-97f3-4124-94e8-d53365c88db5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mmgm4\" (UID: \"0fef66f7-97f3-4124-94e8-d53365c88db5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:43.816710 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.816687    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fef66f7-97f3-4124-94e8-d53365c88db5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mmgm4\" (UID: \"0fef66f7-97f3-4124-94e8-d53365c88db5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:43.917823 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.917781    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-726f2\" (UniqueName: \"kubernetes.io/projected/0fef66f7-97f3-4124-94e8-d53365c88db5-kube-api-access-726f2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mmgm4\" (UID: \"0fef66f7-97f3-4124-94e8-d53365c88db5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:43.917823 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.917826    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fef66f7-97f3-4124-94e8-d53365c88db5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mmgm4\" (UID: \"0fef66f7-97f3-4124-94e8-d53365c88db5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:43.918061 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.917851    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fef66f7-97f3-4124-94e8-d53365c88db5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mmgm4\" (UID: \"0fef66f7-97f3-4124-94e8-d53365c88db5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:43.918061 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.917890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fef66f7-97f3-4124-94e8-d53365c88db5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mmgm4\" (UID: \"0fef66f7-97f3-4124-94e8-d53365c88db5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:43.918061 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.917924    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fef66f7-97f3-4124-94e8-d53365c88db5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mmgm4\" (UID: \"0fef66f7-97f3-4124-94e8-d53365c88db5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:43.918061 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.917961    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fef66f7-97f3-4124-94e8-d53365c88db5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mmgm4\" (UID: \"0fef66f7-97f3-4124-94e8-d53365c88db5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:43.918452 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.918408    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fef66f7-97f3-4124-94e8-d53365c88db5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mmgm4\" (UID: \"0fef66f7-97f3-4124-94e8-d53365c88db5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:43.918564 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.918422    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fef66f7-97f3-4124-94e8-d53365c88db5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mmgm4\" (UID: \"0fef66f7-97f3-4124-94e8-d53365c88db5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:43.918564 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.918478    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fef66f7-97f3-4124-94e8-d53365c88db5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mmgm4\" (UID: \"0fef66f7-97f3-4124-94e8-d53365c88db5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:43.920351 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.920321    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fef66f7-97f3-4124-94e8-d53365c88db5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mmgm4\" (UID: \"0fef66f7-97f3-4124-94e8-d53365c88db5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:43.920798 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.920779    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fef66f7-97f3-4124-94e8-d53365c88db5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mmgm4\" (UID: \"0fef66f7-97f3-4124-94e8-d53365c88db5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:43.927514 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:43.927485    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-726f2\" (UniqueName: \"kubernetes.io/projected/0fef66f7-97f3-4124-94e8-d53365c88db5-kube-api-access-726f2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mmgm4\" (UID: \"0fef66f7-97f3-4124-94e8-d53365c88db5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:44.055337 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:44.055241    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:44.195188 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:44.195135    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"]
Jul 06 14:29:44.197359 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:29:44.197329    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fef66f7_97f3_4124_94e8_d53365c88db5.slice/crio-824db1b40c9b03e0fd6009daacfa43713cdf0f1108dc7eca9757131381172fd8 WatchSource:0}: Error finding container 824db1b40c9b03e0fd6009daacfa43713cdf0f1108dc7eca9757131381172fd8: Status 404 returned error can't find the container with id 824db1b40c9b03e0fd6009daacfa43713cdf0f1108dc7eca9757131381172fd8
Jul 06 14:29:44.436202 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:44.436087    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4" event={"ID":"0fef66f7-97f3-4124-94e8-d53365c88db5","Type":"ContainerStarted","Data":"824db1b40c9b03e0fd6009daacfa43713cdf0f1108dc7eca9757131381172fd8"}
Jul 06 14:29:45.442634 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:45.442587    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4" event={"ID":"0fef66f7-97f3-4124-94e8-d53365c88db5","Type":"ContainerStarted","Data":"c3b0eaffa90504623d0382e4eb46bde69fd7f917b9299bc1b72e01699262e69d"}
Jul 06 14:29:45.469741 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:45.469682    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4" podStartSLOduration=1.398555261 podStartE2EDuration="2.469666961s" totalImagesPullingTime="1.0711117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:45.467549484 +0000 UTC m=+566.316436454" watchObservedRunningTime="2026-07-06 14:29:45.469666961 +0000 UTC m=+566.318553931"
Jul 06 14:29:47.757035 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.757005    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"]
Jul 06 14:29:47.760678 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.760644    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:47.764807 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.764776    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 06 14:29:47.780491 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.780452    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"]
Jul 06 14:29:47.857051 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.857015    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88f4db39-0c3c-4b73-a0bb-6ffa22b4390f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztbg8\" (UID: \"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:47.857251 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.857068    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f4db39-0c3c-4b73-a0bb-6ffa22b4390f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztbg8\" (UID: \"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:47.857251 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.857212    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88f4db39-0c3c-4b73-a0bb-6ffa22b4390f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztbg8\" (UID: \"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:47.857251 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.857238    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhvrw\" (UniqueName: \"kubernetes.io/projected/88f4db39-0c3c-4b73-a0bb-6ffa22b4390f-kube-api-access-zhvrw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztbg8\" (UID: \"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:47.857361 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.857259    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88f4db39-0c3c-4b73-a0bb-6ffa22b4390f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztbg8\" (UID: \"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:47.857361 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.857275    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88f4db39-0c3c-4b73-a0bb-6ffa22b4390f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztbg8\" (UID: \"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:47.958382 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.958356    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88f4db39-0c3c-4b73-a0bb-6ffa22b4390f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztbg8\" (UID: \"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:47.958513 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.958390    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhvrw\" (UniqueName: \"kubernetes.io/projected/88f4db39-0c3c-4b73-a0bb-6ffa22b4390f-kube-api-access-zhvrw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztbg8\" (UID: \"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:47.958513 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.958411    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88f4db39-0c3c-4b73-a0bb-6ffa22b4390f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztbg8\" (UID: \"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:47.958513 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.958428    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88f4db39-0c3c-4b73-a0bb-6ffa22b4390f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztbg8\" (UID: \"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:47.958513 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.958459    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88f4db39-0c3c-4b73-a0bb-6ffa22b4390f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztbg8\" (UID: \"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:47.958660 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.958589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f4db39-0c3c-4b73-a0bb-6ffa22b4390f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztbg8\" (UID: \"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:47.958858 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.958833    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88f4db39-0c3c-4b73-a0bb-6ffa22b4390f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztbg8\" (UID: \"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:47.958936 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.958874    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88f4db39-0c3c-4b73-a0bb-6ffa22b4390f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztbg8\" (UID: \"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:47.958991 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.958927    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f4db39-0c3c-4b73-a0bb-6ffa22b4390f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztbg8\" (UID: \"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:47.960919 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.960901    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88f4db39-0c3c-4b73-a0bb-6ffa22b4390f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztbg8\" (UID: \"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:47.961296 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.961275    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88f4db39-0c3c-4b73-a0bb-6ffa22b4390f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztbg8\" (UID: \"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:47.969778 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:47.969751    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhvrw\" (UniqueName: \"kubernetes.io/projected/88f4db39-0c3c-4b73-a0bb-6ffa22b4390f-kube-api-access-zhvrw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ztbg8\" (UID: \"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:48.071397 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:48.071308    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:48.222364 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:48.222337    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"]
Jul 06 14:29:48.223208 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:29:48.223183    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f4db39_0c3c_4b73_a0bb_6ffa22b4390f.slice/crio-9ed50ec7c5403ad63bea5937044b39afaeabf64e6fa6cac83c70562854c0c6fe WatchSource:0}: Error finding container 9ed50ec7c5403ad63bea5937044b39afaeabf64e6fa6cac83c70562854c0c6fe: Status 404 returned error can't find the container with id 9ed50ec7c5403ad63bea5937044b39afaeabf64e6fa6cac83c70562854c0c6fe
Jul 06 14:29:48.456688 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:48.456651    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8" event={"ID":"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f","Type":"ContainerStarted","Data":"9ed50ec7c5403ad63bea5937044b39afaeabf64e6fa6cac83c70562854c0c6fe"}
Jul 06 14:29:49.466200 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:49.466134    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8" event={"ID":"88f4db39-0c3c-4b73-a0bb-6ffa22b4390f","Type":"ContainerStarted","Data":"188c7959ff270dc0ac576dd2393a2a40ac70918799ca042e410b8804c789f6d2"}
Jul 06 14:29:49.497899 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:49.497841    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8" podStartSLOduration=2.289836295 podStartE2EDuration="2.497823732s" totalImagesPullingTime="207.987437ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:29:49.495838929 +0000 UTC m=+570.344725900" watchObservedRunningTime="2026-07-06 14:29:49.497823732 +0000 UTC m=+570.346710749"
Jul 06 14:29:54.056192 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:54.056127    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:54.056633 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:54.056225    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:54.069348 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:54.069315    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:54.500768 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:54.500735    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mmgm4"
Jul 06 14:29:58.071466 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:58.071427    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:58.071894 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:58.071493    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:58.084026 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:58.083996    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:29:58.518964 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:29:58.518938    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ztbg8"
Jul 06 14:31:45.204724 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:31:45.204691    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67cf869ff4-gt2jd"]
Jul 06 14:31:45.207901 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:31:45.207882    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67cf869ff4-gt2jd"
Jul 06 14:31:45.211469 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:31:45.211447    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 14:31:45.211606 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:31:45.211479    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6h22t\""
Jul 06 14:31:45.217274 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:31:45.217251    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67cf869ff4-gt2jd"]
Jul 06 14:31:45.337361 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:31:45.337322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5vlk\" (UniqueName: \"kubernetes.io/projected/8bf4159a-1dae-4724-92c1-db6b78fcf809-kube-api-access-q5vlk\") pod \"authorino-67cf869ff4-gt2jd\" (UID: \"8bf4159a-1dae-4724-92c1-db6b78fcf809\") " pod="kuadrant-system/authorino-67cf869ff4-gt2jd"
Jul 06 14:31:45.337557 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:31:45.337405    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8bf4159a-1dae-4724-92c1-db6b78fcf809-tls-cert\") pod \"authorino-67cf869ff4-gt2jd\" (UID: \"8bf4159a-1dae-4724-92c1-db6b78fcf809\") " pod="kuadrant-system/authorino-67cf869ff4-gt2jd"
Jul 06 14:31:45.438624 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:31:45.438570    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8bf4159a-1dae-4724-92c1-db6b78fcf809-tls-cert\") pod \"authorino-67cf869ff4-gt2jd\" (UID: \"8bf4159a-1dae-4724-92c1-db6b78fcf809\") " pod="kuadrant-system/authorino-67cf869ff4-gt2jd"
Jul 06 14:31:45.438781 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:31:45.438671    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5vlk\" (UniqueName: \"kubernetes.io/projected/8bf4159a-1dae-4724-92c1-db6b78fcf809-kube-api-access-q5vlk\") pod \"authorino-67cf869ff4-gt2jd\" (UID: \"8bf4159a-1dae-4724-92c1-db6b78fcf809\") " pod="kuadrant-system/authorino-67cf869ff4-gt2jd"
Jul 06 14:31:45.441307 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:31:45.441283    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8bf4159a-1dae-4724-92c1-db6b78fcf809-tls-cert\") pod \"authorino-67cf869ff4-gt2jd\" (UID: \"8bf4159a-1dae-4724-92c1-db6b78fcf809\") " pod="kuadrant-system/authorino-67cf869ff4-gt2jd"
Jul 06 14:31:45.450318 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:31:45.450293    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5vlk\" (UniqueName: \"kubernetes.io/projected/8bf4159a-1dae-4724-92c1-db6b78fcf809-kube-api-access-q5vlk\") pod \"authorino-67cf869ff4-gt2jd\" (UID: \"8bf4159a-1dae-4724-92c1-db6b78fcf809\") " pod="kuadrant-system/authorino-67cf869ff4-gt2jd"
Jul 06 14:31:45.517392 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:31:45.517355    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67cf869ff4-gt2jd"
Jul 06 14:31:45.679578 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:31:45.679551    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67cf869ff4-gt2jd"]
Jul 06 14:31:45.682022 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:31:45.681995    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bf4159a_1dae_4724_92c1_db6b78fcf809.slice/crio-44f69d3822e2ba6fba2a51cd9ae832d85974033c199091da7e68e961e5fd5cc7 WatchSource:0}: Error finding container 44f69d3822e2ba6fba2a51cd9ae832d85974033c199091da7e68e961e5fd5cc7: Status 404 returned error can't find the container with id 44f69d3822e2ba6fba2a51cd9ae832d85974033c199091da7e68e961e5fd5cc7
Jul 06 14:31:45.683308 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:31:45.683292    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:31:46.026684 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:31:46.026649    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67cf869ff4-gt2jd" event={"ID":"8bf4159a-1dae-4724-92c1-db6b78fcf809","Type":"ContainerStarted","Data":"44f69d3822e2ba6fba2a51cd9ae832d85974033c199091da7e68e961e5fd5cc7"}
Jul 06 14:31:47.036033 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:31:47.035254    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67cf869ff4-gt2jd" event={"ID":"8bf4159a-1dae-4724-92c1-db6b78fcf809","Type":"ContainerStarted","Data":"69474bf3d3805dc427892f0d386218d0787de251ba75c3c1a0d340a84466e98c"}
Jul 06 14:31:47.066235 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:31:47.066168    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-67cf869ff4-gt2jd" podStartSLOduration=1.649613524 podStartE2EDuration="2.066126817s" totalImagesPullingTime="416.513293ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:31:47.062639877 +0000 UTC m=+687.911526829" watchObservedRunningTime="2026-07-06 14:31:47.066126817 +0000 UTC m=+687.915013793"
Jul 06 14:52:42.229532 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.229494    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"]
Jul 06 14:52:42.232996 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.232979    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.236262 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.236238    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-421cfb\"/\"test-model-421cfb-kserve-self-signed-certs\""
Jul 06 14:52:42.237205 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.237183    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-421cfb\"/\"openshift-service-ca.crt\""
Jul 06 14:52:42.237310 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.237238    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-421cfb\"/\"kube-root-ca.crt\""
Jul 06 14:52:42.237310 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.237281    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-421cfb\"/\"default-dockercfg-v7wtk\""
Jul 06 14:52:42.246040 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.246011    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"]
Jul 06 14:52:42.383168 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.383115    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-dshm\") pod \"test-model-421cfb-kserve-6dbbc7994f-kzzgq\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") " pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.383342 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.383178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xswss\" (UniqueName: \"kubernetes.io/projected/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-kube-api-access-xswss\") pod \"test-model-421cfb-kserve-6dbbc7994f-kzzgq\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") " pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.383342 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.383258    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-model-cache\") pod \"test-model-421cfb-kserve-6dbbc7994f-kzzgq\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") " pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.383342 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.383294    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-tls-certs\") pod \"test-model-421cfb-kserve-6dbbc7994f-kzzgq\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") " pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.383342 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.383322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-home\") pod \"test-model-421cfb-kserve-6dbbc7994f-kzzgq\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") " pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.383475 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.383353    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-tmp-dir\") pod \"test-model-421cfb-kserve-6dbbc7994f-kzzgq\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") " pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.484135 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.484040    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-model-cache\") pod \"test-model-421cfb-kserve-6dbbc7994f-kzzgq\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") " pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.484135 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.484090    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-tls-certs\") pod \"test-model-421cfb-kserve-6dbbc7994f-kzzgq\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") " pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.484382 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.484218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-home\") pod \"test-model-421cfb-kserve-6dbbc7994f-kzzgq\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") " pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.484382 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.484260    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-tmp-dir\") pod \"test-model-421cfb-kserve-6dbbc7994f-kzzgq\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") " pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.484494 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.484380    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-dshm\") pod \"test-model-421cfb-kserve-6dbbc7994f-kzzgq\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") " pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.484494 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.484410    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xswss\" (UniqueName: \"kubernetes.io/projected/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-kube-api-access-xswss\") pod \"test-model-421cfb-kserve-6dbbc7994f-kzzgq\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") " pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.484597 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.484564    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-model-cache\") pod \"test-model-421cfb-kserve-6dbbc7994f-kzzgq\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") " pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.484657 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.484606    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-home\") pod \"test-model-421cfb-kserve-6dbbc7994f-kzzgq\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") " pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.484708 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.484654    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-tmp-dir\") pod \"test-model-421cfb-kserve-6dbbc7994f-kzzgq\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") " pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.486638 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.486616    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-dshm\") pod \"test-model-421cfb-kserve-6dbbc7994f-kzzgq\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") " pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.486927 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.486905    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-tls-certs\") pod \"test-model-421cfb-kserve-6dbbc7994f-kzzgq\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") " pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.495112 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.495090    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xswss\" (UniqueName: \"kubernetes.io/projected/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-kube-api-access-xswss\") pod \"test-model-421cfb-kserve-6dbbc7994f-kzzgq\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") " pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.542239 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.542201    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:42.681813 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:42.681741    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"]
Jul 06 14:52:42.684808 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:52:42.684772    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4b4b448_baf7_411c_8b0b_1e2e02bc28bf.slice/crio-768b8dc2430ea1286c03474843cd10e973f4ab6eff8b95fb3e2c545dd61907d0 WatchSource:0}: Error finding container 768b8dc2430ea1286c03474843cd10e973f4ab6eff8b95fb3e2c545dd61907d0: Status 404 returned error can't find the container with id 768b8dc2430ea1286c03474843cd10e973f4ab6eff8b95fb3e2c545dd61907d0
Jul 06 14:52:43.178163 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:43.178044    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq" event={"ID":"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf","Type":"ContainerStarted","Data":"55f0004b9af1488519113fba1fc5829fb86adf7e5eb7e86d8d4a143f93c30b2b"}
Jul 06 14:52:43.178163 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:43.178089    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq" event={"ID":"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf","Type":"ContainerStarted","Data":"768b8dc2430ea1286c03474843cd10e973f4ab6eff8b95fb3e2c545dd61907d0"}
Jul 06 14:52:43.218668 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:43.218613    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq" podStartSLOduration=1.21859614 podStartE2EDuration="1.21859614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:52:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:52:43.217849476 +0000 UTC m=+1944.066736448" watchObservedRunningTime="2026-07-06 14:52:43.21859614 +0000 UTC m=+1944.067483142"
Jul 06 14:52:52.543336 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:52.543289    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:52.543852 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:52.543350    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:52.555881 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:52.555853    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:52:53.242686 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:52:53.242657    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:53:02.058232 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:02.058198    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"]
Jul 06 14:53:17.079730 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.079637    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq" podUID="b4b4b448-baf7-411c-8b0b-1e2e02bc28bf" containerName="main" containerID="cri-o://55f0004b9af1488519113fba1fc5829fb86adf7e5eb7e86d8d4a143f93c30b2b" gracePeriod=45
Jul 06 14:53:17.337048 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.336978    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:53:17.349844 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.349812    2562 generic.go:356] "Generic (PLEG): container finished" podID="b4b4b448-baf7-411c-8b0b-1e2e02bc28bf" containerID="55f0004b9af1488519113fba1fc5829fb86adf7e5eb7e86d8d4a143f93c30b2b" exitCode=0
Jul 06 14:53:17.349997 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.349851    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"
Jul 06 14:53:17.349997 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.349894    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq" event={"ID":"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf","Type":"ContainerDied","Data":"55f0004b9af1488519113fba1fc5829fb86adf7e5eb7e86d8d4a143f93c30b2b"}
Jul 06 14:53:17.349997 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.349938    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq" event={"ID":"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf","Type":"ContainerDied","Data":"768b8dc2430ea1286c03474843cd10e973f4ab6eff8b95fb3e2c545dd61907d0"}
Jul 06 14:53:17.349997 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.349956    2562 scope.go:117] "RemoveContainer" containerID="55f0004b9af1488519113fba1fc5829fb86adf7e5eb7e86d8d4a143f93c30b2b"
Jul 06 14:53:17.359780 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.359759    2562 scope.go:117] "RemoveContainer" containerID="55f0004b9af1488519113fba1fc5829fb86adf7e5eb7e86d8d4a143f93c30b2b"
Jul 06 14:53:17.360107 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:53:17.360084    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55f0004b9af1488519113fba1fc5829fb86adf7e5eb7e86d8d4a143f93c30b2b\": container with ID starting with 55f0004b9af1488519113fba1fc5829fb86adf7e5eb7e86d8d4a143f93c30b2b not found: ID does not exist" containerID="55f0004b9af1488519113fba1fc5829fb86adf7e5eb7e86d8d4a143f93c30b2b"
Jul 06 14:53:17.360189 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.360117    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55f0004b9af1488519113fba1fc5829fb86adf7e5eb7e86d8d4a143f93c30b2b"} err="failed to get container status \"55f0004b9af1488519113fba1fc5829fb86adf7e5eb7e86d8d4a143f93c30b2b\": rpc error: code = NotFound desc = could not find container \"55f0004b9af1488519113fba1fc5829fb86adf7e5eb7e86d8d4a143f93c30b2b\": container with ID starting with 55f0004b9af1488519113fba1fc5829fb86adf7e5eb7e86d8d4a143f93c30b2b not found: ID does not exist"
Jul 06 14:53:17.422113 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.422078    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xswss\" (UniqueName: \"kubernetes.io/projected/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-kube-api-access-xswss\") pod \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") "
Jul 06 14:53:17.422315 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.422136    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-tls-certs\") pod \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") "
Jul 06 14:53:17.422315 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.422203    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-tmp-dir\") pod \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") "
Jul 06 14:53:17.422315 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.422293    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-model-cache\") pod \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") "
Jul 06 14:53:17.422477 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.422374    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-dshm\") pod \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") "
Jul 06 14:53:17.422477 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.422403    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-home\") pod \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\" (UID: \"b4b4b448-baf7-411c-8b0b-1e2e02bc28bf\") "
Jul 06 14:53:17.422580 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.422485    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b4b4b448-baf7-411c-8b0b-1e2e02bc28bf" (UID: "b4b4b448-baf7-411c-8b0b-1e2e02bc28bf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:53:17.422644 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.422569    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-model-cache" (OuterVolumeSpecName: "model-cache") pod "b4b4b448-baf7-411c-8b0b-1e2e02bc28bf" (UID: "b4b4b448-baf7-411c-8b0b-1e2e02bc28bf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:53:17.422803 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.422777    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-home" (OuterVolumeSpecName: "home") pod "b4b4b448-baf7-411c-8b0b-1e2e02bc28bf" (UID: "b4b4b448-baf7-411c-8b0b-1e2e02bc28bf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:53:17.422893 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.422799    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-tmp-dir\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:53:17.422893 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.422817    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-model-cache\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:53:17.424604 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.424575    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-dshm" (OuterVolumeSpecName: "dshm") pod "b4b4b448-baf7-411c-8b0b-1e2e02bc28bf" (UID: "b4b4b448-baf7-411c-8b0b-1e2e02bc28bf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:53:17.424604 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.424581    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-kube-api-access-xswss" (OuterVolumeSpecName: "kube-api-access-xswss") pod "b4b4b448-baf7-411c-8b0b-1e2e02bc28bf" (UID: "b4b4b448-baf7-411c-8b0b-1e2e02bc28bf"). InnerVolumeSpecName "kube-api-access-xswss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:53:17.424730 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.424652    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b4b4b448-baf7-411c-8b0b-1e2e02bc28bf" (UID: "b4b4b448-baf7-411c-8b0b-1e2e02bc28bf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:53:17.523580 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.523543    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-dshm\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:53:17.523580 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.523574    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-home\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:53:17.523580 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.523584    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xswss\" (UniqueName: \"kubernetes.io/projected/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-kube-api-access-xswss\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:53:17.523816 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.523595    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf-tls-certs\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:53:17.674199 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.674165    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"]
Jul 06 14:53:17.676932 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.676903    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-421cfb/test-model-421cfb-kserve-6dbbc7994f-kzzgq"]
Jul 06 14:53:17.746895 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:53:17.746864    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4b4b448-baf7-411c-8b0b-1e2e02bc28bf" path="/var/lib/kubelet/pods/b4b4b448-baf7-411c-8b0b-1e2e02bc28bf/volumes"
Jul 06 14:55:27.955496 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:27.955459    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"]
Jul 06 14:55:27.955929 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:27.955838    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4b4b448-baf7-411c-8b0b-1e2e02bc28bf" containerName="main"
Jul 06 14:55:27.955929 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:27.955849    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4b4b448-baf7-411c-8b0b-1e2e02bc28bf" containerName="main"
Jul 06 14:55:27.955929 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:27.955923    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4b4b448-baf7-411c-8b0b-1e2e02bc28bf" containerName="main"
Jul 06 14:55:27.959100 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:27.959078    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:27.962918 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:27.962895    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-aa7c3f\"/\"auth-test-model-aa7c3f-kserve-self-signed-certs\""
Jul 06 14:55:27.963042 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:27.962897    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-aa7c3f\"/\"openshift-service-ca.crt\""
Jul 06 14:55:27.963042 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:27.962895    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-aa7c3f\"/\"default-dockercfg-zc9cx\""
Jul 06 14:55:27.963042 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:27.962900    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-aa7c3f\"/\"kube-root-ca.crt\""
Jul 06 14:55:27.969065 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:27.969044    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"]
Jul 06 14:55:28.036456 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.036421    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7lml\" (UniqueName: \"kubernetes.io/projected/91cba3a7-df75-4a3f-ba0c-68455cc3522a-kube-api-access-r7lml\") pod \"auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") " pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.036456 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.036468    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91cba3a7-df75-4a3f-ba0c-68455cc3522a-tls-certs\") pod \"auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") " pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.036669 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.036500    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-dshm\") pod \"auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") " pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.036669 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.036547    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-model-cache\") pod \"auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") " pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.036669 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.036635    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-tmp-dir\") pod \"auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") " pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.036669 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.036665    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-home\") pod \"auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") " pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.137778 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.137734    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-tmp-dir\") pod \"auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") " pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.137778 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.137776    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-home\") pod \"auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") " pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.137999 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.137812    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7lml\" (UniqueName: \"kubernetes.io/projected/91cba3a7-df75-4a3f-ba0c-68455cc3522a-kube-api-access-r7lml\") pod \"auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") " pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.137999 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.137837    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91cba3a7-df75-4a3f-ba0c-68455cc3522a-tls-certs\") pod \"auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") " pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.137999 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.137864    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-dshm\") pod \"auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") " pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.137999 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.137886    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-model-cache\") pod \"auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") " pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.138502 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.138297    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-tmp-dir\") pod \"auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") " pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.138502 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.138302    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-home\") pod \"auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") " pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.138502 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.138387    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-model-cache\") pod \"auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") " pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.140406 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.140381    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-dshm\") pod \"auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") " pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.140644 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.140627    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91cba3a7-df75-4a3f-ba0c-68455cc3522a-tls-certs\") pod \"auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") " pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.148853 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.148829    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7lml\" (UniqueName: \"kubernetes.io/projected/91cba3a7-df75-4a3f-ba0c-68455cc3522a-kube-api-access-r7lml\") pod \"auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") " pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.269557 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.269523    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:28.410006 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.409978    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"]
Jul 06 14:55:28.411984 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:55:28.411958    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91cba3a7_df75_4a3f_ba0c_68455cc3522a.slice/crio-35374563a810e643c76740d7762e3e8c3bffa48c5db67f7f9224aa8e8660d974 WatchSource:0}: Error finding container 35374563a810e643c76740d7762e3e8c3bffa48c5db67f7f9224aa8e8660d974: Status 404 returned error can't find the container with id 35374563a810e643c76740d7762e3e8c3bffa48c5db67f7f9224aa8e8660d974
Jul 06 14:55:28.995178 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.995124    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc" event={"ID":"91cba3a7-df75-4a3f-ba0c-68455cc3522a","Type":"ContainerStarted","Data":"56e3fe15cca9854f05b6b02762270023c7abe73d53d6efd4bf838eb2a1829216"}
Jul 06 14:55:28.995178 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:28.995185    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc" event={"ID":"91cba3a7-df75-4a3f-ba0c-68455cc3522a","Type":"ContainerStarted","Data":"35374563a810e643c76740d7762e3e8c3bffa48c5db67f7f9224aa8e8660d974"}
Jul 06 14:55:38.270050 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:38.270002    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:38.270050 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:38.270062    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:38.282815 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:38.282789    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:55:38.304099 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:38.304037    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc" podStartSLOduration=11.30401808 podStartE2EDuration="11.30401808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:55:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:55:29.017284506 +0000 UTC m=+2109.866171490" watchObservedRunningTime="2026-07-06 14:55:38.30401808 +0000 UTC m=+2119.152905051"
Jul 06 14:55:39.054251 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:55:39.054216    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:57:28.133982 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:28.133946    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"]
Jul 06 14:57:43.156048 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.155931    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc" podUID="91cba3a7-df75-4a3f-ba0c-68455cc3522a" containerName="main" containerID="cri-o://56e3fe15cca9854f05b6b02762270023c7abe73d53d6efd4bf838eb2a1829216" gracePeriod=45
Jul 06 14:57:43.413331 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.413245    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:57:43.464842 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.464808    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-dshm\") pod \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") "
Jul 06 14:57:43.464842 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.464841    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-home\") pod \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") "
Jul 06 14:57:43.465105 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.464870    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7lml\" (UniqueName: \"kubernetes.io/projected/91cba3a7-df75-4a3f-ba0c-68455cc3522a-kube-api-access-r7lml\") pod \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") "
Jul 06 14:57:43.465105 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.464966    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-model-cache\") pod \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") "
Jul 06 14:57:43.465105 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.464982    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-tmp-dir\") pod \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") "
Jul 06 14:57:43.465105 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.465023    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91cba3a7-df75-4a3f-ba0c-68455cc3522a-tls-certs\") pod \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\" (UID: \"91cba3a7-df75-4a3f-ba0c-68455cc3522a\") "
Jul 06 14:57:43.465346 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.465172    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-home" (OuterVolumeSpecName: "home") pod "91cba3a7-df75-4a3f-ba0c-68455cc3522a" (UID: "91cba3a7-df75-4a3f-ba0c-68455cc3522a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:43.465346 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.465317    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "91cba3a7-df75-4a3f-ba0c-68455cc3522a" (UID: "91cba3a7-df75-4a3f-ba0c-68455cc3522a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:43.465438 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.465368    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-model-cache" (OuterVolumeSpecName: "model-cache") pod "91cba3a7-df75-4a3f-ba0c-68455cc3522a" (UID: "91cba3a7-df75-4a3f-ba0c-68455cc3522a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:43.465438 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.465430    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-tmp-dir\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:57:43.465511 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.465450    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-home\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:57:43.467296 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.467266    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-dshm" (OuterVolumeSpecName: "dshm") pod "91cba3a7-df75-4a3f-ba0c-68455cc3522a" (UID: "91cba3a7-df75-4a3f-ba0c-68455cc3522a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:57:43.467404 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.467305    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91cba3a7-df75-4a3f-ba0c-68455cc3522a-kube-api-access-r7lml" (OuterVolumeSpecName: "kube-api-access-r7lml") pod "91cba3a7-df75-4a3f-ba0c-68455cc3522a" (UID: "91cba3a7-df75-4a3f-ba0c-68455cc3522a"). InnerVolumeSpecName "kube-api-access-r7lml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:57:43.467404 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.467344    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91cba3a7-df75-4a3f-ba0c-68455cc3522a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "91cba3a7-df75-4a3f-ba0c-68455cc3522a" (UID: "91cba3a7-df75-4a3f-ba0c-68455cc3522a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:57:43.566201 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.566130    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-model-cache\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:57:43.566201 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.566195    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91cba3a7-df75-4a3f-ba0c-68455cc3522a-tls-certs\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:57:43.566201 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.566204    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91cba3a7-df75-4a3f-ba0c-68455cc3522a-dshm\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:57:43.566201 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.566212    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7lml\" (UniqueName: \"kubernetes.io/projected/91cba3a7-df75-4a3f-ba0c-68455cc3522a-kube-api-access-r7lml\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:57:43.653199 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.653106    2562 generic.go:356] "Generic (PLEG): container finished" podID="91cba3a7-df75-4a3f-ba0c-68455cc3522a" containerID="56e3fe15cca9854f05b6b02762270023c7abe73d53d6efd4bf838eb2a1829216" exitCode=0
Jul 06 14:57:43.653371 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.653197    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc" event={"ID":"91cba3a7-df75-4a3f-ba0c-68455cc3522a","Type":"ContainerDied","Data":"56e3fe15cca9854f05b6b02762270023c7abe73d53d6efd4bf838eb2a1829216"}
Jul 06 14:57:43.653371 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.653246    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc" event={"ID":"91cba3a7-df75-4a3f-ba0c-68455cc3522a","Type":"ContainerDied","Data":"35374563a810e643c76740d7762e3e8c3bffa48c5db67f7f9224aa8e8660d974"}
Jul 06 14:57:43.653371 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.653173    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"
Jul 06 14:57:43.653371 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.653265    2562 scope.go:117] "RemoveContainer" containerID="56e3fe15cca9854f05b6b02762270023c7abe73d53d6efd4bf838eb2a1829216"
Jul 06 14:57:43.662534 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.662516    2562 scope.go:117] "RemoveContainer" containerID="56e3fe15cca9854f05b6b02762270023c7abe73d53d6efd4bf838eb2a1829216"
Jul 06 14:57:43.662832 ip-10-0-135-124 kubenswrapper[2562]: E0706 14:57:43.662812    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56e3fe15cca9854f05b6b02762270023c7abe73d53d6efd4bf838eb2a1829216\": container with ID starting with 56e3fe15cca9854f05b6b02762270023c7abe73d53d6efd4bf838eb2a1829216 not found: ID does not exist" containerID="56e3fe15cca9854f05b6b02762270023c7abe73d53d6efd4bf838eb2a1829216"
Jul 06 14:57:43.662896 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.662843    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56e3fe15cca9854f05b6b02762270023c7abe73d53d6efd4bf838eb2a1829216"} err="failed to get container status \"56e3fe15cca9854f05b6b02762270023c7abe73d53d6efd4bf838eb2a1829216\": rpc error: code = NotFound desc = could not find container \"56e3fe15cca9854f05b6b02762270023c7abe73d53d6efd4bf838eb2a1829216\": container with ID starting with 56e3fe15cca9854f05b6b02762270023c7abe73d53d6efd4bf838eb2a1829216 not found: ID does not exist"
Jul 06 14:57:43.683406 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.683322    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"]
Jul 06 14:57:43.692175 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.692128    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-aa7c3f/auth-test-model-aa7c3f-kserve-6f8f5f8b9f-s8zcc"]
Jul 06 14:57:43.746343 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:57:43.746312    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91cba3a7-df75-4a3f-ba0c-68455cc3522a" path="/var/lib/kubelet/pods/91cba3a7-df75-4a3f-ba0c-68455cc3522a/volumes"
Jul 06 14:58:19.951577 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:19.951545    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"]
Jul 06 14:58:19.951964 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:19.951916    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91cba3a7-df75-4a3f-ba0c-68455cc3522a" containerName="main"
Jul 06 14:58:19.951964 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:19.951927    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="91cba3a7-df75-4a3f-ba0c-68455cc3522a" containerName="main"
Jul 06 14:58:19.952035 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:19.952004    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="91cba3a7-df75-4a3f-ba0c-68455cc3522a" containerName="main"
Jul 06 14:58:19.956705 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:19.956682    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:19.959767 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:19.959743    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-aa7c3f\"/\"default-dockercfg-zc9cx\""
Jul 06 14:58:19.959877 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:19.959780    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-aa7c3f\"/\"kube-root-ca.crt\""
Jul 06 14:58:19.961076 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:19.961057    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-aa7c3f\"/\"sub-test-model-aa7c3f-kserve-self-signed-certs\""
Jul 06 14:58:19.961128 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:19.961086    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-aa7c3f\"/\"openshift-service-ca.crt\""
Jul 06 14:58:19.966497 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:19.966476    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"]
Jul 06 14:58:20.112548 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.112508    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-tmp-dir\") pod \"sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") " pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.112758 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.112553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64vf7\" (UniqueName: \"kubernetes.io/projected/fe2543ea-6c72-43dc-8f2a-51101811b3df-kube-api-access-64vf7\") pod \"sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") " pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.112758 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.112585    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2543ea-6c72-43dc-8f2a-51101811b3df-tls-certs\") pod \"sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") " pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.112758 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.112612    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-home\") pod \"sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") " pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.112758 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.112633    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-dshm\") pod \"sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") " pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.112758 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.112648    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-model-cache\") pod \"sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") " pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.214057 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.213966    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-tmp-dir\") pod \"sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") " pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.214057 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.214013    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64vf7\" (UniqueName: \"kubernetes.io/projected/fe2543ea-6c72-43dc-8f2a-51101811b3df-kube-api-access-64vf7\") pod \"sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") " pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.214057 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.214056    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2543ea-6c72-43dc-8f2a-51101811b3df-tls-certs\") pod \"sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") " pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.214381 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.214137    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-home\") pod \"sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") " pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.214381 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.214206    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-dshm\") pod \"sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") " pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.214381 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.214227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-model-cache\") pod \"sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") " pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.214537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.214392    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-tmp-dir\") pod \"sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") " pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.214537 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.214462    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-home\") pod \"sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") " pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.214620 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.214569    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-model-cache\") pod \"sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") " pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.216927 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.216898    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-dshm\") pod \"sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") " pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.217808 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.217733    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2543ea-6c72-43dc-8f2a-51101811b3df-tls-certs\") pod \"sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") " pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.223308 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.223287    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64vf7\" (UniqueName: \"kubernetes.io/projected/fe2543ea-6c72-43dc-8f2a-51101811b3df-kube-api-access-64vf7\") pod \"sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") " pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.266890 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.266855    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:20.413734 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.413707    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"]
Jul 06 14:58:20.416161 ip-10-0-135-124 kubenswrapper[2562]: W0706 14:58:20.416122    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe2543ea_6c72_43dc_8f2a_51101811b3df.slice/crio-6f8ba07ac284c802fb64622f9e65a028c3b7a7a67d2e0346fd45f3112f034576 WatchSource:0}: Error finding container 6f8ba07ac284c802fb64622f9e65a028c3b7a7a67d2e0346fd45f3112f034576: Status 404 returned error can't find the container with id 6f8ba07ac284c802fb64622f9e65a028c3b7a7a67d2e0346fd45f3112f034576
Jul 06 14:58:20.836635 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.836598    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b" event={"ID":"fe2543ea-6c72-43dc-8f2a-51101811b3df","Type":"ContainerStarted","Data":"14fadd4cd2c12809ddc27d68f6da0b347358b0a7386cbec8b4cf967a76ca7c11"}
Jul 06 14:58:20.836635 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.836639    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b" event={"ID":"fe2543ea-6c72-43dc-8f2a-51101811b3df","Type":"ContainerStarted","Data":"6f8ba07ac284c802fb64622f9e65a028c3b7a7a67d2e0346fd45f3112f034576"}
Jul 06 14:58:20.877765 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:20.877712    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b" podStartSLOduration=1.877693412 podStartE2EDuration="1.877693412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:58:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:58:20.876100903 +0000 UTC m=+2281.724987874" watchObservedRunningTime="2026-07-06 14:58:20.877693412 +0000 UTC m=+2281.726580429"
Jul 06 14:58:30.267675 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:30.267626    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:30.268113 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:30.267692    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:30.280330 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:30.280303    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:30.896394 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:30.896366    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:58:57.897924 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:58:57.897890    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"]
Jul 06 14:59:12.918464 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:12.918364    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b" podUID="fe2543ea-6c72-43dc-8f2a-51101811b3df" containerName="main" containerID="cri-o://14fadd4cd2c12809ddc27d68f6da0b347358b0a7386cbec8b4cf967a76ca7c11" gracePeriod=45
Jul 06 14:59:13.094184 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.094133    2562 generic.go:356] "Generic (PLEG): container finished" podID="fe2543ea-6c72-43dc-8f2a-51101811b3df" containerID="14fadd4cd2c12809ddc27d68f6da0b347358b0a7386cbec8b4cf967a76ca7c11" exitCode=0
Jul 06 14:59:13.094308 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.094206    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b" event={"ID":"fe2543ea-6c72-43dc-8f2a-51101811b3df","Type":"ContainerDied","Data":"14fadd4cd2c12809ddc27d68f6da0b347358b0a7386cbec8b4cf967a76ca7c11"}
Jul 06 14:59:13.182839 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.182765    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:59:13.214396 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.214367    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-home\") pod \"fe2543ea-6c72-43dc-8f2a-51101811b3df\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") "
Jul 06 14:59:13.214576 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.214449    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64vf7\" (UniqueName: \"kubernetes.io/projected/fe2543ea-6c72-43dc-8f2a-51101811b3df-kube-api-access-64vf7\") pod \"fe2543ea-6c72-43dc-8f2a-51101811b3df\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") "
Jul 06 14:59:13.214576 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.214469    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-model-cache\") pod \"fe2543ea-6c72-43dc-8f2a-51101811b3df\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") "
Jul 06 14:59:13.214576 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.214488    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-dshm\") pod \"fe2543ea-6c72-43dc-8f2a-51101811b3df\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") "
Jul 06 14:59:13.214576 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.214515    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-tmp-dir\") pod \"fe2543ea-6c72-43dc-8f2a-51101811b3df\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") "
Jul 06 14:59:13.214796 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.214626    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2543ea-6c72-43dc-8f2a-51101811b3df-tls-certs\") pod \"fe2543ea-6c72-43dc-8f2a-51101811b3df\" (UID: \"fe2543ea-6c72-43dc-8f2a-51101811b3df\") "
Jul 06 14:59:13.214796 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.214745    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-home" (OuterVolumeSpecName: "home") pod "fe2543ea-6c72-43dc-8f2a-51101811b3df" (UID: "fe2543ea-6c72-43dc-8f2a-51101811b3df"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:59:13.214796 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.214769    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-model-cache" (OuterVolumeSpecName: "model-cache") pod "fe2543ea-6c72-43dc-8f2a-51101811b3df" (UID: "fe2543ea-6c72-43dc-8f2a-51101811b3df"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:59:13.214986 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.214962    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fe2543ea-6c72-43dc-8f2a-51101811b3df" (UID: "fe2543ea-6c72-43dc-8f2a-51101811b3df"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:59:13.215050 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.214981    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-home\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:59:13.215050 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.215000    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-model-cache\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:59:13.216809 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.216785    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe2543ea-6c72-43dc-8f2a-51101811b3df-kube-api-access-64vf7" (OuterVolumeSpecName: "kube-api-access-64vf7") pod "fe2543ea-6c72-43dc-8f2a-51101811b3df" (UID: "fe2543ea-6c72-43dc-8f2a-51101811b3df"). InnerVolumeSpecName "kube-api-access-64vf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:59:13.217008 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.216992    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe2543ea-6c72-43dc-8f2a-51101811b3df-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fe2543ea-6c72-43dc-8f2a-51101811b3df" (UID: "fe2543ea-6c72-43dc-8f2a-51101811b3df"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:59:13.217215 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.217195    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-dshm" (OuterVolumeSpecName: "dshm") pod "fe2543ea-6c72-43dc-8f2a-51101811b3df" (UID: "fe2543ea-6c72-43dc-8f2a-51101811b3df"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:59:13.316495 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.316449    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-dshm\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:59:13.316495 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.316485    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe2543ea-6c72-43dc-8f2a-51101811b3df-tmp-dir\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:59:13.316495 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.316496    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe2543ea-6c72-43dc-8f2a-51101811b3df-tls-certs\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:59:13.316495 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:13.316503    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64vf7\" (UniqueName: \"kubernetes.io/projected/fe2543ea-6c72-43dc-8f2a-51101811b3df-kube-api-access-64vf7\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 14:59:14.100523 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:14.100437    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"
Jul 06 14:59:14.100523 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:14.100475    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b" event={"ID":"fe2543ea-6c72-43dc-8f2a-51101811b3df","Type":"ContainerDied","Data":"6f8ba07ac284c802fb64622f9e65a028c3b7a7a67d2e0346fd45f3112f034576"}
Jul 06 14:59:14.100995 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:14.100527    2562 scope.go:117] "RemoveContainer" containerID="14fadd4cd2c12809ddc27d68f6da0b347358b0a7386cbec8b4cf967a76ca7c11"
Jul 06 14:59:14.122980 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:14.122943    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"]
Jul 06 14:59:14.126747 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:14.126716    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-aa7c3f/sub-test-model-aa7c3f-kserve-6c8f6df885-dvx8b"]
Jul 06 14:59:15.746520 ip-10-0-135-124 kubenswrapper[2562]: I0706 14:59:15.746484    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe2543ea-6c72-43dc-8f2a-51101811b3df" path="/var/lib/kubelet/pods/fe2543ea-6c72-43dc-8f2a-51101811b3df/volumes"
Jul 06 15:00:00.144873 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.144831    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh"]
Jul 06 15:00:00.145474 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.145316    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe2543ea-6c72-43dc-8f2a-51101811b3df" containerName="main"
Jul 06 15:00:00.145474 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.145337    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe2543ea-6c72-43dc-8f2a-51101811b3df" containerName="main"
Jul 06 15:00:00.145474 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.145457    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe2543ea-6c72-43dc-8f2a-51101811b3df" containerName="main"
Jul 06 15:00:00.148409 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.148390    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722500-z22jq"]
Jul 06 15:00:00.148530 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.148509    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh"
Jul 06 15:00:00.151169 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.151132    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-mwgcs\""
Jul 06 15:00:00.151678 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.151664    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw"]
Jul 06 15:00:00.151785 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.151770    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722500-z22jq"
Jul 06 15:00:00.154893 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.154876    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw"
Jul 06 15:00:00.160161 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.160116    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722500-z22jq"]
Jul 06 15:00:00.164932 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.164902    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh"]
Jul 06 15:00:00.167986 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.167961    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw"]
Jul 06 15:00:00.248448 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.248402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z4wr\" (UniqueName: \"kubernetes.io/projected/0a896335-ae29-413d-bee4-432b0f5c6c6b-kube-api-access-6z4wr\") pod \"maas-api-key-cleanup-29722500-z22jq\" (UID: \"0a896335-ae29-413d-bee4-432b0f5c6c6b\") " pod="opendatahub/maas-api-key-cleanup-29722500-z22jq"
Jul 06 15:00:00.248644 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.248491    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lz26\" (UniqueName: \"kubernetes.io/projected/c75d80e9-eaa2-40af-b77c-2a46e8a38da1-kube-api-access-9lz26\") pod \"maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw\" (UID: \"c75d80e9-eaa2-40af-b77c-2a46e8a38da1\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw"
Jul 06 15:00:00.248644 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.248524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjl5g\" (UniqueName: \"kubernetes.io/projected/1865cb2f-d3f3-4a61-8751-a7958788696b-kube-api-access-mjl5g\") pod \"maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh\" (UID: \"1865cb2f-d3f3-4a61-8751-a7958788696b\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh"
Jul 06 15:00:00.349109 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.349069    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z4wr\" (UniqueName: \"kubernetes.io/projected/0a896335-ae29-413d-bee4-432b0f5c6c6b-kube-api-access-6z4wr\") pod \"maas-api-key-cleanup-29722500-z22jq\" (UID: \"0a896335-ae29-413d-bee4-432b0f5c6c6b\") " pod="opendatahub/maas-api-key-cleanup-29722500-z22jq"
Jul 06 15:00:00.349331 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.349127    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lz26\" (UniqueName: \"kubernetes.io/projected/c75d80e9-eaa2-40af-b77c-2a46e8a38da1-kube-api-access-9lz26\") pod \"maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw\" (UID: \"c75d80e9-eaa2-40af-b77c-2a46e8a38da1\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw"
Jul 06 15:00:00.349331 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.349175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjl5g\" (UniqueName: \"kubernetes.io/projected/1865cb2f-d3f3-4a61-8751-a7958788696b-kube-api-access-mjl5g\") pod \"maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh\" (UID: \"1865cb2f-d3f3-4a61-8751-a7958788696b\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh"
Jul 06 15:00:00.358756 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.358729    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z4wr\" (UniqueName: \"kubernetes.io/projected/0a896335-ae29-413d-bee4-432b0f5c6c6b-kube-api-access-6z4wr\") pod \"maas-api-key-cleanup-29722500-z22jq\" (UID: \"0a896335-ae29-413d-bee4-432b0f5c6c6b\") " pod="opendatahub/maas-api-key-cleanup-29722500-z22jq"
Jul 06 15:00:00.358909 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.358828    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjl5g\" (UniqueName: \"kubernetes.io/projected/1865cb2f-d3f3-4a61-8751-a7958788696b-kube-api-access-mjl5g\") pod \"maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh\" (UID: \"1865cb2f-d3f3-4a61-8751-a7958788696b\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh"
Jul 06 15:00:00.358909 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.358828    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lz26\" (UniqueName: \"kubernetes.io/projected/c75d80e9-eaa2-40af-b77c-2a46e8a38da1-kube-api-access-9lz26\") pod \"maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw\" (UID: \"c75d80e9-eaa2-40af-b77c-2a46e8a38da1\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw"
Jul 06 15:00:00.460424 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.460338    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh"
Jul 06 15:00:00.470613 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.470580    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722500-z22jq"
Jul 06 15:00:00.478804 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.478779    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw"
Jul 06 15:00:00.630966 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.630927    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh"]
Jul 06 15:00:00.633058 ip-10-0-135-124 kubenswrapper[2562]: W0706 15:00:00.633027    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1865cb2f_d3f3_4a61_8751_a7958788696b.slice/crio-245ecf241182c341ed77f9735b6c224a2de5fb211baf66f0a6d3b5bf7f36cd2e WatchSource:0}: Error finding container 245ecf241182c341ed77f9735b6c224a2de5fb211baf66f0a6d3b5bf7f36cd2e: Status 404 returned error can't find the container with id 245ecf241182c341ed77f9735b6c224a2de5fb211baf66f0a6d3b5bf7f36cd2e
Jul 06 15:00:00.635296 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.635272    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 15:00:00.854575 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.854498    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722500-z22jq"]
Jul 06 15:00:00.856737 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:00.856712    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw"]
Jul 06 15:00:00.856828 ip-10-0-135-124 kubenswrapper[2562]: W0706 15:00:00.856751    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a896335_ae29_413d_bee4_432b0f5c6c6b.slice/crio-b898441542b416762abf1a24136eb233f2b42dd53b8af15e6585f4b6251842e0 WatchSource:0}: Error finding container b898441542b416762abf1a24136eb233f2b42dd53b8af15e6585f4b6251842e0: Status 404 returned error can't find the container with id b898441542b416762abf1a24136eb233f2b42dd53b8af15e6585f4b6251842e0
Jul 06 15:00:00.858283 ip-10-0-135-124 kubenswrapper[2562]: W0706 15:00:00.858259    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75d80e9_eaa2_40af_b77c_2a46e8a38da1.slice/crio-51ec403352d8dd0d3dd25c3914638c386bdeea1fbcabc81626fc60bc0b3c5d4f WatchSource:0}: Error finding container 51ec403352d8dd0d3dd25c3914638c386bdeea1fbcabc81626fc60bc0b3c5d4f: Status 404 returned error can't find the container with id 51ec403352d8dd0d3dd25c3914638c386bdeea1fbcabc81626fc60bc0b3c5d4f
Jul 06 15:00:01.327600 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:01.327561    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722500-z22jq" event={"ID":"0a896335-ae29-413d-bee4-432b0f5c6c6b","Type":"ContainerStarted","Data":"b898441542b416762abf1a24136eb233f2b42dd53b8af15e6585f4b6251842e0"}
Jul 06 15:00:01.328738 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:01.328707    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw" event={"ID":"c75d80e9-eaa2-40af-b77c-2a46e8a38da1","Type":"ContainerStarted","Data":"51ec403352d8dd0d3dd25c3914638c386bdeea1fbcabc81626fc60bc0b3c5d4f"}
Jul 06 15:00:01.329733 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:01.329705    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh" event={"ID":"1865cb2f-d3f3-4a61-8751-a7958788696b","Type":"ContainerStarted","Data":"245ecf241182c341ed77f9735b6c224a2de5fb211baf66f0a6d3b5bf7f36cd2e"}
Jul 06 15:00:11.381877 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:11.381834    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw" event={"ID":"c75d80e9-eaa2-40af-b77c-2a46e8a38da1","Type":"ContainerStarted","Data":"3ce0e0daafa0c976c56d524f70c7aca78d9bab7808b82625a78578af5c42c2d0"}
Jul 06 15:00:11.400044 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:11.399989    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw" podStartSLOduration=1.570509005 podStartE2EDuration="11.399972175s" totalImagesPullingTime="9.82946317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:00:11.398309708 +0000 UTC m=+2392.247196679" watchObservedRunningTime="2026-07-06 15:00:11.399972175 +0000 UTC m=+2392.248859150"
Jul 06 15:00:12.388665 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:12.388629    2562 generic.go:356] "Generic (PLEG): container finished" podID="c75d80e9-eaa2-40af-b77c-2a46e8a38da1" containerID="3ce0e0daafa0c976c56d524f70c7aca78d9bab7808b82625a78578af5c42c2d0" exitCode=0
Jul 06 15:00:12.389048 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:12.388754    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw" event={"ID":"c75d80e9-eaa2-40af-b77c-2a46e8a38da1","Type":"ContainerDied","Data":"3ce0e0daafa0c976c56d524f70c7aca78d9bab7808b82625a78578af5c42c2d0"}
Jul 06 15:00:13.527329 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:13.527297    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw"
Jul 06 15:00:13.674275 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:13.674182    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lz26\" (UniqueName: \"kubernetes.io/projected/c75d80e9-eaa2-40af-b77c-2a46e8a38da1-kube-api-access-9lz26\") pod \"c75d80e9-eaa2-40af-b77c-2a46e8a38da1\" (UID: \"c75d80e9-eaa2-40af-b77c-2a46e8a38da1\") "
Jul 06 15:00:13.682178 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:13.677369    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c75d80e9-eaa2-40af-b77c-2a46e8a38da1-kube-api-access-9lz26" (OuterVolumeSpecName: "kube-api-access-9lz26") pod "c75d80e9-eaa2-40af-b77c-2a46e8a38da1" (UID: "c75d80e9-eaa2-40af-b77c-2a46e8a38da1"). InnerVolumeSpecName "kube-api-access-9lz26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:00:13.775395 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:13.775361    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lz26\" (UniqueName: \"kubernetes.io/projected/c75d80e9-eaa2-40af-b77c-2a46e8a38da1-kube-api-access-9lz26\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 15:00:14.400314 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:14.400278    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw"
Jul 06 15:00:14.400500 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:14.400319    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw" event={"ID":"c75d80e9-eaa2-40af-b77c-2a46e8a38da1","Type":"ContainerDied","Data":"51ec403352d8dd0d3dd25c3914638c386bdeea1fbcabc81626fc60bc0b3c5d4f"}
Jul 06 15:00:14.400500 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:14.400367    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51ec403352d8dd0d3dd25c3914638c386bdeea1fbcabc81626fc60bc0b3c5d4f"
Jul 06 15:00:19.427354 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:19.427265    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722500-z22jq" event={"ID":"0a896335-ae29-413d-bee4-432b0f5c6c6b","Type":"ContainerStarted","Data":"7babcec6f38df30e709497311408dc3c68322867262b1211eb2ab85a32f12f39"}
Jul 06 15:00:19.444235 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:19.444173    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722500-z22jq" podStartSLOduration=1.483582301 podStartE2EDuration="19.444133488s" totalImagesPullingTime="17.960551187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:00:19.443239539 +0000 UTC m=+2400.292126513" watchObservedRunningTime="2026-07-06 15:00:19.444133488 +0000 UTC m=+2400.293020459"
Jul 06 15:00:20.434108 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:20.434072    2562 generic.go:356] "Generic (PLEG): container finished" podID="0a896335-ae29-413d-bee4-432b0f5c6c6b" containerID="7babcec6f38df30e709497311408dc3c68322867262b1211eb2ab85a32f12f39" exitCode=0
Jul 06 15:00:20.434556 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:20.434134    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722500-z22jq" event={"ID":"0a896335-ae29-413d-bee4-432b0f5c6c6b","Type":"ContainerDied","Data":"7babcec6f38df30e709497311408dc3c68322867262b1211eb2ab85a32f12f39"}
Jul 06 15:00:21.440598 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:21.440556    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh" event={"ID":"1865cb2f-d3f3-4a61-8751-a7958788696b","Type":"ContainerStarted","Data":"752a0b300b67891420ee664a9a647271e0a445131be9b875164082636aa29fbf"}
Jul 06 15:00:21.459698 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:21.459630    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh" podStartSLOduration=1.406106664 podStartE2EDuration="21.459607271s" totalImagesPullingTime="20.053500607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:00:21.458997321 +0000 UTC m=+2402.307884294" watchObservedRunningTime="2026-07-06 15:00:21.459607271 +0000 UTC m=+2402.308494243"
Jul 06 15:00:21.630918 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:21.630892    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722500-z22jq"
Jul 06 15:00:21.754251 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:21.754219    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z4wr\" (UniqueName: \"kubernetes.io/projected/0a896335-ae29-413d-bee4-432b0f5c6c6b-kube-api-access-6z4wr\") pod \"0a896335-ae29-413d-bee4-432b0f5c6c6b\" (UID: \"0a896335-ae29-413d-bee4-432b0f5c6c6b\") "
Jul 06 15:00:21.756443 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:21.756416    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a896335-ae29-413d-bee4-432b0f5c6c6b-kube-api-access-6z4wr" (OuterVolumeSpecName: "kube-api-access-6z4wr") pod "0a896335-ae29-413d-bee4-432b0f5c6c6b" (UID: "0a896335-ae29-413d-bee4-432b0f5c6c6b"). InnerVolumeSpecName "kube-api-access-6z4wr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:00:21.854999 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:21.854964    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z4wr\" (UniqueName: \"kubernetes.io/projected/0a896335-ae29-413d-bee4-432b0f5c6c6b-kube-api-access-6z4wr\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 15:00:22.447105 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:22.447076    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722500-z22jq"
Jul 06 15:00:22.447105 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:22.447093    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722500-z22jq" event={"ID":"0a896335-ae29-413d-bee4-432b0f5c6c6b","Type":"ContainerDied","Data":"b898441542b416762abf1a24136eb233f2b42dd53b8af15e6585f4b6251842e0"}
Jul 06 15:00:22.447598 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:22.447203    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b898441542b416762abf1a24136eb233f2b42dd53b8af15e6585f4b6251842e0"
Jul 06 15:00:22.448698 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:22.448675    2562 generic.go:356] "Generic (PLEG): container finished" podID="1865cb2f-d3f3-4a61-8751-a7958788696b" containerID="752a0b300b67891420ee664a9a647271e0a445131be9b875164082636aa29fbf" exitCode=0
Jul 06 15:00:22.448871 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:22.448716    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh" event={"ID":"1865cb2f-d3f3-4a61-8751-a7958788696b","Type":"ContainerDied","Data":"752a0b300b67891420ee664a9a647271e0a445131be9b875164082636aa29fbf"}
Jul 06 15:00:23.596914 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:23.596885    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh"
Jul 06 15:00:23.773624 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:23.773592    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjl5g\" (UniqueName: \"kubernetes.io/projected/1865cb2f-d3f3-4a61-8751-a7958788696b-kube-api-access-mjl5g\") pod \"1865cb2f-d3f3-4a61-8751-a7958788696b\" (UID: \"1865cb2f-d3f3-4a61-8751-a7958788696b\") "
Jul 06 15:00:23.775779 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:23.775752    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1865cb2f-d3f3-4a61-8751-a7958788696b-kube-api-access-mjl5g" (OuterVolumeSpecName: "kube-api-access-mjl5g") pod "1865cb2f-d3f3-4a61-8751-a7958788696b" (UID: "1865cb2f-d3f3-4a61-8751-a7958788696b"). InnerVolumeSpecName "kube-api-access-mjl5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 15:00:23.875046 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:23.875011    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjl5g\" (UniqueName: \"kubernetes.io/projected/1865cb2f-d3f3-4a61-8751-a7958788696b-kube-api-access-mjl5g\") on node \"ip-10-0-135-124.ec2.internal\" DevicePath \"\""
Jul 06 15:00:24.460490 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:24.460464    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh"
Jul 06 15:00:24.460669 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:24.460464    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh" event={"ID":"1865cb2f-d3f3-4a61-8751-a7958788696b","Type":"ContainerDied","Data":"245ecf241182c341ed77f9735b6c224a2de5fb211baf66f0a6d3b5bf7f36cd2e"}
Jul 06 15:00:24.460669 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:24.460588    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="245ecf241182c341ed77f9735b6c224a2de5fb211baf66f0a6d3b5bf7f36cd2e"
Jul 06 15:00:26.110075 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:26.110039    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw"]
Jul 06 15:00:26.112386 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:26.112363    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-bb4316-29722500-8tqpw"]
Jul 06 15:00:27.746390 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:00:27.746356    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c75d80e9-eaa2-40af-b77c-2a46e8a38da1" path="/var/lib/kubelet/pods/c75d80e9-eaa2-40af-b77c-2a46e8a38da1/volumes"
Jul 06 15:01:09.747691 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:09.747658    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh"]
Jul 06 15:01:09.749489 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:09.749468    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-aa7c3f-29722500-ljhvh"]
Jul 06 15:01:11.746497 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:11.746464    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1865cb2f-d3f3-4a61-8751-a7958788696b" path="/var/lib/kubelet/pods/1865cb2f-d3f3-4a61-8751-a7958788696b/volumes"
Jul 06 15:01:16.666597 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:16.666556    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67cf869ff4-gt2jd_8bf4159a-1dae-4724-92c1-db6b78fcf809/authorino/0.log"
Jul 06 15:01:21.962301 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:21.962261    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722500-z22jq_0a896335-ae29-413d-bee4-432b0f5c6c6b/cleanup/0.log"
Jul 06 15:01:22.419105 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:22.419071    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc_244dd0ac-e39b-4814-912d-2d88f79463cd/copy-manifests/0.log"
Jul 06 15:01:22.426361 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:22.426333    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc_244dd0ac-e39b-4814-912d-2d88f79463cd/manager/0.log"
Jul 06 15:01:24.081496 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:24.081454    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67cf869ff4-gt2jd_8bf4159a-1dae-4724-92c1-db6b78fcf809/authorino/0.log"
Jul 06 15:01:24.319159 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:24.319108    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-z8skn_68d57c5f-6198-44f7-92c8-7c93c50180d1/manager/0.log"
Jul 06 15:01:24.430031 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:24.429956    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-z69sf_ffa0524c-118f-4fa1-a5c7-f58de1788dcd/kuadrant-console-plugin/0.log"
Jul 06 15:01:24.928959 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:24.928915    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qm749_f9309411-fc65-412a-b53d-b5acfd154b99/manager/0.log"
Jul 06 15:01:25.520410 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:25.520377    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64c7864974-sfvtr_a5888a1b-6dd0-40b3-aa5c-f1c18d458061/kube-auth-proxy/0.log"
Jul 06 15:01:26.589730 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:26.589702    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-mmgm4_0fef66f7-97f3-4124-94e8-d53365c88db5/main/0.log"
Jul 06 15:01:26.703883 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:26.703842    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-ztbg8_88f4db39-0c3c-4b73-a0bb-6ffa22b4390f/main/0.log"
Jul 06 15:01:34.700312 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:34.700276    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-49jdc_1b898534-bd6c-43bf-a49c-0ee858e6fb3f/global-pull-secret-syncer/0.log"
Jul 06 15:01:34.918040 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:34.918007    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mmd82_6fd2b9fc-8eed-49bc-b589-60e74d28f89c/konnectivity-agent/0.log"
Jul 06 15:01:35.033990 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:35.033951    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-124.ec2.internal_1589fdad0eee7678693602cdf14d162f/haproxy/0.log"
Jul 06 15:01:40.658919 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:40.658885    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67cf869ff4-gt2jd_8bf4159a-1dae-4724-92c1-db6b78fcf809/authorino/0.log"
Jul 06 15:01:40.723604 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:40.723574    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-z8skn_68d57c5f-6198-44f7-92c8-7c93c50180d1/manager/0.log"
Jul 06 15:01:40.755126 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:40.755098    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-z69sf_ffa0524c-118f-4fa1-a5c7-f58de1788dcd/kuadrant-console-plugin/0.log"
Jul 06 15:01:41.096579 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:41.096542    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qm749_f9309411-fc65-412a-b53d-b5acfd154b99/manager/0.log"
Jul 06 15:01:42.801531 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:42.801492    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb6f5d2e-3706-4db7-931f-76b526cf1d12/alertmanager/0.log"
Jul 06 15:01:42.871006 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:42.870973    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb6f5d2e-3706-4db7-931f-76b526cf1d12/config-reloader/0.log"
Jul 06 15:01:42.922968 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:42.922885    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb6f5d2e-3706-4db7-931f-76b526cf1d12/kube-rbac-proxy-web/0.log"
Jul 06 15:01:42.972002 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:42.971973    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb6f5d2e-3706-4db7-931f-76b526cf1d12/kube-rbac-proxy/0.log"
Jul 06 15:01:43.015088 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:43.015043    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb6f5d2e-3706-4db7-931f-76b526cf1d12/kube-rbac-proxy-metric/0.log"
Jul 06 15:01:43.057590 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:43.057560    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb6f5d2e-3706-4db7-931f-76b526cf1d12/prom-label-proxy/0.log"
Jul 06 15:01:43.103871 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:43.103836    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb6f5d2e-3706-4db7-931f-76b526cf1d12/init-config-reloader/0.log"
Jul 06 15:01:43.216232 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:43.216132    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-6qrrk_5d62d48e-3246-463b-9322-5d28b2b8b1f2/kube-state-metrics/0.log"
Jul 06 15:01:43.257924 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:43.257892    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-6qrrk_5d62d48e-3246-463b-9322-5d28b2b8b1f2/kube-rbac-proxy-main/0.log"
Jul 06 15:01:43.308479 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:43.308448    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-6qrrk_5d62d48e-3246-463b-9322-5d28b2b8b1f2/kube-rbac-proxy-self/0.log"
Jul 06 15:01:43.350942 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:43.350914    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5496dc54b8-7xg7r_d056f006-e607-4b10-ac31-6be5335cdd30/metrics-server/0.log"
Jul 06 15:01:43.399967 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:43.399932    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-cdc2x_6823ad0b-05cf-4273-8153-559cf91b6fe9/monitoring-plugin/0.log"
Jul 06 15:01:43.616365 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:43.616337    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-st9pg_1f864d58-04b2-4a53-b831-40c2d4afe9ce/node-exporter/0.log"
Jul 06 15:01:43.653949 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:43.653922    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-st9pg_1f864d58-04b2-4a53-b831-40c2d4afe9ce/kube-rbac-proxy/0.log"
Jul 06 15:01:43.703806 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:43.703781    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-st9pg_1f864d58-04b2-4a53-b831-40c2d4afe9ce/init-textfile/0.log"
Jul 06 15:01:43.911025 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:43.910940    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-mnngr_1a4fe22e-7e3d-40b9-b316-ec8e190641fd/kube-rbac-proxy-main/0.log"
Jul 06 15:01:43.961165 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:43.961118    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-mnngr_1a4fe22e-7e3d-40b9-b316-ec8e190641fd/kube-rbac-proxy-self/0.log"
Jul 06 15:01:44.004382 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.004348    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-mnngr_1a4fe22e-7e3d-40b9-b316-ec8e190641fd/openshift-state-metrics/0.log"
Jul 06 15:01:44.062879 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.062854    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_991e7eaf-0cf0-4ef9-a2ad-5799c0294be3/prometheus/0.log"
Jul 06 15:01:44.104088 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.104063    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_991e7eaf-0cf0-4ef9-a2ad-5799c0294be3/config-reloader/0.log"
Jul 06 15:01:44.165075 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.164985    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_991e7eaf-0cf0-4ef9-a2ad-5799c0294be3/thanos-sidecar/0.log"
Jul 06 15:01:44.207759 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.207729    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_991e7eaf-0cf0-4ef9-a2ad-5799c0294be3/kube-rbac-proxy-web/0.log"
Jul 06 15:01:44.251760 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.251728    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_991e7eaf-0cf0-4ef9-a2ad-5799c0294be3/kube-rbac-proxy/0.log"
Jul 06 15:01:44.294898 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.294866    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_991e7eaf-0cf0-4ef9-a2ad-5799c0294be3/kube-rbac-proxy-thanos/0.log"
Jul 06 15:01:44.340772 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.340743    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_991e7eaf-0cf0-4ef9-a2ad-5799c0294be3/init-config-reloader/0.log"
Jul 06 15:01:44.393834 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.393806    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-rf2lt_0439270e-db0d-4509-8948-317cb1ee9eb2/prometheus-operator/0.log"
Jul 06 15:01:44.439874 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.439793    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-rf2lt_0439270e-db0d-4509-8948-317cb1ee9eb2/kube-rbac-proxy/0.log"
Jul 06 15:01:44.537312 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.537282    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c47c55bb-ndvfb_856454c0-9d89-4109-b616-afe0686391d9/telemeter-client/0.log"
Jul 06 15:01:44.585766 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.585737    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c47c55bb-ndvfb_856454c0-9d89-4109-b616-afe0686391d9/reload/0.log"
Jul 06 15:01:44.629807 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.629774    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c47c55bb-ndvfb_856454c0-9d89-4109-b616-afe0686391d9/kube-rbac-proxy/0.log"
Jul 06 15:01:44.704040 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.703953    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8d4778867-7twbx_3c4e9e65-bc53-4440-bf85-9824b7cfa3e1/thanos-query/0.log"
Jul 06 15:01:44.737688 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.737650    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8d4778867-7twbx_3c4e9e65-bc53-4440-bf85-9824b7cfa3e1/kube-rbac-proxy-web/0.log"
Jul 06 15:01:44.763952 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.763895    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8d4778867-7twbx_3c4e9e65-bc53-4440-bf85-9824b7cfa3e1/kube-rbac-proxy/0.log"
Jul 06 15:01:44.794033 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.794004    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8d4778867-7twbx_3c4e9e65-bc53-4440-bf85-9824b7cfa3e1/prom-label-proxy/0.log"
Jul 06 15:01:44.833324 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.833298    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8d4778867-7twbx_3c4e9e65-bc53-4440-bf85-9824b7cfa3e1/kube-rbac-proxy-rules/0.log"
Jul 06 15:01:44.864844 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:44.864765    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8d4778867-7twbx_3c4e9e65-bc53-4440-bf85-9824b7cfa3e1/kube-rbac-proxy-metrics/0.log"
Jul 06 15:01:45.746215 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.746186    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"]
Jul 06 15:01:45.746752 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.746732    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1865cb2f-d3f3-4a61-8751-a7958788696b" containerName="cleanup"
Jul 06 15:01:45.746823 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.746754    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1865cb2f-d3f3-4a61-8751-a7958788696b" containerName="cleanup"
Jul 06 15:01:45.746823 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.746771    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75d80e9-eaa2-40af-b77c-2a46e8a38da1" containerName="cleanup"
Jul 06 15:01:45.746823 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.746776    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75d80e9-eaa2-40af-b77c-2a46e8a38da1" containerName="cleanup"
Jul 06 15:01:45.746823 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.746786    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a896335-ae29-413d-bee4-432b0f5c6c6b" containerName="cleanup"
Jul 06 15:01:45.746823 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.746791    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a896335-ae29-413d-bee4-432b0f5c6c6b" containerName="cleanup"
Jul 06 15:01:45.747044 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.746857    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75d80e9-eaa2-40af-b77c-2a46e8a38da1" containerName="cleanup"
Jul 06 15:01:45.747044 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.746866    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a896335-ae29-413d-bee4-432b0f5c6c6b" containerName="cleanup"
Jul 06 15:01:45.747044 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.746874    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1865cb2f-d3f3-4a61-8751-a7958788696b" containerName="cleanup"
Jul 06 15:01:45.749472 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.749450    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:45.753030 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.753009    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-25f49\"/\"openshift-service-ca.crt\""
Jul 06 15:01:45.753156 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.753080    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-25f49\"/\"kube-root-ca.crt\""
Jul 06 15:01:45.753775 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.753761    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-25f49\"/\"default-dockercfg-c76v2\""
Jul 06 15:01:45.760660 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.760634    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"]
Jul 06 15:01:45.821061 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.821029    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k54vs\" (UniqueName: \"kubernetes.io/projected/fa3162aa-b022-44aa-9c22-4f489b597553-kube-api-access-k54vs\") pod \"perf-node-gather-daemonset-2tcln\" (UID: \"fa3162aa-b022-44aa-9c22-4f489b597553\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:45.821261 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.821079    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa3162aa-b022-44aa-9c22-4f489b597553-podres\") pod \"perf-node-gather-daemonset-2tcln\" (UID: \"fa3162aa-b022-44aa-9c22-4f489b597553\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:45.821261 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.821168    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa3162aa-b022-44aa-9c22-4f489b597553-sys\") pod \"perf-node-gather-daemonset-2tcln\" (UID: \"fa3162aa-b022-44aa-9c22-4f489b597553\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:45.821261 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.821220    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa3162aa-b022-44aa-9c22-4f489b597553-proc\") pod \"perf-node-gather-daemonset-2tcln\" (UID: \"fa3162aa-b022-44aa-9c22-4f489b597553\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:45.821261 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.821257    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa3162aa-b022-44aa-9c22-4f489b597553-lib-modules\") pod \"perf-node-gather-daemonset-2tcln\" (UID: \"fa3162aa-b022-44aa-9c22-4f489b597553\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:45.922096 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.922059    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa3162aa-b022-44aa-9c22-4f489b597553-sys\") pod \"perf-node-gather-daemonset-2tcln\" (UID: \"fa3162aa-b022-44aa-9c22-4f489b597553\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:45.922096 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.922099    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa3162aa-b022-44aa-9c22-4f489b597553-proc\") pod \"perf-node-gather-daemonset-2tcln\" (UID: \"fa3162aa-b022-44aa-9c22-4f489b597553\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:45.922348 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.922132    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa3162aa-b022-44aa-9c22-4f489b597553-lib-modules\") pod \"perf-node-gather-daemonset-2tcln\" (UID: \"fa3162aa-b022-44aa-9c22-4f489b597553\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:45.922348 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.922214    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa3162aa-b022-44aa-9c22-4f489b597553-sys\") pod \"perf-node-gather-daemonset-2tcln\" (UID: \"fa3162aa-b022-44aa-9c22-4f489b597553\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:45.922348 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.922233    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k54vs\" (UniqueName: \"kubernetes.io/projected/fa3162aa-b022-44aa-9c22-4f489b597553-kube-api-access-k54vs\") pod \"perf-node-gather-daemonset-2tcln\" (UID: \"fa3162aa-b022-44aa-9c22-4f489b597553\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:45.922348 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.922212    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa3162aa-b022-44aa-9c22-4f489b597553-proc\") pod \"perf-node-gather-daemonset-2tcln\" (UID: \"fa3162aa-b022-44aa-9c22-4f489b597553\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:45.922348 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.922291    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa3162aa-b022-44aa-9c22-4f489b597553-podres\") pod \"perf-node-gather-daemonset-2tcln\" (UID: \"fa3162aa-b022-44aa-9c22-4f489b597553\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:45.922544 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.922372    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa3162aa-b022-44aa-9c22-4f489b597553-lib-modules\") pod \"perf-node-gather-daemonset-2tcln\" (UID: \"fa3162aa-b022-44aa-9c22-4f489b597553\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:45.922544 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.922408    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa3162aa-b022-44aa-9c22-4f489b597553-podres\") pod \"perf-node-gather-daemonset-2tcln\" (UID: \"fa3162aa-b022-44aa-9c22-4f489b597553\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:45.934452 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:45.934408    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k54vs\" (UniqueName: \"kubernetes.io/projected/fa3162aa-b022-44aa-9c22-4f489b597553-kube-api-access-k54vs\") pod \"perf-node-gather-daemonset-2tcln\" (UID: \"fa3162aa-b022-44aa-9c22-4f489b597553\") " pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:46.059958 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:46.059847    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:46.199080 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:46.199053    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"]
Jul 06 15:01:46.200412 ip-10-0-135-124 kubenswrapper[2562]: W0706 15:01:46.200385    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfa3162aa_b022_44aa_9c22_4f489b597553.slice/crio-7318e8173af10a91b1a0b67ca68fd030d2c945a437909a37541054a577cdb994 WatchSource:0}: Error finding container 7318e8173af10a91b1a0b67ca68fd030d2c945a437909a37541054a577cdb994: Status 404 returned error can't find the container with id 7318e8173af10a91b1a0b67ca68fd030d2c945a437909a37541054a577cdb994
Jul 06 15:01:46.872069 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:46.872031    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln" event={"ID":"fa3162aa-b022-44aa-9c22-4f489b597553","Type":"ContainerStarted","Data":"4779025f769cff0db4be6b51a7efcc52b07792c5bb5afb8181e2129724ee9b31"}
Jul 06 15:01:46.872490 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:46.872089    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln" event={"ID":"fa3162aa-b022-44aa-9c22-4f489b597553","Type":"ContainerStarted","Data":"7318e8173af10a91b1a0b67ca68fd030d2c945a437909a37541054a577cdb994"}
Jul 06 15:01:46.872490 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:46.872198    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:46.888593 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:46.888541    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln" podStartSLOduration=1.888525163 podStartE2EDuration="1.888525163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:01:46.888034126 +0000 UTC m=+2487.736921099" watchObservedRunningTime="2026-07-06 15:01:46.888525163 +0000 UTC m=+2487.737412162"
Jul 06 15:01:49.134534 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:49.134502    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vwsz8_7a42caec-c09b-4a4e-9d03-5ad9f0398f88/dns/0.log"
Jul 06 15:01:49.159286 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:49.159255    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vwsz8_7a42caec-c09b-4a4e-9d03-5ad9f0398f88/kube-rbac-proxy/0.log"
Jul 06 15:01:49.259758 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:49.259725    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vvpws_11b08486-332e-46a6-a323-0399f4262447/dns-node-resolver/0.log"
Jul 06 15:01:49.971841 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:49.971809    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zsdxr_d56c55cf-0128-4fb3-9416-2aa8754c56f6/node-ca/0.log"
Jul 06 15:01:51.315541 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:51.315505    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64c7864974-sfvtr_a5888a1b-6dd0-40b3-aa5c-f1c18d458061/kube-auth-proxy/0.log"
Jul 06 15:01:52.387621 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:52.387589    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lbdzt_cde36458-5c24-447e-afa9-a72f3dcff0d7/serve-healthcheck-canary/0.log"
Jul 06 15:01:52.887470 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:52.887440    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-25f49/perf-node-gather-daemonset-2tcln"
Jul 06 15:01:53.175362 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:53.175267    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xxkrl_48c0af62-aaab-4a86-915f-88102351eeae/kube-rbac-proxy/0.log"
Jul 06 15:01:53.200284 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:53.200248    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xxkrl_48c0af62-aaab-4a86-915f-88102351eeae/exporter/0.log"
Jul 06 15:01:53.232705 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:53.232662    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xxkrl_48c0af62-aaab-4a86-915f-88102351eeae/extractor/0.log"
Jul 06 15:01:56.186459 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:56.186428    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722500-z22jq_0a896335-ae29-413d-bee4-432b0f5c6c6b/cleanup/0.log"
Jul 06 15:01:56.508654 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:56.508620    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc_244dd0ac-e39b-4814-912d-2d88f79463cd/manager/0.log"
Jul 06 15:01:56.532516 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:56.532489    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ccf4f7c96-7tjjc_244dd0ac-e39b-4814-912d-2d88f79463cd/copy-manifests/0.log"
Jul 06 15:01:56.877679 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:56.877651    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64c7864974-sfvtr_a5888a1b-6dd0-40b3-aa5c-f1c18d458061/kube-auth-proxy/0.log"
Jul 06 15:01:58.439318 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:58.439287    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d677d8c9-2kpz2_696978a9-e46a-4931-b44a-074ce9e19fa8/manager/0.log"
Jul 06 15:01:58.799891 ip-10-0-135-124 kubenswrapper[2562]: I0706 15:01:58.799857    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64c7864974-sfvtr_a5888a1b-6dd0-40b3-aa5c-f1c18d458061/kube-auth-proxy/0.log"