Jul 15 19:12:25.143796 ip-10-0-134-30 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 19:12:25.143807 ip-10-0-134-30 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 19:12:25.143816 ip-10-0-134-30 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 19:12:25.144107 ip-10-0-134-30 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 19:12:35.265183 ip-10-0-134-30 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 19:12:35.265204 ip-10-0-134-30 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot dbf523fa95854300b7386581e6a2d9a4 --
Jul 15 19:14:35.950493 ip-10-0-134-30 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 19:14:36.403085 ip-10-0-134-30 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 19:14:36.403085 ip-10-0-134-30 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 19:14:36.403085 ip-10-0-134-30 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 19:14:36.403085 ip-10-0-134-30 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 19:14:36.403085 ip-10-0-134-30 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 19:14:36.403085 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.359963    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 19:14:36.403085 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364773    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:14:36.403085 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364787    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:14:36.403085 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364791    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:14:36.403085 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364794    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:14:36.403085 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364797    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:14:36.403085 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364800    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:14:36.403085 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364803    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:14:36.403085 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364805    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364808    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364810    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364814    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364817    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364819    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364821    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364824    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364826    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364829    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364832    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364834    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364837    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364840    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364843    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364846    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364848    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364851    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364853    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364856    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:14:36.404004 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364858    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364861    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364864    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364866    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364869    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364875    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364878    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364880    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364883    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364885    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364888    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364891    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364893    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364896    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364898    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364901    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364903    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364906    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364908    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364911    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:14:36.404573 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364914    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364916    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364919    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364922    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364924    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364927    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364929    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364932    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364936    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364940    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364943    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364945    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364948    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364951    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364956    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364959    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364963    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364966    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364968    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:14:36.405100 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364971    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364974    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364977    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364979    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364982    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364985    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364987    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364990    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364994    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.364997    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365000    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365002    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365005    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365007    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365010    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365014    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365016    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365020    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365022    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365025    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:14:36.405670 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365027    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365030    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365032    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365035    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365037    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365040    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365044    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365047    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365050    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365053    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365055    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365058    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365061    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365786    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365792    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365796    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365799    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365802    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365805    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:14:36.406192 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365807    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365810    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365813    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365816    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365818    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365821    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365824    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365826    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365829    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365832    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365834    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365838    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365840    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365843    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365845    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365850    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365853    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365856    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365859    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365862    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:14:36.406759 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365865    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365868    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365870    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365873    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365877    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365881    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365886    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365890    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365894    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365897    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365899    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365902    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365904    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365907    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365909    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365912    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365916    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365918    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365921    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365923    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:14:36.407516 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365926    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365928    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365931    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365933    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365936    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365939    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365942    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365944    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365947    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365949    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365952    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365955    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365957    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365960    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365962    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365965    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365967    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365971    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365973    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365976    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:14:36.408369 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365978    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365981    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365984    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365987    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365989    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365991    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365994    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365996    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.365999    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366001    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366004    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366006    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366009    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366011    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366014    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366016    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366019    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366022    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366027    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:14:36.409121 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366030    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366032    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366035    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366037    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366040    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366042    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366044    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366047    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366049    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366052    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366055    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366058    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366060    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366062    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366433    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366449    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366452    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366455    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366458    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:14:36.409840 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366460    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366463    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366466    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366468    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366471    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366473    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366477    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366481    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366484    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366487    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366490    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366493    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366497    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366500    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366503    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366506    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366509    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366511    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366513    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:14:36.410452 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366516    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366519    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366522    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366524    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366527    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366529    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366531    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366534    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366537    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366539    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366542    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366544    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366549    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366552    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366554    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366556    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366559    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366562    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366564    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366567    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:14:36.410991 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366569    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366572    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366575    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366579    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366581    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366586    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366590    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366592    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366595    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366598    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366600    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366603    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366605    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366607    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366610    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366612    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366615    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366618    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366621    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:14:36.411632 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366624    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366626    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366629    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366632    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366634    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366637    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366639    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366641    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366644    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366646    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366649    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366651    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366654    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366656    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366658    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366661    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366663    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366666    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366669    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366674    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:14:36.412186 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366677    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366679    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366682    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366685    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366687    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366689    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366692    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366694    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366698    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366701    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366704    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366707    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366710    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366713    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366715    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.366718    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366784    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366791    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366797    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366801    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366805    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 19:14:36.412891 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366808    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366812    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366815    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366818    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366821    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366825    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366828    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366831    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366834    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366837    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366841    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366845    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366848    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366852    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366854    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366858    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366861    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366864    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366868    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366871    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366874    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366877    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366880    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366882    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 19:14:36.413498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366885    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366888    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366891    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366895    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366898    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366901    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366904    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366907    2565 flags.go:64] FLAG: --enable-server="true"
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366909    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366914    2565 flags.go:64] FLAG: --event-burst="100"
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366917    2565 flags.go:64] FLAG: --event-qps="50"
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366919    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366922    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366925    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366928    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366931    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366934    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366938    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366942    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366945    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366949    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366951    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366954    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366957    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366960    2565 flags.go:64] FLAG: --feature-gates=""
Jul 15 19:14:36.414238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366963    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366966    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366969    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366972    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366974    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366977    2565 flags.go:64] FLAG: --help="false"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366980    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-134-30.ec2.internal"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366983    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366986    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366989    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366992    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366995    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.366998    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367001    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367003    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367006    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367009    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367012    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367015    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367017    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367020    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367023    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367025    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367028    2565 flags.go:64] FLAG: --lock-file=""
Jul 15 19:14:36.569940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367032    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 19:14:36.441668 ip-10-0-134-30 systemd[1]: Started Kubernetes Kubelet.
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367036    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367039    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367044    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367047    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367050    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367053    2565 flags.go:64] FLAG: --logging-format="text"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367055    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367058    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367061    2565 flags.go:64] FLAG: --manifest-url=""
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367064    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367068    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367071    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367074    2565 flags.go:64] FLAG: --max-pods="110"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367077    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367080    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367083    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367086    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367089    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367091    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367094    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367101    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367104    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367106    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 19:14:36.571597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367109    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367112    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367119    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367121    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367124    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367127    2565 flags.go:64] FLAG: --port="10250"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367130    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367132    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09d544033fe82123c"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367135    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367141    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367144    2565 flags.go:64] FLAG: --register-node="true"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367147    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367150    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367154    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367157    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367159    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367163    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367166    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367169    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367171    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367174    2565 flags.go:64] FLAG: --runonce="false"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367177    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367180    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367183    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367185    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 19:14:36.573084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367188    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367217    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367222    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367225    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367228    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367230    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367233    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367236    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367239    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367242    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367245    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367250    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367252    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367255    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367259    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367261    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367268    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367271    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367273    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367276    2565 flags.go:64] FLAG: --v="2"
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367280    2565 flags.go:64] FLAG: --version="false"
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367288    2565 flags.go:64] FLAG: --vmodule=""
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367291    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.367294    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367408    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:14:36.574431 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367411    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367414    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367417    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367420    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367422    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367425    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367427    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367430    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367432    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367435    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367438    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367440    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367444    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367448    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367450    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367454    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367457    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367461    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367464    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:14:36.576647 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367467    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367469    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367472    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367474    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367479    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367482    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367485    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367487    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367490    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367493    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367495    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367498    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367501    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367503    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367505    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367508    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367510    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367513    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367515    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367517    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:14:36.577794 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367520    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367522    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367525    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367527    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367530    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367532    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367535    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367537    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367540    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367542    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367546    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367549    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367553    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367555    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367558    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367560    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367565    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367567    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367570    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:14:36.578726 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367572    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367575    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367578    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367580    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367583    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367586    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367589    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367591    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367594    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367596    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367599    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367601    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367604    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367606    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367609    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367611    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367614    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367616    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367619    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367621    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:14:36.579888 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367624    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367627    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367629    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367632    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367634    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367637    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367639    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367642    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367644    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367650    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367653    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367655    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367658    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367660    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367663    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367665    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367668    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367671    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367673    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:14:36.581753 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.367675    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:14:36.582915 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.368192    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 19:14:36.582915 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.378933    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 19:14:36.582915 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.378949    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 19:14:36.582915 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.378962    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 19:14:36.582915 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.378968    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 19:14:36.582915 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379037    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:14:36.582915 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379042    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:14:36.582915 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379046    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:14:36.582915 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379049    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:14:36.582915 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379052    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:14:36.582915 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379055    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:14:36.582915 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379058    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:14:36.582915 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379061    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:14:36.582915 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379064    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:14:36.582915 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379067    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379069    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379072    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379075    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379077    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379080    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379082    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379085    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379087    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379090    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379094    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379098    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379100    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379103    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379106    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379109    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379113    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379116    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379119    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379122    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:14:36.584311 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379125    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379128    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379131    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379134    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379137    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379140    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379142    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379145    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379148    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379150    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379153    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379155    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379158    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379160    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379163    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379165    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379168    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379170    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379173    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379175    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:14:36.585674 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379179    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379181    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379183    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379186    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379212    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379218    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379221    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379224    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379226    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379229    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379232    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379236    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379239    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379243    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379245    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379248    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379251    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379254    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379257    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:14:36.587089 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379259    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379261    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379264    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379268    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379271    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379274    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379277    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379280    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379283    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379286    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379288    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379291    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379296    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379299    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379302    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379304    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379307    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379310    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379312    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:14:36.587763 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379315    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:14:36.588392 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379317    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:14:36.588392 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379320    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:14:36.588392 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379323    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:14:36.588392 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379326    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:14:36.588392 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379328    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:14:36.588392 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379331    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:14:36.588392 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379333    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:14:36.588392 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379336    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:14:36.588392 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379339    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:14:36.588392 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379343    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:14:36.588392 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379346    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:14:36.588392 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.379351    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 19:14:36.588392 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379458    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:14:36.588392 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379463    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:14:36.588392 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379466    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379469    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379472    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379474    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379477    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379480    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379482    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379485    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379487    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379490    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379493    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379498    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379501    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379503    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379506    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379508    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379511    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379513    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379516    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379518    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:14:36.588908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379521    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379524    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379528    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379531    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379534    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379537    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379540    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379545    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379548    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379550    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379553    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379556    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379558    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379561    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379564    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379566    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379570    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379573    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379576    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:14:36.589699 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379579    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379582    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379585    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379589    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379593    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379596    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379598    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379601    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379604    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379606    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379609    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379611    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379614    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379616    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379619    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379622    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379624    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379630    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379633    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379635    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:14:36.590313 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379639    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379642    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379645    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379647    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379650    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379652    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379655    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379657    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379660    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379662    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379665    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379667    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379670    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379672    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379675    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379677    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379681    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379684    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379687    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:14:36.591022 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379689    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:14:36.591619 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379692    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:14:36.591619 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379694    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:14:36.591619 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379697    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:14:36.591619 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379699    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:14:36.591619 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379702    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:14:36.591619 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379704    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:14:36.591619 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379707    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:14:36.591619 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379709    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:14:36.591619 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379712    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:14:36.591619 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379715    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:14:36.591619 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379717    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:14:36.591619 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379720    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:14:36.591619 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379724    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:14:36.591619 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379727    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:14:36.591619 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379729    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:14:36.591619 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379732    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:14:36.591619 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379734    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:14:36.591619 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:36.379737    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:14:36.592141 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.379741    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 19:14:36.592141 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.379833    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 19:14:36.592141 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.381661    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 19:14:36.592141 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.382973    2565 server.go:1019] "Starting client certificate rotation"
Jul 15 19:14:36.592141 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.383074    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 19:14:36.592141 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.383110    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 19:14:36.592141 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.385335    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 19:14:36.592141 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.392364    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 19:14:36.592141 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.406422    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 15 19:14:36.592141 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.409147    2565 log.go:25] "Validated CRI v1 image API"
Jul 15 19:14:36.592141 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.409979    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 19:14:36.592141 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.412260    2565 fs.go:135] Filesystem UUIDs: map[020cd368-f678-4f09-8975-ab048af2a1df:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 85dc6b9e-de4f-4ce4-ae5e-f750fdfad268:/dev/nvme0n1p4]
Jul 15 19:14:36.594383 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.412274    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 19:14:36.595072 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.417220    2565 manager.go:216] Machine: {Timestamp:2026-07-15 19:14:36.415840499 +0000 UTC m=+0.353878958 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105435 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27672218562527110fe34cb701fe22 SystemUUID:ec276722-1856-2527-110f-e34cb701fe22 BootID:dbf523fa-9585-4300-b738-6581e6a2d9a4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:62:ff:b8:a9:83 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:62:ff:b8:a9:83 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:54:a7:bb:d4:56 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 19:14:36.595072 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.417321    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 19:14:36.595072 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.417391    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 19:14:36.595072 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.421525    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 19:14:36.595072 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.421583    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 19:14:36.595072 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.421556    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-30.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 19:14:36.595072 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.422262    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.422273    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.422280    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.422815    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.423525    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.426095    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.426221    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.426250    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.426263    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.426279    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.426294    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.426305    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.426737    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.426753    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.429893    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.436489    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.436518    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.437059    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.437073    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.437079    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.437084    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.437093    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.437101    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.437158    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.437164    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.437171    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.437177    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.437186    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.437195    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:36.437333    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-30.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:36.437368    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.437934    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.437945    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.440895    2565 server.go:1268] "Started kubelet"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.440963    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.441041    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.441111    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.441824    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9qcqz"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.442430    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.443472    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:36.446562    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 19:14:36.612270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.447961    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.448069    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:36.448084    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-30.ec2.internal\" not found"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.449750    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-30.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.449930    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9qcqz"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.450113    2565 factory.go:153] Registering CRI-O factory
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.450131    2565 factory.go:223] Registration of the crio container factory successfully
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.450177    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.450186    2565 factory.go:55] Registering systemd factory
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.450192    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.450226    2565 factory.go:103] Registering Raw factory
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.450238    2565 manager.go:1196] Started watching for new ooms in manager
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.450636    2565 manager.go:349] Starting recovery of all containers
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.458729    2565 manager.go:354] Recovery completed
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.467677    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.467776    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.467662    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.467924    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.467931    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.468500    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:36.449537    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-30.ec2.internal.18c28c7e4acd386c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-30.ec2.internal,UID:ip-10-0-134-30.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-30.ec2.internal,},FirstTimestamp:2026-07-15 19:14:36.440868972 +0000 UTC m=+0.378907450,LastTimestamp:2026-07-15 19:14:36.440868972 +0000 UTC m=+0.378907450,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-30.ec2.internal,}"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:36.475384    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:36.475428    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-30.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.476225    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.479787    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.479830    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.480063    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.485413    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.485424    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.485425    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.485439    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.486207    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:14:36.614920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.486234    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:14:36.616490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.486255    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:14:36.616490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.486486    2565 policy_none.go:49] "None policy: Start"
Jul 15 19:14:36.616490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.486499    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 19:14:36.616490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.486511    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 19:14:36.616490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.487693    2565 policy_none.go:47] "Start"
Jul 15 19:14:36.616490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.541574    2565 manager.go:337] "Starting Device Plugin manager"
Jul 15 19:14:36.616490 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:36.541758    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 19:14:36.616490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.541772    2565 server.go:87] "Starting device plugin registration server"
Jul 15 19:14:36.616490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.542026    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 19:14:36.616490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.542038    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 19:14:36.616490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.542130    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 19:14:36.616490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.542196    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 19:14:36.616490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.542202    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 19:14:36.616490 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:36.542717    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 19:14:36.616490 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:36.542775    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-30.ec2.internal\" not found"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.642518    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.643578    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.643620    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.643637    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.643674    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-30.ec2.internal"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.653052    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-30.ec2.internal"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:36.653079    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-30.ec2.internal\": node \"ip-10-0-134-30.ec2.internal\" not found"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:36.666047    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-30.ec2.internal\" not found"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.682120    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.682161    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.682181    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:36.682214    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.685150    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:36.766828    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-30.ec2.internal\" not found"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.783147    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-30.ec2.internal"]
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.783278    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.784182    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.784221    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.784239    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.793023    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.793191    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.793235    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.794284    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.794302    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.794324    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.794345    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.794364    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.794396    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.795711    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-30.ec2.internal"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.795732    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.796433    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.796461    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.796472    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:14:36.842309 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:36.826085    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-30.ec2.internal\" not found" node="ip-10-0-134-30.ec2.internal"
Jul 15 19:14:36.844735 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:36.830901    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-30.ec2.internal\" not found" node="ip-10-0-134-30.ec2.internal"
Jul 15 19:14:37.034439 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:36.867350    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-30.ec2.internal\" not found"
Jul 15 19:14:37.034439 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.876399    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9ed8bf5af08da7fafa3062ddefc6174a-config\") pod \"kube-apiserver-proxy-ip-10-0-134-30.ec2.internal\" (UID: \"9ed8bf5af08da7fafa3062ddefc6174a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-30.ec2.internal"
Jul 15 19:14:37.034439 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.876426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd2a6115e39d1cdf12008ebc7db2584c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal\" (UID: \"bd2a6115e39d1cdf12008ebc7db2584c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal"
Jul 15 19:14:37.034439 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.876470    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd2a6115e39d1cdf12008ebc7db2584c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal\" (UID: \"bd2a6115e39d1cdf12008ebc7db2584c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal"
Jul 15 19:14:37.034439 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:36.968141    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-30.ec2.internal\" not found"
Jul 15 19:14:37.034439 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.976942    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9ed8bf5af08da7fafa3062ddefc6174a-config\") pod \"kube-apiserver-proxy-ip-10-0-134-30.ec2.internal\" (UID: \"9ed8bf5af08da7fafa3062ddefc6174a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-30.ec2.internal"
Jul 15 19:14:37.034439 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.976975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd2a6115e39d1cdf12008ebc7db2584c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal\" (UID: \"bd2a6115e39d1cdf12008ebc7db2584c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal"
Jul 15 19:14:37.034439 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.977009    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd2a6115e39d1cdf12008ebc7db2584c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal\" (UID: \"bd2a6115e39d1cdf12008ebc7db2584c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal"
Jul 15 19:14:37.034439 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.977054    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd2a6115e39d1cdf12008ebc7db2584c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal\" (UID: \"bd2a6115e39d1cdf12008ebc7db2584c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal"
Jul 15 19:14:37.034439 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.977063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9ed8bf5af08da7fafa3062ddefc6174a-config\") pod \"kube-apiserver-proxy-ip-10-0-134-30.ec2.internal\" (UID: \"9ed8bf5af08da7fafa3062ddefc6174a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-30.ec2.internal"
Jul 15 19:14:37.034439 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:36.977082    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd2a6115e39d1cdf12008ebc7db2584c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal\" (UID: \"bd2a6115e39d1cdf12008ebc7db2584c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal"
Jul 15 19:14:37.235761 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:37.068713    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-30.ec2.internal\" not found"
Jul 15 19:14:37.235761 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:37.131743    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal"
Jul 15 19:14:37.235761 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:37.134040    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-30.ec2.internal"
Jul 15 19:14:37.235761 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:37.169557    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-30.ec2.internal\" not found"
Jul 15 19:14:37.458903 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:37.269738    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-30.ec2.internal\" not found"
Jul 15 19:14:37.458903 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:37.369778    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-30.ec2.internal\" not found"
Jul 15 19:14:37.458903 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:37.382901    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 19:14:37.458903 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:37.383063    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 19:14:37.607223 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:37.470815    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-30.ec2.internal\" not found"
Jul 15 19:14:37.607223 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:37.476152    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 19:09:37 +0000 UTC" deadline="2028-02-18 11:57:19.774366853 +0000 UTC"
Jul 15 19:14:37.607223 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:37.476173    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13984h42m42.298197014s"
Jul 15 19:14:37.607223 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:37.571907    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-30.ec2.internal\" not found"
Jul 15 19:14:37.763930 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:37.653780    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:14:37.763930 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:37.672741    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-30.ec2.internal\" not found"
Jul 15 19:14:37.763930 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:37.756513    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed8bf5af08da7fafa3062ddefc6174a.slice/crio-8701c59f6e243af905731a34f8bb2c5cdee8c28e7aa4ff12604e704daeab37e1 WatchSource:0}: Error finding container 8701c59f6e243af905731a34f8bb2c5cdee8c28e7aa4ff12604e704daeab37e1: Status 404 returned error can't find the container with id 8701c59f6e243af905731a34f8bb2c5cdee8c28e7aa4ff12604e704daeab37e1
Jul 15 19:14:37.763930 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:37.757049    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd2a6115e39d1cdf12008ebc7db2584c.slice/crio-5af42c465c7cdae5cdd63ef38b8c1c02986b0cef80211ae85f08e94ade8811c3 WatchSource:0}: Error finding container 5af42c465c7cdae5cdd63ef38b8c1c02986b0cef80211ae85f08e94ade8811c3: Status 404 returned error can't find the container with id 5af42c465c7cdae5cdd63ef38b8c1c02986b0cef80211ae85f08e94ade8811c3
Jul 15 19:14:37.948406 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:37.773474    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-30.ec2.internal\" not found"
Jul 15 19:14:37.948406 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:37.781089    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:14:37.948406 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:37.873517    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-30.ec2.internal\" not found"
Jul 15 19:14:37.948406 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:37.908987    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:14:37.950495 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:37.950471    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-30.ec2.internal"
Jul 15 19:14:37.963473 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:37.963453    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 19:14:37.964486 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:37.964471    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal"
Jul 15 19:14:37.978270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:37.978246    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 19:14:38.386099 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.386018    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:14:38.429694 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.429651    2565 apiserver.go:52] "Watching apiserver"
Jul 15 19:14:38.438145 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.438110    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 19:14:38.438599 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.438565    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-kqpm4","kube-system/konnectivity-agent-qj5fv","openshift-dns/node-resolver-xkhrx","openshift-image-registry/node-ca-85vb9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal","openshift-multus/network-metrics-daemon-rxq78","openshift-network-diagnostics/network-check-target-n844l","openshift-ovn-kubernetes/ovnkube-node-whcqx","kube-system/kube-apiserver-proxy-ip-10-0-134-30.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc","openshift-cluster-node-tuning-operator/tuned-9dx8r","openshift-multus/multus-additional-cni-plugins-mqblk","openshift-multus/multus-cfk6s","openshift-network-operator/iptables-alerter-rwc27"]
Jul 15 19:14:38.440169 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.440143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:14:38.440300 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:38.440259    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:14:38.441387 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.441361    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.442481 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.442460    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xkhrx"
Jul 15 19:14:38.443887 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.443851    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 19:14:38.444102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.444082    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:14:38.444211 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.444099    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t9ds6\""
Jul 15 19:14:38.444211 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.444092    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-85vb9"
Jul 15 19:14:38.444841 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.444605    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 19:14:38.444841 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.444704    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c58dr\""
Jul 15 19:14:38.444841 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.444722    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 19:14:38.445319 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.445299    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rwc27"
Jul 15 19:14:38.446629 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.446601    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 19:14:38.446758 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.446736    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f6vkg\""
Jul 15 19:14:38.446982 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.446963    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 19:14:38.447046 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.446964    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 19:14:38.447113 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.447042    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:38.447184 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:38.447107    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:14:38.447856 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.447765    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:14:38.448136 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.448109    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mqnx7\""
Jul 15 19:14:38.448313 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.448292    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 19:14:38.448393 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.448369    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 19:14:38.448646 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.448625    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.449709 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.449688    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.450669 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.450649    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 19:14:38.450766 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.450685    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 19:14:38.451642 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.451550    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 19:14:38.451799 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.451780    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qj5fv"
Jul 15 19:14:38.452086 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.452064    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 19:14:38.452128 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.452102    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hf7f7\""
Jul 15 19:14:38.452128 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.452119    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 19:14:38.452190 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.452143    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wftx6\""
Jul 15 19:14:38.453335 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.453076    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 19:14:38.453335 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.453176    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 19:14:38.453335 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.453213    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 19:14:38.453335 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.453253    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 19:14:38.454181 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.453607    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 19:14:38.454262 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.454198    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 19:14:38.454380 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.454359    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 19:14:38.455114 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.455091    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hlbvl\""
Jul 15 19:14:38.456984 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.456679    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 19:14:38.457216 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.457170    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.459309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.459290    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:38.459888 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:38.459372    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:14:38.460150 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.460130    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 19:14:38.460259 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.460148    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 19:14:38.460343 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.460277    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ds4fg\""
Jul 15 19:14:38.461081 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.461059    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.461182 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.461062    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 19:14:38.463344 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.463324    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jn9lv\""
Jul 15 19:14:38.463754 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.463729    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 19:14:38.463850 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.463825    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 19:14:38.465018 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.464831    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 19:14:38.469121 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.469101    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 19:14:38.474918 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.474888    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:14:38.483854 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.483829    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-run\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.483959 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.483867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-lib-modules\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.483959 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.483892    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4z7x\" (UniqueName: \"kubernetes.io/projected/403b76f2-1f50-4cbe-8e15-2f801a1a00bf-kube-api-access-p4z7x\") pod \"node-resolver-xkhrx\" (UID: \"403b76f2-1f50-4cbe-8e15-2f801a1a00bf\") " pod="openshift-dns/node-resolver-xkhrx"
Jul 15 19:14:38.483959 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.483917    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66t54\" (UniqueName: \"kubernetes.io/projected/490659e2-9daa-46c5-90a3-7247a4d6efc6-kube-api-access-66t54\") pod \"iptables-alerter-rwc27\" (UID: \"490659e2-9daa-46c5-90a3-7247a4d6efc6\") " pod="openshift-network-operator/iptables-alerter-rwc27"
Jul 15 19:14:38.483959 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.483941    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-multus-conf-dir\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.484170 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.483966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfcx7\" (UniqueName: \"kubernetes.io/projected/b211001d-7fa8-4435-8e93-82de48bfc7c3-kube-api-access-pfcx7\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.484170 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.483989    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-sys\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.484170 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484014    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4440f86e-5176-4bc6-a35d-7b2b2c991a50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.484170 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-sysconfig\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.484170 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484064    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-run-netns\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.484170 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-run-openvswitch\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.484170 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484112    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-run-ovn\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.484170 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484135    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29fa5340-5611-41f9-94e9-d42cfc8bab06-system-cni-dir\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.484170 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-host\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.484646 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484184    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79sqr\" (UniqueName: \"kubernetes.io/projected/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-kube-api-access-79sqr\") pod \"network-metrics-daemon-rxq78\" (UID: \"4808e44a-0e6a-47eb-babd-4c7254c7a5f6\") " pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:38.484646 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484209    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4440f86e-5176-4bc6-a35d-7b2b2c991a50-socket-dir\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.484646 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484251    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.484646 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-host-var-lib-cni-multus\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.484646 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484302    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-host-run-multus-certs\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.484646 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484328    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-sysctl-conf\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.484646 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484353    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5prdf\" (UniqueName: \"kubernetes.io/projected/4440f86e-5176-4bc6-a35d-7b2b2c991a50-kube-api-access-5prdf\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.484646 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484376    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-slash\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.484646 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484402    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-var-lib-openvswitch\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.484646 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zhjr\" (UniqueName: \"kubernetes.io/projected/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-kube-api-access-2zhjr\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.484646 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-system-cni-dir\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.484646 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484509    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a7ad72a4-2fca-4e84-987b-8cd04ea99c2b-agent-certs\") pod \"konnectivity-agent-qj5fv\" (UID: \"a7ad72a4-2fca-4e84-987b-8cd04ea99c2b\") " pod="kube-system/konnectivity-agent-qj5fv"
Jul 15 19:14:38.484646 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484572    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.485310 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484600    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-ovnkube-config\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.485310 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484626    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-hostroot\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.485310 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484668    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/29fa5340-5611-41f9-94e9-d42cfc8bab06-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.485310 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484692    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-var-lib-kubelet\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.485310 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-tuned\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.485310 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484756    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/403b76f2-1f50-4cbe-8e15-2f801a1a00bf-tmp-dir\") pod \"node-resolver-xkhrx\" (UID: \"403b76f2-1f50-4cbe-8e15-2f801a1a00bf\") " pod="openshift-dns/node-resolver-xkhrx"
Jul 15 19:14:38.485310 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret\") pod \"global-pull-secret-syncer-kqpm4\" (UID: \"c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0\") " pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:38.485310 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484808    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddg2d\" (UniqueName: \"kubernetes.io/projected/f1515c25-1fb1-42ea-87ce-26b955623a40-kube-api-access-ddg2d\") pod \"node-ca-85vb9\" (UID: \"f1515c25-1fb1-42ea-87ce-26b955623a40\") " pod="openshift-image-registry/node-ca-85vb9"
Jul 15 19:14:38.485310 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-host-var-lib-kubelet\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.485310 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-etc-kubernetes\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.485310 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484899    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29fa5340-5611-41f9-94e9-d42cfc8bab06-cni-binary-copy\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.485310 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-sysctl-d\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.485310 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.484980    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdxbk\" (UniqueName: \"kubernetes.io/projected/69b481ec-02a5-4a23-b02e-0362e02208f6-kube-api-access-vdxbk\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.485310 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485018    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4440f86e-5176-4bc6-a35d-7b2b2c991a50-etc-selinux\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.485985 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-kubelet-config\") pod \"global-pull-secret-syncer-kqpm4\" (UID: \"c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0\") " pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:38.485985 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b211001d-7fa8-4435-8e93-82de48bfc7c3-cni-binary-copy\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.485985 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485096    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-modprobe-d\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.485985 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485135    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-dbus\") pod \"global-pull-secret-syncer-kqpm4\" (UID: \"c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0\") " pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:38.485985 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/29fa5340-5611-41f9-94e9-d42cfc8bab06-os-release\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.485985 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485197    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn7h6\" (UniqueName: \"kubernetes.io/projected/29fa5340-5611-41f9-94e9-d42cfc8bab06-kube-api-access-fn7h6\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.485985 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485241    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-systemd-units\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.485985 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485267    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-multus-cni-dir\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.485985 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485320    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/403b76f2-1f50-4cbe-8e15-2f801a1a00bf-hosts-file\") pod \"node-resolver-xkhrx\" (UID: \"403b76f2-1f50-4cbe-8e15-2f801a1a00bf\") " pod="openshift-dns/node-resolver-xkhrx"
Jul 15 19:14:38.485985 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485356    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/490659e2-9daa-46c5-90a3-7247a4d6efc6-host-slash\") pod \"iptables-alerter-rwc27\" (UID: \"490659e2-9daa-46c5-90a3-7247a4d6efc6\") " pod="openshift-network-operator/iptables-alerter-rwc27"
Jul 15 19:14:38.485985 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485382    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4440f86e-5176-4bc6-a35d-7b2b2c991a50-device-dir\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.485985 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485432    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6vd6\" (UniqueName: \"kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6\") pod \"network-check-target-n844l\" (UID: \"433b5ca5-5a13-436f-8794-aed9e142b74d\") " pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:14:38.485985 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485465    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f1515c25-1fb1-42ea-87ce-26b955623a40-serviceca\") pod \"node-ca-85vb9\" (UID: \"f1515c25-1fb1-42ea-87ce-26b955623a40\") " pod="openshift-image-registry/node-ca-85vb9"
Jul 15 19:14:38.485985 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-etc-openvswitch\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.486699 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-node-log\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.486699 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485562    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-ovnkube-script-lib\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.486699 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-kubelet\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.486699 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-cni-bin\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.486699 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1515c25-1fb1-42ea-87ce-26b955623a40-host\") pod \"node-ca-85vb9\" (UID: \"f1515c25-1fb1-42ea-87ce-26b955623a40\") " pod="openshift-image-registry/node-ca-85vb9"
Jul 15 19:14:38.486699 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-os-release\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.486699 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485701    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4440f86e-5176-4bc6-a35d-7b2b2c991a50-registration-dir\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.486699 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4440f86e-5176-4bc6-a35d-7b2b2c991a50-sys-fs\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.486699 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485782    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-env-overrides\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.486699 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485830    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-ovn-node-metrics-cert\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.486699 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-multus-socket-dir-parent\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.486699 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485881    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b211001d-7fa8-4435-8e93-82de48bfc7c3-multus-daemon-config\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.486699 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29fa5340-5611-41f9-94e9-d42cfc8bab06-cnibin\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.486699 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485939    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29fa5340-5611-41f9-94e9-d42cfc8bab06-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.487433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.485970    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/29fa5340-5611-41f9-94e9-d42cfc8bab06-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.487433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.486003    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-systemd\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.487433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.486040    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-run-systemd\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.487433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.486069    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-cni-netd\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.487433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.486105    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-cnibin\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.487433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.486128    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-host-var-lib-cni-bin\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.487433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.486154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69b481ec-02a5-4a23-b02e-0362e02208f6-tmp\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.487433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.486179    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/490659e2-9daa-46c5-90a3-7247a4d6efc6-iptables-alerter-script\") pod \"iptables-alerter-rwc27\" (UID: \"490659e2-9daa-46c5-90a3-7247a4d6efc6\") " pod="openshift-network-operator/iptables-alerter-rwc27"
Jul 15 19:14:38.487433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.486209    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs\") pod \"network-metrics-daemon-rxq78\" (UID: \"4808e44a-0e6a-47eb-babd-4c7254c7a5f6\") " pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:38.487433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.486244    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-host-run-k8s-cni-cncf-io\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.487433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.486299    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-host-run-netns\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.487433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.486325    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-kubernetes\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.487433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.486347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-log-socket\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.487433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.486372    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a7ad72a4-2fca-4e84-987b-8cd04ea99c2b-konnectivity-ca\") pod \"konnectivity-agent-qj5fv\" (UID: \"a7ad72a4-2fca-4e84-987b-8cd04ea99c2b\") " pod="kube-system/konnectivity-agent-qj5fv"
Jul 15 19:14:38.497012 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.496895    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qmbg9"
Jul 15 19:14:38.507312 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.507290    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qmbg9"
Jul 15 19:14:38.586788 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.586748    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-var-lib-openvswitch\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.587053 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.586792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zhjr\" (UniqueName: \"kubernetes.io/projected/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-kube-api-access-2zhjr\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.587053 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.586818    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-system-cni-dir\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.587053 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.586843    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a7ad72a4-2fca-4e84-987b-8cd04ea99c2b-agent-certs\") pod \"konnectivity-agent-qj5fv\" (UID: \"a7ad72a4-2fca-4e84-987b-8cd04ea99c2b\") " pod="kube-system/konnectivity-agent-qj5fv"
Jul 15 19:14:38.587053 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.586870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.587053 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.586897    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-ovnkube-config\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.587053 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.586920    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-hostroot\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.587053 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.586944    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/29fa5340-5611-41f9-94e9-d42cfc8bab06-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.587053 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.586969    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-var-lib-kubelet\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.587053 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-tuned\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.587053 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587027    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/403b76f2-1f50-4cbe-8e15-2f801a1a00bf-tmp-dir\") pod \"node-resolver-xkhrx\" (UID: \"403b76f2-1f50-4cbe-8e15-2f801a1a00bf\") " pod="openshift-dns/node-resolver-xkhrx"
Jul 15 19:14:38.587053 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587055    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret\") pod \"global-pull-secret-syncer-kqpm4\" (UID: \"c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0\") " pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:38.587685 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587086    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddg2d\" (UniqueName: \"kubernetes.io/projected/f1515c25-1fb1-42ea-87ce-26b955623a40-kube-api-access-ddg2d\") pod \"node-ca-85vb9\" (UID: \"f1515c25-1fb1-42ea-87ce-26b955623a40\") " pod="openshift-image-registry/node-ca-85vb9"
Jul 15 19:14:38.587685 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-host-var-lib-kubelet\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.587685 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587146    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-etc-kubernetes\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.587685 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587171    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29fa5340-5611-41f9-94e9-d42cfc8bab06-cni-binary-copy\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.587685 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-sysctl-d\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.587685 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587227    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdxbk\" (UniqueName: \"kubernetes.io/projected/69b481ec-02a5-4a23-b02e-0362e02208f6-kube-api-access-vdxbk\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.587685 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587228    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-var-lib-openvswitch\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.587685 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587309    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-host-var-lib-kubelet\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.587685 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4440f86e-5176-4bc6-a35d-7b2b2c991a50-etc-selinux\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.587685 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-kubelet-config\") pod \"global-pull-secret-syncer-kqpm4\" (UID: \"c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0\") " pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:38.587685 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b211001d-7fa8-4435-8e93-82de48bfc7c3-cni-binary-copy\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.587685 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-modprobe-d\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.588374 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587715    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-dbus\") pod \"global-pull-secret-syncer-kqpm4\" (UID: \"c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0\") " pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:38.588374 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587742    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/29fa5340-5611-41f9-94e9-d42cfc8bab06-os-release\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.588374 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn7h6\" (UniqueName: \"kubernetes.io/projected/29fa5340-5611-41f9-94e9-d42cfc8bab06-kube-api-access-fn7h6\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.588374 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587797    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-systemd-units\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.588374 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-multus-cni-dir\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.588374 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587834    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29fa5340-5611-41f9-94e9-d42cfc8bab06-cni-binary-copy\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.588374 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/403b76f2-1f50-4cbe-8e15-2f801a1a00bf-hosts-file\") pod \"node-resolver-xkhrx\" (UID: \"403b76f2-1f50-4cbe-8e15-2f801a1a00bf\") " pod="openshift-dns/node-resolver-xkhrx"
Jul 15 19:14:38.588374 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587869    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-system-cni-dir\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.588374 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/490659e2-9daa-46c5-90a3-7247a4d6efc6-host-slash\") pod \"iptables-alerter-rwc27\" (UID: \"490659e2-9daa-46c5-90a3-7247a4d6efc6\") " pod="openshift-network-operator/iptables-alerter-rwc27"
Jul 15 19:14:38.588374 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587920    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4440f86e-5176-4bc6-a35d-7b2b2c991a50-device-dir\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.588374 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6vd6\" (UniqueName: \"kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6\") pod \"network-check-target-n844l\" (UID: \"433b5ca5-5a13-436f-8794-aed9e142b74d\") " pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:14:38.588374 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f1515c25-1fb1-42ea-87ce-26b955623a40-serviceca\") pod \"node-ca-85vb9\" (UID: \"f1515c25-1fb1-42ea-87ce-26b955623a40\") " pod="openshift-image-registry/node-ca-85vb9"
Jul 15 19:14:38.588374 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587979    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.588374 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-etc-openvswitch\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.589102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.588021    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4440f86e-5176-4bc6-a35d-7b2b2c991a50-etc-selinux\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.589102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.588024    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-node-log\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.589102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.588063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-node-log\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.589102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587608    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/403b76f2-1f50-4cbe-8e15-2f801a1a00bf-tmp-dir\") pod \"node-resolver-xkhrx\" (UID: \"403b76f2-1f50-4cbe-8e15-2f801a1a00bf\") " pod="openshift-dns/node-resolver-xkhrx"
Jul 15 19:14:38.589102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.588142    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-kubelet-config\") pod \"global-pull-secret-syncer-kqpm4\" (UID: \"c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0\") " pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:38.589102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.588183    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4440f86e-5176-4bc6-a35d-7b2b2c991a50-device-dir\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.589102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.588064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-ovnkube-script-lib\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.589102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.587918    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/490659e2-9daa-46c5-90a3-7247a4d6efc6-host-slash\") pod \"iptables-alerter-rwc27\" (UID: \"490659e2-9daa-46c5-90a3-7247a4d6efc6\") " pod="openshift-network-operator/iptables-alerter-rwc27"
Jul 15 19:14:38.589102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.588380    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/403b76f2-1f50-4cbe-8e15-2f801a1a00bf-hosts-file\") pod \"node-resolver-xkhrx\" (UID: \"403b76f2-1f50-4cbe-8e15-2f801a1a00bf\") " pod="openshift-dns/node-resolver-xkhrx"
Jul 15 19:14:38.589102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.588414    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 19:14:38.589102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.588491    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-var-lib-kubelet\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.589102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.588514    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-etc-openvswitch\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.589102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.588660    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-sysctl-d\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.589102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.588679    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-dbus\") pod \"global-pull-secret-syncer-kqpm4\" (UID: \"c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0\") " pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:38.589102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.588726    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-hostroot\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.589846 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.588718    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-ovnkube-config\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.589846 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.588772    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-etc-kubernetes\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.589846 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.588803    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b211001d-7fa8-4435-8e93-82de48bfc7c3-cni-binary-copy\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.589846 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.588935    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-systemd-units\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.589846 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.589194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-kubelet\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.589846 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.589249    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-cni-bin\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.589846 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.589281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1515c25-1fb1-42ea-87ce-26b955623a40-host\") pod \"node-ca-85vb9\" (UID: \"f1515c25-1fb1-42ea-87ce-26b955623a40\") " pod="openshift-image-registry/node-ca-85vb9"
Jul 15 19:14:38.589846 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.589233    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/29fa5340-5611-41f9-94e9-d42cfc8bab06-os-release\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.589846 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.589299    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-ovnkube-script-lib\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.589846 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.589354    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-os-release\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.589846 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.589395    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-kubelet\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.589846 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.589429    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f1515c25-1fb1-42ea-87ce-26b955623a40-serviceca\") pod \"node-ca-85vb9\" (UID: \"f1515c25-1fb1-42ea-87ce-26b955623a40\") " pod="openshift-image-registry/node-ca-85vb9"
Jul 15 19:14:38.589846 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.589405    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-modprobe-d\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.589846 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.589481    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-multus-cni-dir\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.589846 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.589500    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-cni-bin\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.590688 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.589505    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-os-release\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.590688 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.589517    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1515c25-1fb1-42ea-87ce-26b955623a40-host\") pod \"node-ca-85vb9\" (UID: \"f1515c25-1fb1-42ea-87ce-26b955623a40\") " pod="openshift-image-registry/node-ca-85vb9"
Jul 15 19:14:38.590688 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:38.589595    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:14:38.590688 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.589769    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/29fa5340-5611-41f9-94e9-d42cfc8bab06-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.590688 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.589796    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4440f86e-5176-4bc6-a35d-7b2b2c991a50-registration-dir\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.590688 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:38.589937    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret podName:c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0 nodeName:}" failed. No retries permitted until 2026-07-15 19:14:39.089896859 +0000 UTC m=+3.027935311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret") pod "global-pull-secret-syncer-kqpm4" (UID: "c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:14:38.590688 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.589555    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4440f86e-5176-4bc6-a35d-7b2b2c991a50-registration-dir\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.590688 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4440f86e-5176-4bc6-a35d-7b2b2c991a50-sys-fs\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.590688 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590232    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-env-overrides\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.590688 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590257    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-ovn-node-metrics-cert\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.590688 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590301    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-multus-socket-dir-parent\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.590688 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590303    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4440f86e-5176-4bc6-a35d-7b2b2c991a50-sys-fs\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.590688 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b211001d-7fa8-4435-8e93-82de48bfc7c3-multus-daemon-config\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.590688 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590353    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29fa5340-5611-41f9-94e9-d42cfc8bab06-cnibin\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.591437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29fa5340-5611-41f9-94e9-d42cfc8bab06-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.591437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/29fa5340-5611-41f9-94e9-d42cfc8bab06-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.591437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590431    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-systemd\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.591437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-run-systemd\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.591437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590480    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-cni-netd\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.591437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-cnibin\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.591437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590527    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-host-var-lib-cni-bin\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.591437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69b481ec-02a5-4a23-b02e-0362e02208f6-tmp\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.591437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/490659e2-9daa-46c5-90a3-7247a4d6efc6-iptables-alerter-script\") pod \"iptables-alerter-rwc27\" (UID: \"490659e2-9daa-46c5-90a3-7247a4d6efc6\") " pod="openshift-network-operator/iptables-alerter-rwc27"
Jul 15 19:14:38.591437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590610    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs\") pod \"network-metrics-daemon-rxq78\" (UID: \"4808e44a-0e6a-47eb-babd-4c7254c7a5f6\") " pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:38.591437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-host-run-k8s-cni-cncf-io\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.591437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590651    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-systemd\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.591437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590661    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-host-run-netns\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.591437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590689    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-kubernetes\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.591437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-log-socket\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.592234 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590742    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a7ad72a4-2fca-4e84-987b-8cd04ea99c2b-konnectivity-ca\") pod \"konnectivity-agent-qj5fv\" (UID: \"a7ad72a4-2fca-4e84-987b-8cd04ea99c2b\") " pod="kube-system/konnectivity-agent-qj5fv"
Jul 15 19:14:38.592234 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-run\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.592234 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-lib-modules\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.592234 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590809    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4z7x\" (UniqueName: \"kubernetes.io/projected/403b76f2-1f50-4cbe-8e15-2f801a1a00bf-kube-api-access-p4z7x\") pod \"node-resolver-xkhrx\" (UID: \"403b76f2-1f50-4cbe-8e15-2f801a1a00bf\") " pod="openshift-dns/node-resolver-xkhrx"
Jul 15 19:14:38.592234 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66t54\" (UniqueName: \"kubernetes.io/projected/490659e2-9daa-46c5-90a3-7247a4d6efc6-kube-api-access-66t54\") pod \"iptables-alerter-rwc27\" (UID: \"490659e2-9daa-46c5-90a3-7247a4d6efc6\") " pod="openshift-network-operator/iptables-alerter-rwc27"
Jul 15 19:14:38.592234 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-multus-conf-dir\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.592234 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590888    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfcx7\" (UniqueName: \"kubernetes.io/projected/b211001d-7fa8-4435-8e93-82de48bfc7c3-kube-api-access-pfcx7\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.592234 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590912    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-sys\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.592234 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4440f86e-5176-4bc6-a35d-7b2b2c991a50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.592234 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590968    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-sysconfig\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.592234 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-run-netns\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.592234 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591017    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-run-openvswitch\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.592234 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-env-overrides\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.592234 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591040    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-run-ovn\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.592234 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591086    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-run-ovn\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.593001 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591086    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29fa5340-5611-41f9-94e9-d42cfc8bab06-system-cni-dir\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.593001 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591123    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-host\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.593001 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79sqr\" (UniqueName: \"kubernetes.io/projected/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-kube-api-access-79sqr\") pod \"network-metrics-daemon-rxq78\" (UID: \"4808e44a-0e6a-47eb-babd-4c7254c7a5f6\") " pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:38.593001 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591184    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4440f86e-5176-4bc6-a35d-7b2b2c991a50-socket-dir\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.593001 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591200    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b211001d-7fa8-4435-8e93-82de48bfc7c3-multus-daemon-config\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.593001 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-run-systemd\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.593001 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591212    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.593001 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-host-var-lib-cni-multus\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.593001 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591253    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29fa5340-5611-41f9-94e9-d42cfc8bab06-cnibin\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.593001 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-host-run-multus-certs\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.593001 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591314    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-sysctl-conf\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.593001 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-run\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.593001 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591345    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5prdf\" (UniqueName: \"kubernetes.io/projected/4440f86e-5176-4bc6-a35d-7b2b2c991a50-kube-api-access-5prdf\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.593001 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591371    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-slash\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.593759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591126    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29fa5340-5611-41f9-94e9-d42cfc8bab06-system-cni-dir\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.593759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591429    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-host-run-multus-certs\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.593759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-lib-modules\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.593759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591776    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-sysconfig\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.593759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591853    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4440f86e-5176-4bc6-a35d-7b2b2c991a50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.593759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591909    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-cni-netd\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.593759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.591923    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a7ad72a4-2fca-4e84-987b-8cd04ea99c2b-konnectivity-ca\") pod \"konnectivity-agent-qj5fv\" (UID: \"a7ad72a4-2fca-4e84-987b-8cd04ea99c2b\") " pod="kube-system/konnectivity-agent-qj5fv"
Jul 15 19:14:38.593759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.592008    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-cnibin\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.593759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.592023    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4440f86e-5176-4bc6-a35d-7b2b2c991a50-socket-dir\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.593759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.592058    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-host-var-lib-cni-bin\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.593759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.592078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.593759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.592120    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-host-var-lib-cni-multus\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.593759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.592345    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/29fa5340-5611-41f9-94e9-d42cfc8bab06-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.593759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.592348    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29fa5340-5611-41f9-94e9-d42cfc8bab06-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.593759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.592402    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-run-netns\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.594572 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.592429    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-sys\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.594572 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.592457    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-run-openvswitch\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.594572 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.592523    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-host\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.594572 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:38.592767    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:14:38.594572 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.592881    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/490659e2-9daa-46c5-90a3-7247a4d6efc6-iptables-alerter-script\") pod \"iptables-alerter-rwc27\" (UID: \"490659e2-9daa-46c5-90a3-7247a4d6efc6\") " pod="openshift-network-operator/iptables-alerter-rwc27"
Jul 15 19:14:38.594572 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:38.592920    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs podName:4808e44a-0e6a-47eb-babd-4c7254c7a5f6 nodeName:}" failed. No retries permitted until 2026-07-15 19:14:39.092889719 +0000 UTC m=+3.030928169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs") pod "network-metrics-daemon-rxq78" (UID: "4808e44a-0e6a-47eb-babd-4c7254c7a5f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:14:38.594572 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.592972    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-multus-conf-dir\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.594572 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.593046    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-host-slash\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.594572 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.590712    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-multus-socket-dir-parent\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.594572 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.593194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-sysctl-conf\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.594572 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.593269    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-host-run-netns\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.594572 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.593281    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-kubernetes\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.594572 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.593318    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b211001d-7fa8-4435-8e93-82de48bfc7c3-host-run-k8s-cni-cncf-io\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.594572 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.593384    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-log-socket\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.594572 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.594063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/69b481ec-02a5-4a23-b02e-0362e02208f6-etc-tuned\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.595380 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.594608    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a7ad72a4-2fca-4e84-987b-8cd04ea99c2b-agent-certs\") pod \"konnectivity-agent-qj5fv\" (UID: \"a7ad72a4-2fca-4e84-987b-8cd04ea99c2b\") " pod="kube-system/konnectivity-agent-qj5fv"
Jul 15 19:14:38.596650 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.596562    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-ovn-node-metrics-cert\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.597067 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.597046    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69b481ec-02a5-4a23-b02e-0362e02208f6-tmp\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.600990 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:38.600868    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:14:38.600990 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:38.600891    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:14:38.600990 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:38.600905    2565 projected.go:196] Error preparing data for projected volume kube-api-access-f6vd6 for pod openshift-network-diagnostics/network-check-target-n844l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:14:38.600990 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:38.600962    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6 podName:433b5ca5-5a13-436f-8794-aed9e142b74d nodeName:}" failed. No retries permitted until 2026-07-15 19:14:39.100942579 +0000 UTC m=+3.038981053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f6vd6" (UniqueName: "kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6") pod "network-check-target-n844l" (UID: "433b5ca5-5a13-436f-8794-aed9e142b74d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:14:38.603269 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.603246    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zhjr\" (UniqueName: \"kubernetes.io/projected/9c4ac0eb-5179-4f51-b8dd-8204f934a1d3-kube-api-access-2zhjr\") pod \"ovnkube-node-whcqx\" (UID: \"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.605371 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.605311    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn7h6\" (UniqueName: \"kubernetes.io/projected/29fa5340-5611-41f9-94e9-d42cfc8bab06-kube-api-access-fn7h6\") pod \"multus-additional-cni-plugins-mqblk\" (UID: \"29fa5340-5611-41f9-94e9-d42cfc8bab06\") " pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:38.606942 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.606916    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdxbk\" (UniqueName: \"kubernetes.io/projected/69b481ec-02a5-4a23-b02e-0362e02208f6-kube-api-access-vdxbk\") pod \"tuned-9dx8r\" (UID: \"69b481ec-02a5-4a23-b02e-0362e02208f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.611339 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.610213    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66t54\" (UniqueName: \"kubernetes.io/projected/490659e2-9daa-46c5-90a3-7247a4d6efc6-kube-api-access-66t54\") pod \"iptables-alerter-rwc27\" (UID: \"490659e2-9daa-46c5-90a3-7247a4d6efc6\") " pod="openshift-network-operator/iptables-alerter-rwc27"
Jul 15 19:14:38.611339 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.611204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4z7x\" (UniqueName: \"kubernetes.io/projected/403b76f2-1f50-4cbe-8e15-2f801a1a00bf-kube-api-access-p4z7x\") pod \"node-resolver-xkhrx\" (UID: \"403b76f2-1f50-4cbe-8e15-2f801a1a00bf\") " pod="openshift-dns/node-resolver-xkhrx"
Jul 15 19:14:38.616079 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.615860    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79sqr\" (UniqueName: \"kubernetes.io/projected/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-kube-api-access-79sqr\") pod \"network-metrics-daemon-rxq78\" (UID: \"4808e44a-0e6a-47eb-babd-4c7254c7a5f6\") " pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:38.619975 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.619921    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5prdf\" (UniqueName: \"kubernetes.io/projected/4440f86e-5176-4bc6-a35d-7b2b2c991a50-kube-api-access-5prdf\") pod \"aws-ebs-csi-driver-node-zrqxc\" (UID: \"4440f86e-5176-4bc6-a35d-7b2b2c991a50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.622097 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.622054    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfcx7\" (UniqueName: \"kubernetes.io/projected/b211001d-7fa8-4435-8e93-82de48bfc7c3-kube-api-access-pfcx7\") pod \"multus-cfk6s\" (UID: \"b211001d-7fa8-4435-8e93-82de48bfc7c3\") " pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.624244 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.624201    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddg2d\" (UniqueName: \"kubernetes.io/projected/f1515c25-1fb1-42ea-87ce-26b955623a40-kube-api-access-ddg2d\") pod \"node-ca-85vb9\" (UID: \"f1515c25-1fb1-42ea-87ce-26b955623a40\") " pod="openshift-image-registry/node-ca-85vb9"
Jul 15 19:14:38.689122 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.689019    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-30.ec2.internal" event={"ID":"9ed8bf5af08da7fafa3062ddefc6174a","Type":"ContainerStarted","Data":"8701c59f6e243af905731a34f8bb2c5cdee8c28e7aa4ff12604e704daeab37e1"}
Jul 15 19:14:38.691911 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.691758    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal" event={"ID":"bd2a6115e39d1cdf12008ebc7db2584c","Type":"ContainerStarted","Data":"5af42c465c7cdae5cdd63ef38b8c1c02986b0cef80211ae85f08e94ade8811c3"}
Jul 15 19:14:38.759555 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.759525    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9dx8r"
Jul 15 19:14:38.768734 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.768711    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xkhrx"
Jul 15 19:14:38.778800 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.778771    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-85vb9"
Jul 15 19:14:38.787079 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.786913    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rwc27"
Jul 15 19:14:38.795253 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.795211    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:14:38.807547 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.807490    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cfk6s"
Jul 15 19:14:38.815568 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.815524    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qj5fv"
Jul 15 19:14:38.827512 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.827330    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc"
Jul 15 19:14:38.835179 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:38.835158    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mqblk"
Jul 15 19:14:39.096702 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:39.096633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs\") pod \"network-metrics-daemon-rxq78\" (UID: \"4808e44a-0e6a-47eb-babd-4c7254c7a5f6\") " pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:39.096702 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:39.096678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret\") pod \"global-pull-secret-syncer-kqpm4\" (UID: \"c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0\") " pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:39.096869 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:39.096791    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:14:39.096869 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:39.096851    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs podName:4808e44a-0e6a-47eb-babd-4c7254c7a5f6 nodeName:}" failed. No retries permitted until 2026-07-15 19:14:40.096836208 +0000 UTC m=+4.034874661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs") pod "network-metrics-daemon-rxq78" (UID: "4808e44a-0e6a-47eb-babd-4c7254c7a5f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:14:39.096957 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:39.096791    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:14:39.096957 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:39.096936    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret podName:c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0 nodeName:}" failed. No retries permitted until 2026-07-15 19:14:40.096923645 +0000 UTC m=+4.034962097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret") pod "global-pull-secret-syncer-kqpm4" (UID: "c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:14:39.197167 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:39.197129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6vd6\" (UniqueName: \"kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6\") pod \"network-check-target-n844l\" (UID: \"433b5ca5-5a13-436f-8794-aed9e142b74d\") " pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:14:39.197364 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:39.197304    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:14:39.197364 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:39.197331    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:14:39.197364 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:39.197344    2565 projected.go:196] Error preparing data for projected volume kube-api-access-f6vd6 for pod openshift-network-diagnostics/network-check-target-n844l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:14:39.197522 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:39.197410    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6 podName:433b5ca5-5a13-436f-8794-aed9e142b74d nodeName:}" failed. No retries permitted until 2026-07-15 19:14:40.197390516 +0000 UTC m=+4.135428991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6vd6" (UniqueName: "kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6") pod "network-check-target-n844l" (UID: "433b5ca5-5a13-436f-8794-aed9e142b74d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:14:39.509410 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:39.509332    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 19:09:39 +0000 UTC" deadline="2028-04-21 19:40:35.61661864 +0000 UTC"
Jul 15 19:14:39.509410 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:39.509362    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15504h25m56.107260233s"
Jul 15 19:14:39.682456 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:39.682418    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:39.682627 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:39.682589    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:14:39.801037 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:39.801002    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29fa5340_5611_41f9_94e9_d42cfc8bab06.slice/crio-b6c05c40e4e63b643b70a737112c0b1a6c7a8fc6208cef51529ea0b707b84acf WatchSource:0}: Error finding container b6c05c40e4e63b643b70a737112c0b1a6c7a8fc6208cef51529ea0b707b84acf: Status 404 returned error can't find the container with id b6c05c40e4e63b643b70a737112c0b1a6c7a8fc6208cef51529ea0b707b84acf
Jul 15 19:14:39.802156 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:39.802129    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod403b76f2_1f50_4cbe_8e15_2f801a1a00bf.slice/crio-326e069a0655f27c3da76a6919000e3c201152495d7c0a0bd40cfbc1af813c9e WatchSource:0}: Error finding container 326e069a0655f27c3da76a6919000e3c201152495d7c0a0bd40cfbc1af813c9e: Status 404 returned error can't find the container with id 326e069a0655f27c3da76a6919000e3c201152495d7c0a0bd40cfbc1af813c9e
Jul 15 19:14:39.803843 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:14:39.803596    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c4ac0eb_5179_4f51_b8dd_8204f934a1d3.slice/crio-cde9d331ee18a3323588da4b8c4dacf50725ef29e1129f6defdf9358be1126fa WatchSource:0}: Error finding container cde9d331ee18a3323588da4b8c4dacf50725ef29e1129f6defdf9358be1126fa: Status 404 returned error can't find the container with id cde9d331ee18a3323588da4b8c4dacf50725ef29e1129f6defdf9358be1126fa
Jul 15 19:14:40.105848 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.105678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs\") pod \"network-metrics-daemon-rxq78\" (UID: \"4808e44a-0e6a-47eb-babd-4c7254c7a5f6\") " pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:40.105955 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.105875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret\") pod \"global-pull-secret-syncer-kqpm4\" (UID: \"c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0\") " pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:40.105955 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:40.105834    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:14:40.106031 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:40.105972    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:14:40.106031 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:40.105974    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs podName:4808e44a-0e6a-47eb-babd-4c7254c7a5f6 nodeName:}" failed. No retries permitted until 2026-07-15 19:14:42.105957481 +0000 UTC m=+6.043995933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs") pod "network-metrics-daemon-rxq78" (UID: "4808e44a-0e6a-47eb-babd-4c7254c7a5f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:14:40.106031 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:40.106031    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret podName:c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0 nodeName:}" failed. No retries permitted until 2026-07-15 19:14:42.106015071 +0000 UTC m=+6.044053525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret") pod "global-pull-secret-syncer-kqpm4" (UID: "c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:14:40.207474 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.207442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6vd6\" (UniqueName: \"kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6\") pod \"network-check-target-n844l\" (UID: \"433b5ca5-5a13-436f-8794-aed9e142b74d\") " pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:14:40.207616 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:40.207578    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:14:40.207616 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:40.207595    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:14:40.207616 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:40.207604    2565 projected.go:196] Error preparing data for projected volume kube-api-access-f6vd6 for pod openshift-network-diagnostics/network-check-target-n844l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:14:40.207733 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:40.207651    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6 podName:433b5ca5-5a13-436f-8794-aed9e142b74d nodeName:}" failed. No retries permitted until 2026-07-15 19:14:42.207636622 +0000 UTC m=+6.145675070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6vd6" (UniqueName: "kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6") pod "network-check-target-n844l" (UID: "433b5ca5-5a13-436f-8794-aed9e142b74d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:14:40.509898 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.509734    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 19:09:39 +0000 UTC" deadline="2027-12-10 22:28:48.350308369 +0000 UTC"
Jul 15 19:14:40.509898 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.509805    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12315h14m7.840507404s"
Jul 15 19:14:40.683468 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.683438    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:40.683631 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:40.683592    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:14:40.683695 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.683638    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:14:40.683787 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:40.683761    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:14:40.712775 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.712739    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-30.ec2.internal" event={"ID":"9ed8bf5af08da7fafa3062ddefc6174a","Type":"ContainerStarted","Data":"67c63b75e9492e12cbf09ee104eea911bb2761e3b4aec5f33a13cf11a60666ad"}
Jul 15 19:14:40.726300 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.726179    2565 generic.go:356] "Generic (PLEG): container finished" podID="bd2a6115e39d1cdf12008ebc7db2584c" containerID="4a643ddf66a986d5c46253f593ec67a8be683cac2952e6fff61192b40a90e341" exitCode=0
Jul 15 19:14:40.726472 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.726383    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal" event={"ID":"bd2a6115e39d1cdf12008ebc7db2584c","Type":"ContainerDied","Data":"4a643ddf66a986d5c46253f593ec67a8be683cac2952e6fff61192b40a90e341"}
Jul 15 19:14:40.740224 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.739491    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc" event={"ID":"4440f86e-5176-4bc6-a35d-7b2b2c991a50","Type":"ContainerStarted","Data":"189875f0f8363ddc94fdfc46087f9f528e295d9ffc7cd9f58f3cb094c31ee852"}
Jul 15 19:14:40.742956 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.742890    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cfk6s" event={"ID":"b211001d-7fa8-4435-8e93-82de48bfc7c3","Type":"ContainerStarted","Data":"ddca2a60c67f76582d0fbf562565f9b5d9fcc7f94776d0598bfb5e6b2b5d0872"}
Jul 15 19:14:40.748615 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.748588    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-85vb9" event={"ID":"f1515c25-1fb1-42ea-87ce-26b955623a40","Type":"ContainerStarted","Data":"9de7ef5998626c4ef9e02a83a6f4230decb153aada8d2b73f743fe77777c8562"}
Jul 15 19:14:40.754708 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.754639    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-30.ec2.internal" podStartSLOduration=2.754621299 podStartE2EDuration="2.754621299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:40.733381873 +0000 UTC m=+4.671420337" watchObservedRunningTime="2026-07-15 19:14:40.754621299 +0000 UTC m=+4.692659771"
Jul 15 19:14:40.766681 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.766607    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qj5fv" event={"ID":"a7ad72a4-2fca-4e84-987b-8cd04ea99c2b","Type":"ContainerStarted","Data":"b2e001b53566a505a7704136639daabb767b7473c62d6939dff9b64aaf274dad"}
Jul 15 19:14:40.777257 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.777235    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xkhrx" event={"ID":"403b76f2-1f50-4cbe-8e15-2f801a1a00bf","Type":"ContainerStarted","Data":"326e069a0655f27c3da76a6919000e3c201152495d7c0a0bd40cfbc1af813c9e"}
Jul 15 19:14:40.789678 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.789653    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rwc27" event={"ID":"490659e2-9daa-46c5-90a3-7247a4d6efc6","Type":"ContainerStarted","Data":"ff250bb2023f3e099a2ac7849f74a3f0eb10ab28fa0f9f6230d18892a8474008"}
Jul 15 19:14:40.803607 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.803559    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx" event={"ID":"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3","Type":"ContainerStarted","Data":"cde9d331ee18a3323588da4b8c4dacf50725ef29e1129f6defdf9358be1126fa"}
Jul 15 19:14:40.811087 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.810917    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqblk" event={"ID":"29fa5340-5611-41f9-94e9-d42cfc8bab06","Type":"ContainerStarted","Data":"b6c05c40e4e63b643b70a737112c0b1a6c7a8fc6208cef51529ea0b707b84acf"}
Jul 15 19:14:40.828075 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:40.827995    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9dx8r" event={"ID":"69b481ec-02a5-4a23-b02e-0362e02208f6","Type":"ContainerStarted","Data":"965fe950324c454250a111d357a3365eaba46122c9c79b79112e33dd592321fe"}
Jul 15 19:14:41.689299 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:41.683368    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:41.689299 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:41.683523    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:14:41.849898 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:41.849858    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal" event={"ID":"bd2a6115e39d1cdf12008ebc7db2584c","Type":"ContainerStarted","Data":"c6317a07492bc4e4afd899a95c73d33ea3803e62f9336ba9ca77837874a64ccd"}
Jul 15 19:14:41.867678 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:41.867619    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-30.ec2.internal" podStartSLOduration=3.867598383 podStartE2EDuration="3.867598383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:41.867106807 +0000 UTC m=+5.805145283" watchObservedRunningTime="2026-07-15 19:14:41.867598383 +0000 UTC m=+5.805636859"
Jul 15 19:14:42.125651 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:42.125118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs\") pod \"network-metrics-daemon-rxq78\" (UID: \"4808e44a-0e6a-47eb-babd-4c7254c7a5f6\") " pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:42.125651 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:42.125195    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret\") pod \"global-pull-secret-syncer-kqpm4\" (UID: \"c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0\") " pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:42.125651 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:42.125376    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:14:42.125651 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:42.125460    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret podName:c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0 nodeName:}" failed. No retries permitted until 2026-07-15 19:14:46.12543368 +0000 UTC m=+10.063474425 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret") pod "global-pull-secret-syncer-kqpm4" (UID: "c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:14:42.125651 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:42.125488    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:14:42.125651 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:42.125559    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs podName:4808e44a-0e6a-47eb-babd-4c7254c7a5f6 nodeName:}" failed. No retries permitted until 2026-07-15 19:14:46.125540464 +0000 UTC m=+10.063578929 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs") pod "network-metrics-daemon-rxq78" (UID: "4808e44a-0e6a-47eb-babd-4c7254c7a5f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:14:42.226622 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:42.225993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6vd6\" (UniqueName: \"kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6\") pod \"network-check-target-n844l\" (UID: \"433b5ca5-5a13-436f-8794-aed9e142b74d\") " pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:14:42.226622 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:42.226178    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:14:42.226622 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:42.226196    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:14:42.226622 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:42.226209    2565 projected.go:196] Error preparing data for projected volume kube-api-access-f6vd6 for pod openshift-network-diagnostics/network-check-target-n844l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:14:42.226622 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:42.226282    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6 podName:433b5ca5-5a13-436f-8794-aed9e142b74d nodeName:}" failed. No retries permitted until 2026-07-15 19:14:46.226264141 +0000 UTC m=+10.164302595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6vd6" (UniqueName: "kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6") pod "network-check-target-n844l" (UID: "433b5ca5-5a13-436f-8794-aed9e142b74d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:14:42.682781 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:42.682744    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:42.682974 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:42.682898    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:14:42.683371 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:42.683344    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:14:42.683503 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:42.683480    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:14:43.683171 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:43.682649    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:43.683171 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:43.682788    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:14:44.682813 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:44.682714    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:44.682984 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:44.682721    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:14:44.682984 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:44.682880    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:14:44.682984 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:44.682915    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:14:45.682572 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:45.682531    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:45.683081 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:45.682694    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:14:46.159928 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:46.159819    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret\") pod \"global-pull-secret-syncer-kqpm4\" (UID: \"c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0\") " pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:46.159928 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:46.159920    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs\") pod \"network-metrics-daemon-rxq78\" (UID: \"4808e44a-0e6a-47eb-babd-4c7254c7a5f6\") " pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:46.160181 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:46.159978    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:14:46.160181 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:46.160011    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:14:46.160181 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:46.160051    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret podName:c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0 nodeName:}" failed. No retries permitted until 2026-07-15 19:14:54.160030238 +0000 UTC m=+18.098068707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret") pod "global-pull-secret-syncer-kqpm4" (UID: "c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:14:46.160181 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:46.160075    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs podName:4808e44a-0e6a-47eb-babd-4c7254c7a5f6 nodeName:}" failed. No retries permitted until 2026-07-15 19:14:54.160062843 +0000 UTC m=+18.098101306 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs") pod "network-metrics-daemon-rxq78" (UID: "4808e44a-0e6a-47eb-babd-4c7254c7a5f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:14:46.261162 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:46.261102    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6vd6\" (UniqueName: \"kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6\") pod \"network-check-target-n844l\" (UID: \"433b5ca5-5a13-436f-8794-aed9e142b74d\") " pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:14:46.261357 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:46.261326    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:14:46.261406 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:46.261357    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:14:46.261406 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:46.261373    2565 projected.go:196] Error preparing data for projected volume kube-api-access-f6vd6 for pod openshift-network-diagnostics/network-check-target-n844l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:14:46.261474 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:46.261438    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6 podName:433b5ca5-5a13-436f-8794-aed9e142b74d nodeName:}" failed. No retries permitted until 2026-07-15 19:14:54.261414524 +0000 UTC m=+18.199452992 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6vd6" (UniqueName: "kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6") pod "network-check-target-n844l" (UID: "433b5ca5-5a13-436f-8794-aed9e142b74d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:14:46.686942 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:46.686284    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:46.686942 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:46.686384    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:14:46.686942 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:46.686794    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:14:46.686942 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:46.686890    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:14:47.683338 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:47.683302    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:47.683665 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:47.683457    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:14:48.683263 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:48.682760    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:48.683263 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:48.682894    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:14:48.683911 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:48.683409    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:14:48.683911 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:48.683510    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:14:49.683343 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:49.683265    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:49.683913 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:49.683424    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:14:50.683338 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:50.683304    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:50.683504 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:50.683440    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:14:50.683504 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:50.683479    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:14:50.683853 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:50.683551    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:14:51.683265 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:51.683230    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:51.683449 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:51.683355    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:14:52.682876 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:52.682808    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:52.683330 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:52.682947    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:14:52.683330 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:52.683009    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:14:52.683330 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:52.683109    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:14:53.683173 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:53.683144    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:53.683635 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:53.683287    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:14:54.225362 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:54.225325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret\") pod \"global-pull-secret-syncer-kqpm4\" (UID: \"c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0\") " pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:54.225534 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:54.225414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs\") pod \"network-metrics-daemon-rxq78\" (UID: \"4808e44a-0e6a-47eb-babd-4c7254c7a5f6\") " pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:54.225534 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:54.225491    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:14:54.225534 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:54.225511    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:14:54.225630 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:54.225561    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret podName:c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:10.225542067 +0000 UTC m=+34.163580521 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret") pod "global-pull-secret-syncer-kqpm4" (UID: "c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:14:54.225630 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:54.225579    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs podName:4808e44a-0e6a-47eb-babd-4c7254c7a5f6 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:10.225572025 +0000 UTC m=+34.163610477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs") pod "network-metrics-daemon-rxq78" (UID: "4808e44a-0e6a-47eb-babd-4c7254c7a5f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:14:54.326457 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:54.326423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6vd6\" (UniqueName: \"kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6\") pod \"network-check-target-n844l\" (UID: \"433b5ca5-5a13-436f-8794-aed9e142b74d\") " pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:14:54.326630 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:54.326592    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:14:54.326630 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:54.326615    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:14:54.326630 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:54.326626    2565 projected.go:196] Error preparing data for projected volume kube-api-access-f6vd6 for pod openshift-network-diagnostics/network-check-target-n844l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:14:54.326777 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:54.326683    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6 podName:433b5ca5-5a13-436f-8794-aed9e142b74d nodeName:}" failed. No retries permitted until 2026-07-15 19:15:10.32666518 +0000 UTC m=+34.264703649 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6vd6" (UniqueName: "kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6") pod "network-check-target-n844l" (UID: "433b5ca5-5a13-436f-8794-aed9e142b74d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:14:54.682630 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:54.682504    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:54.682767 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:54.682637    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:14:54.682767 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:54.682695    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:14:54.682865 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:54.682798    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:14:55.682747 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:55.682709    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:55.683144 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:55.682843    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:14:56.683569 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:56.683534    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:14:56.683980 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:56.683657    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:14:56.683980 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:56.683685    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:56.683980 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:56.683795    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:14:57.682582 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:57.682546    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:57.682765 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:57.682682    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:14:58.682872 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:58.682835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:14:58.683371 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:58.682965    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:14:58.683371 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:58.683017    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:14:58.683371 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:58.683104    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:14:59.683333 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:59.683102    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:14:59.683738 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:14:59.683445    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:14:59.887919 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:59.887889    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-85vb9" event={"ID":"f1515c25-1fb1-42ea-87ce-26b955623a40","Type":"ContainerStarted","Data":"ae5c4448af12e6e2311db66cc3a7fa67d45692cf9f69339996a6b8676b97caf7"}
Jul 15 19:14:59.889185 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:59.889164    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qj5fv" event={"ID":"a7ad72a4-2fca-4e84-987b-8cd04ea99c2b","Type":"ContainerStarted","Data":"8861ea069ea61ba58efe2169261a28508122d8ddaa881db513518d7498d8db19"}
Jul 15 19:14:59.890424 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:59.890407    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xkhrx" event={"ID":"403b76f2-1f50-4cbe-8e15-2f801a1a00bf","Type":"ContainerStarted","Data":"fe8e3a43259598656d1481f95f74988d263bf95c6c5fe95be7f22c47d94c8d9c"}
Jul 15 19:14:59.891987 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:59.891955    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx" event={"ID":"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3","Type":"ContainerStarted","Data":"a02c8320e28223b293e82e81d0c27bbf3263b063ed19cde51eaba5fddfc028ea"}
Jul 15 19:14:59.892090 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:59.892013    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx" event={"ID":"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3","Type":"ContainerStarted","Data":"e1891ae0def578a45ae9cf3850ba8191094cbfb596b29ccd1c68f19362cd82ee"}
Jul 15 19:14:59.893303 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:59.893284    2565 generic.go:356] "Generic (PLEG): container finished" podID="29fa5340-5611-41f9-94e9-d42cfc8bab06" containerID="14d60a0ad5464df4a3b5e6a0c2a0681bb7c18c1aa200cb8bf65c5799ce3b5f54" exitCode=0
Jul 15 19:14:59.893381 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:59.893343    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqblk" event={"ID":"29fa5340-5611-41f9-94e9-d42cfc8bab06","Type":"ContainerDied","Data":"14d60a0ad5464df4a3b5e6a0c2a0681bb7c18c1aa200cb8bf65c5799ce3b5f54"}
Jul 15 19:14:59.894917 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:59.894771    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9dx8r" event={"ID":"69b481ec-02a5-4a23-b02e-0362e02208f6","Type":"ContainerStarted","Data":"2a8ace759395352be07d93241b13157e39f2fa2d206ae0be4d9c3f82d2a66408"}
Jul 15 19:14:59.896390 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:59.896357    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc" event={"ID":"4440f86e-5176-4bc6-a35d-7b2b2c991a50","Type":"ContainerStarted","Data":"ea95cf60adfa81eac7a6c6c7042101bf5bb61181d3a0b40ba243365fed89ebc3"}
Jul 15 19:14:59.897732 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:59.897711    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cfk6s" event={"ID":"b211001d-7fa8-4435-8e93-82de48bfc7c3","Type":"ContainerStarted","Data":"ed1c0cb2051f8119ee379be6ea44466f4dec9655eb9af80818505c58b40668f4"}
Jul 15 19:14:59.904620 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:59.904586    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-85vb9" podStartSLOduration=3.307660965 podStartE2EDuration="22.904574891s" totalImagesPullingTime="19.596913926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:59.904279039 +0000 UTC m=+23.842317509" watchObservedRunningTime="2026-07-15 19:14:59.904574891 +0000 UTC m=+23.842613359"
Jul 15 19:14:59.921145 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:59.921112    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xkhrx" podStartSLOduration=3.3162300399999998 podStartE2EDuration="22.921098738s" totalImagesPullingTime="19.604868698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:59.920731921 +0000 UTC m=+23.858770390" watchObservedRunningTime="2026-07-15 19:14:59.921098738 +0000 UTC m=+23.859137204"
Jul 15 19:14:59.938660 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:59.936829    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qj5fv" podStartSLOduration=3.335847915 podStartE2EDuration="22.936814067s" totalImagesPullingTime="19.600966152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:59.936419999 +0000 UTC m=+23.874458471" watchObservedRunningTime="2026-07-15 19:14:59.936814067 +0000 UTC m=+23.874852536"
Jul 15 19:14:59.956661 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:14:59.956628    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9dx8r" podStartSLOduration=3.337422446 podStartE2EDuration="22.956616344s" totalImagesPullingTime="19.619193898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:59.956454852 +0000 UTC m=+23.894493323" watchObservedRunningTime="2026-07-15 19:14:59.956616344 +0000 UTC m=+23.894654813"
Jul 15 19:15:00.023646 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:00.023606    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cfk6s" podStartSLOduration=3.415721694 podStartE2EDuration="23.02358919s" totalImagesPullingTime="19.607867496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:14:59.983816366 +0000 UTC m=+23.921854834" watchObservedRunningTime="2026-07-15 19:15:00.02358919 +0000 UTC m=+23.961627670"
Jul 15 19:15:00.683329 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:00.682976    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:00.684060 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:00.683330    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:15:00.684060 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:00.683017    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:00.684060 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:00.683450    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:15:00.902023 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:00.901930    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rwc27" event={"ID":"490659e2-9daa-46c5-90a3-7247a4d6efc6","Type":"ContainerStarted","Data":"1ab4f2e32cae5e4a9c74790bcab476809109a098ca4c357ec445cca085a09654"}
Jul 15 19:15:00.905179 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:00.905150    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:15:00.905539 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:00.905517    2565 generic.go:356] "Generic (PLEG): container finished" podID="9c4ac0eb-5179-4f51-b8dd-8204f934a1d3" containerID="a02c8320e28223b293e82e81d0c27bbf3263b063ed19cde51eaba5fddfc028ea" exitCode=1
Jul 15 19:15:00.905652 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:00.905601    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx" event={"ID":"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3","Type":"ContainerDied","Data":"a02c8320e28223b293e82e81d0c27bbf3263b063ed19cde51eaba5fddfc028ea"}
Jul 15 19:15:00.905755 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:00.905690    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx" event={"ID":"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3","Type":"ContainerStarted","Data":"f9a6d026248061758891de59dc8c4cef7bf438c8709fc0af8fc4d0c1726a4f8b"}
Jul 15 19:15:00.905755 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:00.905742    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx" event={"ID":"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3","Type":"ContainerStarted","Data":"501786d6c807e222f3b8af6bb45aeed6fe27257ba6b0cfc3d5f329a8aeb1f824"}
Jul 15 19:15:00.906114 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:00.905790    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx" event={"ID":"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3","Type":"ContainerStarted","Data":"2f7308b5892e97ad24e64fc695e67a173feca4c2ed61416ab9b2659c09ae93bb"}
Jul 15 19:15:00.906114 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:00.905835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx" event={"ID":"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3","Type":"ContainerStarted","Data":"2c27990503c9658c6d551e76882c8f592d29d7aa2568b88fdd365f007d6a8655"}
Jul 15 19:15:00.923028 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:00.922974    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rwc27" podStartSLOduration=4.323664756 podStartE2EDuration="23.922956367s" totalImagesPullingTime="19.599291611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:00.922530893 +0000 UTC m=+24.860569364" watchObservedRunningTime="2026-07-15 19:15:00.922956367 +0000 UTC m=+24.860994838"
Jul 15 19:15:01.232685 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:01.232657    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 19:15:01.553625 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:01.553481    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T19:15:01.232680923Z","UUID":"d47e0692-3968-429c-920b-9437e8ac499c","Handler":null,"Name":"","Endpoint":""}
Jul 15 19:15:01.556457 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:01.556428    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 19:15:01.556588 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:01.556479    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 19:15:01.683913 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:01.683887    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:01.684378 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:01.683996    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:15:01.911099 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:01.911014    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc" event={"ID":"4440f86e-5176-4bc6-a35d-7b2b2c991a50","Type":"ContainerStarted","Data":"7f6ec936e5a04a152dd576ccc305ffff0911e2b602ad21ab6ac61259151d3269"}
Jul 15 19:15:02.682830 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:02.682693    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:02.682830 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:02.682728    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:02.683039 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:02.682824    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:15:02.683039 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:02.682977    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:15:02.916464 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:02.916435    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:15:02.916906 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:02.916835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx" event={"ID":"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3","Type":"ContainerStarted","Data":"c185fed4eba3e1965f410ef821288e45061d3bd430cd561c9e89a64b9d67f633"}
Jul 15 19:15:03.683343 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:03.683164    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:03.683540 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:03.683441    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:15:03.990326 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:03.990248    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qj5fv"
Jul 15 19:15:03.990969 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:03.990945    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qj5fv"
Jul 15 19:15:04.683623 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:04.683420    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:04.683748 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:04.683479    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:04.683807 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:04.683740    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:15:04.683850 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:04.683801    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:15:04.924525 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:04.924419    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:15:04.924804 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:04.924782    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx" event={"ID":"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3","Type":"ContainerStarted","Data":"afb4712dda8b25494f4d4a694d647758b5cd60b559ac54dcc5b483bce7ed20b3"}
Jul 15 19:15:04.925038 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:04.925019    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:15:04.925306 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:04.925284    2565 scope.go:117] "RemoveContainer" containerID="a02c8320e28223b293e82e81d0c27bbf3263b063ed19cde51eaba5fddfc028ea"
Jul 15 19:15:04.926670 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:04.926650    2565 generic.go:356] "Generic (PLEG): container finished" podID="29fa5340-5611-41f9-94e9-d42cfc8bab06" containerID="350506f618e5ea72ff97217443f6d05ae9ebdecf9e37e72241ea4004b39119df" exitCode=0
Jul 15 19:15:04.926788 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:04.926737    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqblk" event={"ID":"29fa5340-5611-41f9-94e9-d42cfc8bab06","Type":"ContainerDied","Data":"350506f618e5ea72ff97217443f6d05ae9ebdecf9e37e72241ea4004b39119df"}
Jul 15 19:15:04.929110 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:04.929090    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc" event={"ID":"4440f86e-5176-4bc6-a35d-7b2b2c991a50","Type":"ContainerStarted","Data":"4ccf07e103dbf34533eb1fdc03b12352d3acb649804ea0f9a9bcf963d9d5315e"}
Jul 15 19:15:04.941081 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:04.941058    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:15:05.001617 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:05.001574    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrqxc" podStartSLOduration=4.22807654 podStartE2EDuration="28.001560865s" totalImagesPullingTime="23.773484325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:05.001183561 +0000 UTC m=+28.939222030" watchObservedRunningTime="2026-07-15 19:15:05.001560865 +0000 UTC m=+28.939599334"
Jul 15 19:15:05.682863 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:05.682835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:05.683030 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:05.682934    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:15:05.937748 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:05.937678    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:15:05.938017 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:05.937997    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx" event={"ID":"9c4ac0eb-5179-4f51-b8dd-8204f934a1d3","Type":"ContainerStarted","Data":"b9f64b49f9d75cef8a70b4e9159ea711076b046d3faecb4d4ae7973a5ccc36de"}
Jul 15 19:15:05.938073 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:05.938039    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 15 19:15:05.938305 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:05.938286    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:15:05.953127 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:05.953106    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:15:05.966002 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:05.965965    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx" podStartSLOduration=9.15578579 podStartE2EDuration="28.965951443s" totalImagesPullingTime="19.810165653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:05.965154186 +0000 UTC m=+29.903192654" watchObservedRunningTime="2026-07-15 19:15:05.965951443 +0000 UTC m=+29.903989890"
Jul 15 19:15:06.590061 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:06.589859    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kqpm4"]
Jul 15 19:15:06.590398 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:06.590165    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:06.590398 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:06.590292    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:15:06.593308 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:06.593285    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n844l"]
Jul 15 19:15:06.593756 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:06.593739    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:06.593872 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:06.593839    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:15:06.593872 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:06.593854    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rxq78"]
Jul 15 19:15:06.593977 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:06.593927    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:06.594028 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:06.594008    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:15:06.942606 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:06.942531    2565 generic.go:356] "Generic (PLEG): container finished" podID="29fa5340-5611-41f9-94e9-d42cfc8bab06" containerID="6087b685b426cce5ecd5d0130912ee66c14f6fc32f5791436857e4fc00a81049" exitCode=0
Jul 15 19:15:06.942799 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:06.942613    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqblk" event={"ID":"29fa5340-5611-41f9-94e9-d42cfc8bab06","Type":"ContainerDied","Data":"6087b685b426cce5ecd5d0130912ee66c14f6fc32f5791436857e4fc00a81049"}
Jul 15 19:15:06.942799 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:06.942687    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 15 19:15:07.944758 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:07.944730    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 15 19:15:08.224264 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:08.224193    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:15:08.643821 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:08.643794    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qj5fv"
Jul 15 19:15:08.643965 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:08.643912    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 15 19:15:08.644356 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:08.644335    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qj5fv"
Jul 15 19:15:08.682810 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:08.682778    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:08.682810 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:08.682794    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:08.683030 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:08.682875    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:08.683030 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:08.682887    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:15:08.683030 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:08.682956    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:15:08.683186 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:08.683030    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:15:08.950304 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:08.950230    2565 generic.go:356] "Generic (PLEG): container finished" podID="29fa5340-5611-41f9-94e9-d42cfc8bab06" containerID="6de4534cf0bb37e3cb517e40ad0b73247cee31f9e3daa926650d1923d2545629" exitCode=0
Jul 15 19:15:08.950887 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:08.950314    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqblk" event={"ID":"29fa5340-5611-41f9-94e9-d42cfc8bab06","Type":"ContainerDied","Data":"6de4534cf0bb37e3cb517e40ad0b73247cee31f9e3daa926650d1923d2545629"}
Jul 15 19:15:09.470372 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:09.470343    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xkhrx_403b76f2-1f50-4cbe-8e15-2f801a1a00bf/dns-node-resolver/0.log"
Jul 15 19:15:10.239252 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:10.239224    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-85vb9_f1515c25-1fb1-42ea-87ce-26b955623a40/node-ca/0.log"
Jul 15 19:15:10.248518 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:10.248489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret\") pod \"global-pull-secret-syncer-kqpm4\" (UID: \"c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0\") " pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:10.248673 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:10.248550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs\") pod \"network-metrics-daemon-rxq78\" (UID: \"4808e44a-0e6a-47eb-babd-4c7254c7a5f6\") " pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:10.248673 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:10.248646    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:15:10.248673 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:10.248651    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:15:10.248826 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:10.248701    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs podName:4808e44a-0e6a-47eb-babd-4c7254c7a5f6 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:42.248682414 +0000 UTC m=+66.186720862 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs") pod "network-metrics-daemon-rxq78" (UID: "4808e44a-0e6a-47eb-babd-4c7254c7a5f6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:15:10.248826 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:10.248719    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret podName:c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:42.248710229 +0000 UTC m=+66.186748676 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret") pod "global-pull-secret-syncer-kqpm4" (UID: "c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:15:10.349445 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:10.349408    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6vd6\" (UniqueName: \"kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6\") pod \"network-check-target-n844l\" (UID: \"433b5ca5-5a13-436f-8794-aed9e142b74d\") " pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:10.349607 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:10.349588    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:15:10.349653 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:10.349617    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:15:10.349653 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:10.349632    2565 projected.go:196] Error preparing data for projected volume kube-api-access-f6vd6 for pod openshift-network-diagnostics/network-check-target-n844l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:15:10.349733 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:10.349698    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6 podName:433b5ca5-5a13-436f-8794-aed9e142b74d nodeName:}" failed. No retries permitted until 2026-07-15 19:15:42.349679316 +0000 UTC m=+66.287717776 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f6vd6" (UniqueName: "kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6") pod "network-check-target-n844l" (UID: "433b5ca5-5a13-436f-8794-aed9e142b74d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:15:10.682536 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:10.682460    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:10.682689 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:10.682466    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:10.682689 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:10.682589    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:15:10.682689 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:10.682611    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:10.682850 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:10.682721    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:15:10.682850 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:10.682806    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:15:12.683421 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:12.683389    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:12.684013 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:12.683432    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:12.684013 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:12.683525    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:15:12.684013 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:12.683557    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:15:12.684013 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:12.683596    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:12.684013 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:12.683685    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:15:13.966480 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:13.966446    2565 generic.go:356] "Generic (PLEG): container finished" podID="29fa5340-5611-41f9-94e9-d42cfc8bab06" containerID="e3f31793f1682cae9f5ca58da01b2b04b6cfa0b437626eab3eca9cdea88f7d6f" exitCode=0
Jul 15 19:15:13.966480 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:13.966484    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqblk" event={"ID":"29fa5340-5611-41f9-94e9-d42cfc8bab06","Type":"ContainerDied","Data":"e3f31793f1682cae9f5ca58da01b2b04b6cfa0b437626eab3eca9cdea88f7d6f"}
Jul 15 19:15:14.682988 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:14.682956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:14.683126 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:14.682956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:14.683126 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:14.683064    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:15:14.683242 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:14.682962    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:14.683242 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:14.683121    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:15:14.683242 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:14.683222    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:15:14.971903 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:14.971820    2565 generic.go:356] "Generic (PLEG): container finished" podID="29fa5340-5611-41f9-94e9-d42cfc8bab06" containerID="9c95962e22212ac22086a1e49bed90cbd6dbb4e6abf36795f9641f0dc7f8e921" exitCode=0
Jul 15 19:15:14.971903 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:14.971872    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqblk" event={"ID":"29fa5340-5611-41f9-94e9-d42cfc8bab06","Type":"ContainerDied","Data":"9c95962e22212ac22086a1e49bed90cbd6dbb4e6abf36795f9641f0dc7f8e921"}
Jul 15 19:15:15.977430 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:15.977257    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqblk" event={"ID":"29fa5340-5611-41f9-94e9-d42cfc8bab06","Type":"ContainerStarted","Data":"57e564b7e478642401b57b8f0656bced554bd9c06726b79a7fb78e8ea004c5b1"}
Jul 15 19:15:16.000022 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:15.999977    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mqblk" podStartSLOduration=7.959664675 podStartE2EDuration="38.999961566s" totalImagesPullingTime="31.040296891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:15.999534063 +0000 UTC m=+39.937572544" watchObservedRunningTime="2026-07-15 19:15:15.999961566 +0000 UTC m=+39.938000034"
Jul 15 19:15:16.683470 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:16.683436    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:16.683672 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:16.683538    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:15:16.683672 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:16.683547    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:16.683672 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:16.683576    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:16.683672 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:16.683624    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:15:16.683818 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:16.683703    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:15:18.682951 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:18.682924    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:18.683351 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:18.682924    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:18.683351 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:18.682927    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:18.683351 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:18.683059    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:15:18.683351 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:18.683148    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:15:18.683351 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:18.683257    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:15:20.683317 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:20.683290    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:20.683317 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:20.683305    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:20.683830 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:20.683417    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:15:20.683830 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:20.683460    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:15:20.683830 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:20.683514    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:20.683830 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:20.683598    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:15:22.682864 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:22.682833    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:22.683387 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:22.682833    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:22.683387 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:22.682953    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:15:22.683387 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:22.682834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:22.683387 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:22.683057    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:15:22.683387 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:22.683113    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:15:24.682806 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:24.682774    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:24.682806 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:24.682805    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:24.683277 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:24.682784    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:24.683277 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:24.682871    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:15:24.683277 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:24.682933    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:15:24.683277 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:24.683026    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:15:26.683475 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:26.683442    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:26.683854 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:26.683537    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:15:26.683854 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:26.683560    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:26.683854 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:26.683583    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:26.683854 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:26.683647    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:15:26.683854 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:26.683724    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:15:28.683161 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:28.683130    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:28.683161 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:28.683144    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:28.683161 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:28.683138    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:28.683739 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:28.683270    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n844l" podUID="433b5ca5-5a13-436f-8794-aed9e142b74d"
Jul 15 19:15:28.683739 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:28.683318    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqpm4" podUID="c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0"
Jul 15 19:15:28.683739 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:28.683382    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxq78" podUID="4808e44a-0e6a-47eb-babd-4c7254c7a5f6"
Jul 15 19:15:29.373406 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.373382    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-30.ec2.internal" event="NodeReady"
Jul 15 19:15:29.373561 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.373486    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 19:15:29.421384 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.421353    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gs9w2"]
Jul 15 19:15:29.438875 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.438850    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6wddf"]
Jul 15 19:15:29.438994 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.438967    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gs9w2"
Jul 15 19:15:29.441815 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.441743    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 19:15:29.441815 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.441774    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gg6xc\""
Jul 15 19:15:29.441815 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.441785    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 19:15:29.442022 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.441789    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 19:15:29.442022 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.441893    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 19:15:29.453087 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.453070    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gs9w2"]
Jul 15 19:15:29.453173 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.453104    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6wddf"]
Jul 15 19:15:29.453251 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.453184    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6wddf"
Jul 15 19:15:29.455562 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.455548    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 19:15:29.455951 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.455912    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 19:15:29.455951 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.455912    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 19:15:29.456110 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.456095    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vvjwq\""
Jul 15 19:15:29.489659 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.489633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67800f37-87dc-468b-9e62-0f5813790484-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gs9w2\" (UID: \"67800f37-87dc-468b-9e62-0f5813790484\") " pod="openshift-insights/insights-runtime-extractor-gs9w2"
Jul 15 19:15:29.489752 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.489662    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cprb\" (UniqueName: \"kubernetes.io/projected/753cbcd0-a844-4e99-aeea-45aadbcbdc87-kube-api-access-6cprb\") pod \"ingress-canary-6wddf\" (UID: \"753cbcd0-a844-4e99-aeea-45aadbcbdc87\") " pod="openshift-ingress-canary/ingress-canary-6wddf"
Jul 15 19:15:29.489752 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.489683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67800f37-87dc-468b-9e62-0f5813790484-data-volume\") pod \"insights-runtime-extractor-gs9w2\" (UID: \"67800f37-87dc-468b-9e62-0f5813790484\") " pod="openshift-insights/insights-runtime-extractor-gs9w2"
Jul 15 19:15:29.489752 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.489703    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67800f37-87dc-468b-9e62-0f5813790484-crio-socket\") pod \"insights-runtime-extractor-gs9w2\" (UID: \"67800f37-87dc-468b-9e62-0f5813790484\") " pod="openshift-insights/insights-runtime-extractor-gs9w2"
Jul 15 19:15:29.489869 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.489780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t2cf\" (UniqueName: \"kubernetes.io/projected/67800f37-87dc-468b-9e62-0f5813790484-kube-api-access-4t2cf\") pod \"insights-runtime-extractor-gs9w2\" (UID: \"67800f37-87dc-468b-9e62-0f5813790484\") " pod="openshift-insights/insights-runtime-extractor-gs9w2"
Jul 15 19:15:29.489869 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.489834    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67800f37-87dc-468b-9e62-0f5813790484-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gs9w2\" (UID: \"67800f37-87dc-468b-9e62-0f5813790484\") " pod="openshift-insights/insights-runtime-extractor-gs9w2"
Jul 15 19:15:29.489869 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.489852    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/753cbcd0-a844-4e99-aeea-45aadbcbdc87-cert\") pod \"ingress-canary-6wddf\" (UID: \"753cbcd0-a844-4e99-aeea-45aadbcbdc87\") " pod="openshift-ingress-canary/ingress-canary-6wddf"
Jul 15 19:15:29.522604 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.522584    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dsxld"]
Jul 15 19:15:29.542883 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.542865    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dsxld"]
Jul 15 19:15:29.542972 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.542953    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dsxld"
Jul 15 19:15:29.545546 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.545523    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 19:15:29.545640 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.545524    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l2njj\""
Jul 15 19:15:29.545640 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.545524    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 19:15:29.590385 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.590365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t2cf\" (UniqueName: \"kubernetes.io/projected/67800f37-87dc-468b-9e62-0f5813790484-kube-api-access-4t2cf\") pod \"insights-runtime-extractor-gs9w2\" (UID: \"67800f37-87dc-468b-9e62-0f5813790484\") " pod="openshift-insights/insights-runtime-extractor-gs9w2"
Jul 15 19:15:29.590459 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.590391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5037a0cb-d1d4-414e-bbca-b8e190db70f3-config-volume\") pod \"dns-default-dsxld\" (UID: \"5037a0cb-d1d4-414e-bbca-b8e190db70f3\") " pod="openshift-dns/dns-default-dsxld"
Jul 15 19:15:29.590532 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.590516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67800f37-87dc-468b-9e62-0f5813790484-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gs9w2\" (UID: \"67800f37-87dc-468b-9e62-0f5813790484\") " pod="openshift-insights/insights-runtime-extractor-gs9w2"
Jul 15 19:15:29.590576 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.590542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/753cbcd0-a844-4e99-aeea-45aadbcbdc87-cert\") pod \"ingress-canary-6wddf\" (UID: \"753cbcd0-a844-4e99-aeea-45aadbcbdc87\") " pod="openshift-ingress-canary/ingress-canary-6wddf"
Jul 15 19:15:29.590576 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.590563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67800f37-87dc-468b-9e62-0f5813790484-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gs9w2\" (UID: \"67800f37-87dc-468b-9e62-0f5813790484\") " pod="openshift-insights/insights-runtime-extractor-gs9w2"
Jul 15 19:15:29.590651 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.590579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cprb\" (UniqueName: \"kubernetes.io/projected/753cbcd0-a844-4e99-aeea-45aadbcbdc87-kube-api-access-6cprb\") pod \"ingress-canary-6wddf\" (UID: \"753cbcd0-a844-4e99-aeea-45aadbcbdc87\") " pod="openshift-ingress-canary/ingress-canary-6wddf"
Jul 15 19:15:29.590651 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.590603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67800f37-87dc-468b-9e62-0f5813790484-data-volume\") pod \"insights-runtime-extractor-gs9w2\" (UID: \"67800f37-87dc-468b-9e62-0f5813790484\") " pod="openshift-insights/insights-runtime-extractor-gs9w2"
Jul 15 19:15:29.590651 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.590631    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdkb2\" (UniqueName: \"kubernetes.io/projected/5037a0cb-d1d4-414e-bbca-b8e190db70f3-kube-api-access-xdkb2\") pod \"dns-default-dsxld\" (UID: \"5037a0cb-d1d4-414e-bbca-b8e190db70f3\") " pod="openshift-dns/dns-default-dsxld"
Jul 15 19:15:29.590778 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.590663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67800f37-87dc-468b-9e62-0f5813790484-crio-socket\") pod \"insights-runtime-extractor-gs9w2\" (UID: \"67800f37-87dc-468b-9e62-0f5813790484\") " pod="openshift-insights/insights-runtime-extractor-gs9w2"
Jul 15 19:15:29.590778 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.590689    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5037a0cb-d1d4-414e-bbca-b8e190db70f3-metrics-tls\") pod \"dns-default-dsxld\" (UID: \"5037a0cb-d1d4-414e-bbca-b8e190db70f3\") " pod="openshift-dns/dns-default-dsxld"
Jul 15 19:15:29.590778 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.590712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5037a0cb-d1d4-414e-bbca-b8e190db70f3-tmp-dir\") pod \"dns-default-dsxld\" (UID: \"5037a0cb-d1d4-414e-bbca-b8e190db70f3\") " pod="openshift-dns/dns-default-dsxld"
Jul 15 19:15:29.590905 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.590873    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/67800f37-87dc-468b-9e62-0f5813790484-crio-socket\") pod \"insights-runtime-extractor-gs9w2\" (UID: \"67800f37-87dc-468b-9e62-0f5813790484\") " pod="openshift-insights/insights-runtime-extractor-gs9w2"
Jul 15 19:15:29.590991 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.590976    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/67800f37-87dc-468b-9e62-0f5813790484-data-volume\") pod \"insights-runtime-extractor-gs9w2\" (UID: \"67800f37-87dc-468b-9e62-0f5813790484\") " pod="openshift-insights/insights-runtime-extractor-gs9w2"
Jul 15 19:15:29.591146 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.591132    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/67800f37-87dc-468b-9e62-0f5813790484-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gs9w2\" (UID: \"67800f37-87dc-468b-9e62-0f5813790484\") " pod="openshift-insights/insights-runtime-extractor-gs9w2"
Jul 15 19:15:29.594529 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.594471    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/67800f37-87dc-468b-9e62-0f5813790484-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gs9w2\" (UID: \"67800f37-87dc-468b-9e62-0f5813790484\") " pod="openshift-insights/insights-runtime-extractor-gs9w2"
Jul 15 19:15:29.594604 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.594585    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/753cbcd0-a844-4e99-aeea-45aadbcbdc87-cert\") pod \"ingress-canary-6wddf\" (UID: \"753cbcd0-a844-4e99-aeea-45aadbcbdc87\") " pod="openshift-ingress-canary/ingress-canary-6wddf"
Jul 15 19:15:29.599378 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.599355    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cprb\" (UniqueName: \"kubernetes.io/projected/753cbcd0-a844-4e99-aeea-45aadbcbdc87-kube-api-access-6cprb\") pod \"ingress-canary-6wddf\" (UID: \"753cbcd0-a844-4e99-aeea-45aadbcbdc87\") " pod="openshift-ingress-canary/ingress-canary-6wddf"
Jul 15 19:15:29.599487 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.599404    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t2cf\" (UniqueName: \"kubernetes.io/projected/67800f37-87dc-468b-9e62-0f5813790484-kube-api-access-4t2cf\") pod \"insights-runtime-extractor-gs9w2\" (UID: \"67800f37-87dc-468b-9e62-0f5813790484\") " pod="openshift-insights/insights-runtime-extractor-gs9w2"
Jul 15 19:15:29.691179 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.691120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdkb2\" (UniqueName: \"kubernetes.io/projected/5037a0cb-d1d4-414e-bbca-b8e190db70f3-kube-api-access-xdkb2\") pod \"dns-default-dsxld\" (UID: \"5037a0cb-d1d4-414e-bbca-b8e190db70f3\") " pod="openshift-dns/dns-default-dsxld"
Jul 15 19:15:29.691179 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.691155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5037a0cb-d1d4-414e-bbca-b8e190db70f3-metrics-tls\") pod \"dns-default-dsxld\" (UID: \"5037a0cb-d1d4-414e-bbca-b8e190db70f3\") " pod="openshift-dns/dns-default-dsxld"
Jul 15 19:15:29.691179 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.691173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5037a0cb-d1d4-414e-bbca-b8e190db70f3-tmp-dir\") pod \"dns-default-dsxld\" (UID: \"5037a0cb-d1d4-414e-bbca-b8e190db70f3\") " pod="openshift-dns/dns-default-dsxld"
Jul 15 19:15:29.691591 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.691232    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5037a0cb-d1d4-414e-bbca-b8e190db70f3-config-volume\") pod \"dns-default-dsxld\" (UID: \"5037a0cb-d1d4-414e-bbca-b8e190db70f3\") " pod="openshift-dns/dns-default-dsxld"
Jul 15 19:15:29.691591 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.691546    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5037a0cb-d1d4-414e-bbca-b8e190db70f3-tmp-dir\") pod \"dns-default-dsxld\" (UID: \"5037a0cb-d1d4-414e-bbca-b8e190db70f3\") " pod="openshift-dns/dns-default-dsxld"
Jul 15 19:15:29.691798 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.691783    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5037a0cb-d1d4-414e-bbca-b8e190db70f3-config-volume\") pod \"dns-default-dsxld\" (UID: \"5037a0cb-d1d4-414e-bbca-b8e190db70f3\") " pod="openshift-dns/dns-default-dsxld"
Jul 15 19:15:29.693327 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.693309    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5037a0cb-d1d4-414e-bbca-b8e190db70f3-metrics-tls\") pod \"dns-default-dsxld\" (UID: \"5037a0cb-d1d4-414e-bbca-b8e190db70f3\") " pod="openshift-dns/dns-default-dsxld"
Jul 15 19:15:29.701987 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.701969    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdkb2\" (UniqueName: \"kubernetes.io/projected/5037a0cb-d1d4-414e-bbca-b8e190db70f3-kube-api-access-xdkb2\") pod \"dns-default-dsxld\" (UID: \"5037a0cb-d1d4-414e-bbca-b8e190db70f3\") " pod="openshift-dns/dns-default-dsxld"
Jul 15 19:15:29.748992 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.748955    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gs9w2"
Jul 15 19:15:29.761096 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.761076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6wddf"
Jul 15 19:15:29.850362 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.850332    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dsxld"
Jul 15 19:15:29.971467 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.970999    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6wddf"]
Jul 15 19:15:29.975578 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:15:29.975546    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753cbcd0_a844_4e99_aeea_45aadbcbdc87.slice/crio-fa398e7935248c91e99bbe844bcff8c53ab7d5d987eadd2b84f46fa41e06748f WatchSource:0}: Error finding container fa398e7935248c91e99bbe844bcff8c53ab7d5d987eadd2b84f46fa41e06748f: Status 404 returned error can't find the container with id fa398e7935248c91e99bbe844bcff8c53ab7d5d987eadd2b84f46fa41e06748f
Jul 15 19:15:29.995939 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:29.995916    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gs9w2"]
Jul 15 19:15:29.998818 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:15:29.998794    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67800f37_87dc_468b_9e62_0f5813790484.slice/crio-bf39bf720ea5a7f4579f42d257e8e54741c65a93769dfe97fe0c55b2f543b370 WatchSource:0}: Error finding container bf39bf720ea5a7f4579f42d257e8e54741c65a93769dfe97fe0c55b2f543b370: Status 404 returned error can't find the container with id bf39bf720ea5a7f4579f42d257e8e54741c65a93769dfe97fe0c55b2f543b370
Jul 15 19:15:30.008752 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:30.008718    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6wddf" event={"ID":"753cbcd0-a844-4e99-aeea-45aadbcbdc87","Type":"ContainerStarted","Data":"fa398e7935248c91e99bbe844bcff8c53ab7d5d987eadd2b84f46fa41e06748f"}
Jul 15 19:15:30.009769 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:30.009745    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gs9w2" event={"ID":"67800f37-87dc-468b-9e62-0f5813790484","Type":"ContainerStarted","Data":"bf39bf720ea5a7f4579f42d257e8e54741c65a93769dfe97fe0c55b2f543b370"}
Jul 15 19:15:30.017793 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:30.017774    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dsxld"]
Jul 15 19:15:30.020640 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:15:30.020619    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5037a0cb_d1d4_414e_bbca_b8e190db70f3.slice/crio-1b9cf877e152fd2d28d55c7bf1c1c7062451a178fcaefc59235ef7d16c5cbdc7 WatchSource:0}: Error finding container 1b9cf877e152fd2d28d55c7bf1c1c7062451a178fcaefc59235ef7d16c5cbdc7: Status 404 returned error can't find the container with id 1b9cf877e152fd2d28d55c7bf1c1c7062451a178fcaefc59235ef7d16c5cbdc7
Jul 15 19:15:30.684872 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:30.684076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:30.684872 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:30.684076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:30.684872 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:30.684244    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:30.688392 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:30.688368    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 19:15:30.688597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:30.688581    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 19:15:30.688775 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:30.688759    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 19:15:30.689094 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:30.688941    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 19:15:30.689094 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:30.688942    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pjk9x\""
Jul 15 19:15:30.689364 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:30.689213    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sk5rd\""
Jul 15 19:15:31.014847 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:31.014752    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dsxld" event={"ID":"5037a0cb-d1d4-414e-bbca-b8e190db70f3","Type":"ContainerStarted","Data":"1b9cf877e152fd2d28d55c7bf1c1c7062451a178fcaefc59235ef7d16c5cbdc7"}
Jul 15 19:15:35.297805 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:35.297771    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-frx8v"]
Jul 15 19:15:35.326348 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:35.326307    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-frx8v"]
Jul 15 19:15:35.326529 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:35.326417    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-frx8v"
Jul 15 19:15:35.328821 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:35.328795    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 15 19:15:35.328953 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:35.328858    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-brtbk\""
Jul 15 19:15:35.440215 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:35.440153    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2938884e-5963-4aab-b95d-078099762bd0-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-frx8v\" (UID: \"2938884e-5963-4aab-b95d-078099762bd0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-frx8v"
Jul 15 19:15:35.541322 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:35.541283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2938884e-5963-4aab-b95d-078099762bd0-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-frx8v\" (UID: \"2938884e-5963-4aab-b95d-078099762bd0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-frx8v"
Jul 15 19:15:35.541472 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:35.541436    2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 15 19:15:35.541519 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:35.541508    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2938884e-5963-4aab-b95d-078099762bd0-tls-certificates podName:2938884e-5963-4aab-b95d-078099762bd0 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:36.041486971 +0000 UTC m=+59.979525418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/2938884e-5963-4aab-b95d-078099762bd0-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-frx8v" (UID: "2938884e-5963-4aab-b95d-078099762bd0") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 15 19:15:36.048591 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:36.048513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2938884e-5963-4aab-b95d-078099762bd0-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-frx8v\" (UID: \"2938884e-5963-4aab-b95d-078099762bd0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-frx8v"
Jul 15 19:15:36.051124 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:36.051096    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2938884e-5963-4aab-b95d-078099762bd0-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-frx8v\" (UID: \"2938884e-5963-4aab-b95d-078099762bd0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-frx8v"
Jul 15 19:15:36.237954 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:36.237912    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-frx8v"
Jul 15 19:15:36.389607 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:36.389581    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-frx8v"]
Jul 15 19:15:36.396382 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:15:36.396341    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2938884e_5963_4aab_b95d_078099762bd0.slice/crio-56ef6df4e38ac16fb611126713a6031898b2c1882c7569f9b1f17a403bd9bcf3 WatchSource:0}: Error finding container 56ef6df4e38ac16fb611126713a6031898b2c1882c7569f9b1f17a403bd9bcf3: Status 404 returned error can't find the container with id 56ef6df4e38ac16fb611126713a6031898b2c1882c7569f9b1f17a403bd9bcf3
Jul 15 19:15:37.034607 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:37.034573    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6wddf" event={"ID":"753cbcd0-a844-4e99-aeea-45aadbcbdc87","Type":"ContainerStarted","Data":"d544580754cdea6e90d3fc8dea7257d40ddf30cd6e8d46a1baa132d58f572357"}
Jul 15 19:15:37.035695 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:37.035666    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-frx8v" event={"ID":"2938884e-5963-4aab-b95d-078099762bd0","Type":"ContainerStarted","Data":"56ef6df4e38ac16fb611126713a6031898b2c1882c7569f9b1f17a403bd9bcf3"}
Jul 15 19:15:37.037397 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:37.037372    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dsxld" event={"ID":"5037a0cb-d1d4-414e-bbca-b8e190db70f3","Type":"ContainerStarted","Data":"2a1c61d07d56c74b4ebf86bcdaf7cd92fe48a8aa9e79f93040287a8a8876ca1f"}
Jul 15 19:15:37.037486 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:37.037412    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dsxld" event={"ID":"5037a0cb-d1d4-414e-bbca-b8e190db70f3","Type":"ContainerStarted","Data":"a36e53f9c7664563d96e6952871b8d8d4ae42ab23b83a4bcb9bba2c882d0e23e"}
Jul 15 19:15:37.037532 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:37.037512    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dsxld"
Jul 15 19:15:37.038767 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:37.038747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gs9w2" event={"ID":"67800f37-87dc-468b-9e62-0f5813790484","Type":"ContainerStarted","Data":"13bb088969866672bf5076f7d9614796e6fe0a4669c6b3780fb367ecdd52fe73"}
Jul 15 19:15:37.053070 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:37.053032    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6wddf" podStartSLOduration=1.780283989 podStartE2EDuration="8.053020527s" totalImagesPullingTime="6.272736538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:37.052106778 +0000 UTC m=+60.990145246" watchObservedRunningTime="2026-07-15 19:15:37.053020527 +0000 UTC m=+60.991058995"
Jul 15 19:15:37.070129 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:37.070089    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dsxld" podStartSLOduration=1.841769835 podStartE2EDuration="8.070073638s" totalImagesPullingTime="6.228303803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:37.069080157 +0000 UTC m=+61.007118627" watchObservedRunningTime="2026-07-15 19:15:37.070073638 +0000 UTC m=+61.008112100"
Jul 15 19:15:38.962068 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:38.962037    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whcqx"
Jul 15 19:15:41.051602 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.051564    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gs9w2" event={"ID":"67800f37-87dc-468b-9e62-0f5813790484","Type":"ContainerStarted","Data":"90715cc674d2c75b4af39d111b2947e907d20517e92d3d6569ba7ae71b5737fc"}
Jul 15 19:15:41.052878 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.052852    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-frx8v" event={"ID":"2938884e-5963-4aab-b95d-078099762bd0","Type":"ContainerStarted","Data":"f69b9f3e9310dc2f919761d45eb9f37e0c9f4d3358aa96a76529a78c6fd38162"}
Jul 15 19:15:41.053071 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.053052    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-frx8v"
Jul 15 19:15:41.057581 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.057560    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-frx8v"
Jul 15 19:15:41.069946 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.069901    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-frx8v" podStartSLOduration=2.178096052 podStartE2EDuration="6.069889257s" totalImagesPullingTime="3.891793205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:41.069439466 +0000 UTC m=+65.007477938" watchObservedRunningTime="2026-07-15 19:15:41.069889257 +0000 UTC m=+65.007927725"
Jul 15 19:15:41.368317 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.368283    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-d5ngb"]
Jul 15 19:15:41.370294 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.370280    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb"
Jul 15 19:15:41.372698 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.372678    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 15 19:15:41.372901 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.372874    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 19:15:41.372901 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.372889    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 19:15:41.373051 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.372906    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zgn8p\""
Jul 15 19:15:41.373051 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.372906    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 15 19:15:41.373685 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.373667    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 19:15:41.381964 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.381944    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-d5ngb"]
Jul 15 19:15:41.492885 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.492853    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zzx2\" (UniqueName: \"kubernetes.io/projected/a35a40d8-5a72-416e-8853-98f84d574002-kube-api-access-7zzx2\") pod \"prometheus-operator-64785b6675-d5ngb\" (UID: \"a35a40d8-5a72-416e-8853-98f84d574002\") " pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb"
Jul 15 19:15:41.493045 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.492928    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a35a40d8-5a72-416e-8853-98f84d574002-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-d5ngb\" (UID: \"a35a40d8-5a72-416e-8853-98f84d574002\") " pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb"
Jul 15 19:15:41.493045 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.492991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a35a40d8-5a72-416e-8853-98f84d574002-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-d5ngb\" (UID: \"a35a40d8-5a72-416e-8853-98f84d574002\") " pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb"
Jul 15 19:15:41.493045 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.493013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a35a40d8-5a72-416e-8853-98f84d574002-metrics-client-ca\") pod \"prometheus-operator-64785b6675-d5ngb\" (UID: \"a35a40d8-5a72-416e-8853-98f84d574002\") " pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb"
Jul 15 19:15:41.593525 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.593499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a35a40d8-5a72-416e-8853-98f84d574002-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-d5ngb\" (UID: \"a35a40d8-5a72-416e-8853-98f84d574002\") " pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb"
Jul 15 19:15:41.593731 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.593554    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a35a40d8-5a72-416e-8853-98f84d574002-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-d5ngb\" (UID: \"a35a40d8-5a72-416e-8853-98f84d574002\") " pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb"
Jul 15 19:15:41.593731 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.593592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a35a40d8-5a72-416e-8853-98f84d574002-metrics-client-ca\") pod \"prometheus-operator-64785b6675-d5ngb\" (UID: \"a35a40d8-5a72-416e-8853-98f84d574002\") " pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb"
Jul 15 19:15:41.593731 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.593634    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zzx2\" (UniqueName: \"kubernetes.io/projected/a35a40d8-5a72-416e-8853-98f84d574002-kube-api-access-7zzx2\") pod \"prometheus-operator-64785b6675-d5ngb\" (UID: \"a35a40d8-5a72-416e-8853-98f84d574002\") " pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb"
Jul 15 19:15:41.593731 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:41.593666    2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 15 19:15:41.593904 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:41.593741    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a35a40d8-5a72-416e-8853-98f84d574002-prometheus-operator-tls podName:a35a40d8-5a72-416e-8853-98f84d574002 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:42.093722241 +0000 UTC m=+66.031760701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a35a40d8-5a72-416e-8853-98f84d574002-prometheus-operator-tls") pod "prometheus-operator-64785b6675-d5ngb" (UID: "a35a40d8-5a72-416e-8853-98f84d574002") : secret "prometheus-operator-tls" not found
Jul 15 19:15:41.594583 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.594551    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a35a40d8-5a72-416e-8853-98f84d574002-metrics-client-ca\") pod \"prometheus-operator-64785b6675-d5ngb\" (UID: \"a35a40d8-5a72-416e-8853-98f84d574002\") " pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb"
Jul 15 19:15:41.596285 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.596261    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a35a40d8-5a72-416e-8853-98f84d574002-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-d5ngb\" (UID: \"a35a40d8-5a72-416e-8853-98f84d574002\") " pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb"
Jul 15 19:15:41.603565 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:41.603538    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zzx2\" (UniqueName: \"kubernetes.io/projected/a35a40d8-5a72-416e-8853-98f84d574002-kube-api-access-7zzx2\") pod \"prometheus-operator-64785b6675-d5ngb\" (UID: \"a35a40d8-5a72-416e-8853-98f84d574002\") " pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb"
Jul 15 19:15:42.098344 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.098304    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a35a40d8-5a72-416e-8853-98f84d574002-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-d5ngb\" (UID: \"a35a40d8-5a72-416e-8853-98f84d574002\") " pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb"
Jul 15 19:15:42.100967 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.100939    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a35a40d8-5a72-416e-8853-98f84d574002-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-d5ngb\" (UID: \"a35a40d8-5a72-416e-8853-98f84d574002\") " pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb"
Jul 15 19:15:42.279412 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.279379    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb"
Jul 15 19:15:42.300446 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.300413    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs\") pod \"network-metrics-daemon-rxq78\" (UID: \"4808e44a-0e6a-47eb-babd-4c7254c7a5f6\") " pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:42.300555 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.300503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret\") pod \"global-pull-secret-syncer-kqpm4\" (UID: \"c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0\") " pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:42.306465 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.306444    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 19:15:42.306614 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.306447    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 19:15:42.313578 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.313555    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0-original-pull-secret\") pod \"global-pull-secret-syncer-kqpm4\" (UID: \"c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0\") " pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:42.313960 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.313942    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4808e44a-0e6a-47eb-babd-4c7254c7a5f6-metrics-certs\") pod \"network-metrics-daemon-rxq78\" (UID: \"4808e44a-0e6a-47eb-babd-4c7254c7a5f6\") " pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:42.401287 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.401243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6vd6\" (UniqueName: \"kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6\") pod \"network-check-target-n844l\" (UID: \"433b5ca5-5a13-436f-8794-aed9e142b74d\") " pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:42.401618 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.401520    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sk5rd\""
Jul 15 19:15:42.405471 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.405448    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 19:15:42.407376 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.407345    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqpm4"
Jul 15 19:15:42.409474 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.409454    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxq78"
Jul 15 19:15:42.414803 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.414787    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 19:15:42.424511 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.424482    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-d5ngb"]
Jul 15 19:15:42.426475 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.426422    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6vd6\" (UniqueName: \"kubernetes.io/projected/433b5ca5-5a13-436f-8794-aed9e142b74d-kube-api-access-f6vd6\") pod \"network-check-target-n844l\" (UID: \"433b5ca5-5a13-436f-8794-aed9e142b74d\") " pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:42.429097 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:15:42.428888    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda35a40d8_5a72_416e_8853_98f84d574002.slice/crio-049ec569a54937f9f11c3260394b30a890fe9747a890cd1bea9727295f8464f8 WatchSource:0}: Error finding container 049ec569a54937f9f11c3260394b30a890fe9747a890cd1bea9727295f8464f8: Status 404 returned error can't find the container with id 049ec569a54937f9f11c3260394b30a890fe9747a890cd1bea9727295f8464f8
Jul 15 19:15:42.551412 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.551376    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kqpm4"]
Jul 15 19:15:42.555340 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:15:42.555309    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a2b3c1_48cc_4e71_aa49_174dcab5b8d0.slice/crio-977d216e7df95a67defb256178e1ea1cfcdfadaf24ab2f2553dbad3baf40350d WatchSource:0}: Error finding container 977d216e7df95a67defb256178e1ea1cfcdfadaf24ab2f2553dbad3baf40350d: Status 404 returned error can't find the container with id 977d216e7df95a67defb256178e1ea1cfcdfadaf24ab2f2553dbad3baf40350d
Jul 15 19:15:42.574326 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.574300    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rxq78"]
Jul 15 19:15:42.578265 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:15:42.578240    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4808e44a_0e6a_47eb_babd_4c7254c7a5f6.slice/crio-2c19eaf6cc01113eb58f4bfcbde92cf40a6ab580e808c415ae4ba8bf633a1964 WatchSource:0}: Error finding container 2c19eaf6cc01113eb58f4bfcbde92cf40a6ab580e808c415ae4ba8bf633a1964: Status 404 returned error can't find the container with id 2c19eaf6cc01113eb58f4bfcbde92cf40a6ab580e808c415ae4ba8bf633a1964
Jul 15 19:15:42.716069 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.715992    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pjk9x\""
Jul 15 19:15:42.723983 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.723955    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:42.862402 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:42.862373    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n844l"]
Jul 15 19:15:43.065303 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:43.065187    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxq78" event={"ID":"4808e44a-0e6a-47eb-babd-4c7254c7a5f6","Type":"ContainerStarted","Data":"2c19eaf6cc01113eb58f4bfcbde92cf40a6ab580e808c415ae4ba8bf633a1964"}
Jul 15 19:15:43.066493 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:43.066466    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kqpm4" event={"ID":"c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0","Type":"ContainerStarted","Data":"977d216e7df95a67defb256178e1ea1cfcdfadaf24ab2f2553dbad3baf40350d"}
Jul 15 19:15:43.067686 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:43.067652    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb" event={"ID":"a35a40d8-5a72-416e-8853-98f84d574002","Type":"ContainerStarted","Data":"049ec569a54937f9f11c3260394b30a890fe9747a890cd1bea9727295f8464f8"}
Jul 15 19:15:44.396297 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:15:44.396265    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod433b5ca5_5a13_436f_8794_aed9e142b74d.slice/crio-0acb06c643c26242e8b72c810123f93e9dc1e3936d0bf9399fd47db8741846af WatchSource:0}: Error finding container 0acb06c643c26242e8b72c810123f93e9dc1e3936d0bf9399fd47db8741846af: Status 404 returned error can't find the container with id 0acb06c643c26242e8b72c810123f93e9dc1e3936d0bf9399fd47db8741846af
Jul 15 19:15:45.078675 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:45.078639    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gs9w2" event={"ID":"67800f37-87dc-468b-9e62-0f5813790484","Type":"ContainerStarted","Data":"07d5f9cb384e1afadd90cb588b55a5dfe767137b5d3d1aa8fa93232e41546973"}
Jul 15 19:15:45.080146 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:45.080094    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n844l" event={"ID":"433b5ca5-5a13-436f-8794-aed9e142b74d","Type":"ContainerStarted","Data":"0acb06c643c26242e8b72c810123f93e9dc1e3936d0bf9399fd47db8741846af"}
Jul 15 19:15:45.103335 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:45.102984    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gs9w2" podStartSLOduration=1.79787658 podStartE2EDuration="16.102963968s" totalImagesPullingTime="14.305087388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:15:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:45.102817768 +0000 UTC m=+69.040856241" watchObservedRunningTime="2026-07-15 19:15:45.102963968 +0000 UTC m=+69.041002433"
Jul 15 19:15:46.093493 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:46.093431    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxq78" event={"ID":"4808e44a-0e6a-47eb-babd-4c7254c7a5f6","Type":"ContainerStarted","Data":"297e944568845bcd82137d59f87f189d3c3d687564855e412c92d13706f297fb"}
Jul 15 19:15:46.094760 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:46.094018    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxq78" event={"ID":"4808e44a-0e6a-47eb-babd-4c7254c7a5f6","Type":"ContainerStarted","Data":"56f16905f9c25c778d9c596ba3b7c9aa52d3a396dcd0b498a34303e773497375"}
Jul 15 19:15:46.105381 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:46.104501    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb" event={"ID":"a35a40d8-5a72-416e-8853-98f84d574002","Type":"ContainerStarted","Data":"8e9a9f7202b9bb8271845f84f19e9abf20211aaa7ceb60ef181a5c3adb18e51a"}
Jul 15 19:15:46.105381 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:46.104567    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb" event={"ID":"a35a40d8-5a72-416e-8853-98f84d574002","Type":"ContainerStarted","Data":"0d897c6c0e3a33aad0ec0f3148e819df77e44ab5fa9f79551ddd1f734e75a06e"}
Jul 15 19:15:46.118755 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:46.118705    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rxq78" podStartSLOduration=65.896818474 podStartE2EDuration="1m9.11868898s" totalImagesPullingTime="3.221870506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:46.117636004 +0000 UTC m=+70.055674472" watchObservedRunningTime="2026-07-15 19:15:46.11868898 +0000 UTC m=+70.056727458"
Jul 15 19:15:46.656687 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:46.656113    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-d5ngb" podStartSLOduration=2.282056978 podStartE2EDuration="5.656092377s" totalImagesPullingTime="3.374035399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:46.137305863 +0000 UTC m=+70.075344334" watchObservedRunningTime="2026-07-15 19:15:46.656092377 +0000 UTC m=+70.594130847"
Jul 15 19:15:46.656687 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:46.656674    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-b6tsh"]
Jul 15 19:15:46.675225 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:46.675158    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-b6tsh"]
Jul 15 19:15:46.675387 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:46.675295    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-b6tsh"
Jul 15 19:15:46.677703 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:46.677679    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 19:15:46.678087 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:46.677900    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-75xr6\""
Jul 15 19:15:46.678087 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:46.677909    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 19:15:46.735213 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:46.735174    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqm6p\" (UniqueName: \"kubernetes.io/projected/1220340b-be76-4b6b-a382-49ec608a1054-kube-api-access-lqm6p\") pod \"downloads-68c9cbb497-b6tsh\" (UID: \"1220340b-be76-4b6b-a382-49ec608a1054\") " pod="openshift-console/downloads-68c9cbb497-b6tsh"
Jul 15 19:15:46.836609 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:46.836569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqm6p\" (UniqueName: \"kubernetes.io/projected/1220340b-be76-4b6b-a382-49ec608a1054-kube-api-access-lqm6p\") pod \"downloads-68c9cbb497-b6tsh\" (UID: \"1220340b-be76-4b6b-a382-49ec608a1054\") " pod="openshift-console/downloads-68c9cbb497-b6tsh"
Jul 15 19:15:46.846593 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:46.846566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqm6p\" (UniqueName: \"kubernetes.io/projected/1220340b-be76-4b6b-a382-49ec608a1054-kube-api-access-lqm6p\") pod \"downloads-68c9cbb497-b6tsh\" (UID: \"1220340b-be76-4b6b-a382-49ec608a1054\") " pod="openshift-console/downloads-68c9cbb497-b6tsh"
Jul 15 19:15:46.990181 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:46.990099    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-b6tsh"
Jul 15 19:15:47.044576 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.044518    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dsxld"
Jul 15 19:15:47.761082 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.761048    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn"]
Jul 15 19:15:47.763516 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.763488    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn"
Jul 15 19:15:47.767108 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.767087    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qzr8w\""
Jul 15 19:15:47.767263 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.767110    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 15 19:15:47.767263 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.767125    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 15 19:15:47.778957 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.778908    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"]
Jul 15 19:15:47.781949 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.781832    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn"]
Jul 15 19:15:47.782055 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.781950    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:47.784431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.784413    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 15 19:15:47.784611 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.784592    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6gxwr\""
Jul 15 19:15:47.784707 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.784616    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 15 19:15:47.784707 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.784616    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 15 19:15:47.794809 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.794789    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"]
Jul 15 19:15:47.806168 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.806149    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p2rnr"]
Jul 15 19:15:47.808356 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.808337    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:47.810455 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.810435    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 19:15:47.810592 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.810572    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 19:15:47.810711 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.810699    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-znk59\""
Jul 15 19:15:47.810970 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.810954    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 19:15:47.845282 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.845256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/77c666ab-c766-4239-90aa-f10646b718b8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:47.845411 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.845296    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b1202b2-ce2c-42de-b65a-5176f5b55db6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-crsfn\" (UID: \"7b1202b2-ce2c-42de-b65a-5176f5b55db6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn"
Jul 15 19:15:47.845411 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.845322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77c666ab-c766-4239-90aa-f10646b718b8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:47.845411 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.845368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5p2s\" (UniqueName: \"kubernetes.io/projected/7b1202b2-ce2c-42de-b65a-5176f5b55db6-kube-api-access-l5p2s\") pod \"openshift-state-metrics-84bd68b896-crsfn\" (UID: \"7b1202b2-ce2c-42de-b65a-5176f5b55db6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn"
Jul 15 19:15:47.845580 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.845458    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l56cz\" (UniqueName: \"kubernetes.io/projected/77c666ab-c766-4239-90aa-f10646b718b8-kube-api-access-l56cz\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:47.845580 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.845520    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77c666ab-c766-4239-90aa-f10646b718b8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:47.845580 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.845560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/77c666ab-c766-4239-90aa-f10646b718b8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:47.845731 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.845595    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b1202b2-ce2c-42de-b65a-5176f5b55db6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-crsfn\" (UID: \"7b1202b2-ce2c-42de-b65a-5176f5b55db6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn"
Jul 15 19:15:47.845731 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.845628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b1202b2-ce2c-42de-b65a-5176f5b55db6-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-crsfn\" (UID: \"7b1202b2-ce2c-42de-b65a-5176f5b55db6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn"
Jul 15 19:15:47.845731 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.845661    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/77c666ab-c766-4239-90aa-f10646b718b8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:47.946166 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b1202b2-ce2c-42de-b65a-5176f5b55db6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-crsfn\" (UID: \"7b1202b2-ce2c-42de-b65a-5176f5b55db6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn"
Jul 15 19:15:47.946364 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946172    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77c666ab-c766-4239-90aa-f10646b718b8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:47.946364 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946223    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/feb09d05-4fb6-4254-8c5e-600e9de57790-sys\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:47.946364 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946245    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/feb09d05-4fb6-4254-8c5e-600e9de57790-node-exporter-textfile\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:47.946364 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946270    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/feb09d05-4fb6-4254-8c5e-600e9de57790-node-exporter-wtmp\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:47.946364 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946299    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5p2s\" (UniqueName: \"kubernetes.io/projected/7b1202b2-ce2c-42de-b65a-5176f5b55db6-kube-api-access-l5p2s\") pod \"openshift-state-metrics-84bd68b896-crsfn\" (UID: \"7b1202b2-ce2c-42de-b65a-5176f5b55db6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn"
Jul 15 19:15:47.946621 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/feb09d05-4fb6-4254-8c5e-600e9de57790-node-exporter-accelerators-collector-config\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:47.946621 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l56cz\" (UniqueName: \"kubernetes.io/projected/77c666ab-c766-4239-90aa-f10646b718b8-kube-api-access-l56cz\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:47.946621 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946465    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/feb09d05-4fb6-4254-8c5e-600e9de57790-root\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:47.946621 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77c666ab-c766-4239-90aa-f10646b718b8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:47.946621 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946527    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/77c666ab-c766-4239-90aa-f10646b718b8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:47.946621 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/feb09d05-4fb6-4254-8c5e-600e9de57790-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:47.946621 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946585    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b1202b2-ce2c-42de-b65a-5176f5b55db6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-crsfn\" (UID: \"7b1202b2-ce2c-42de-b65a-5176f5b55db6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn"
Jul 15 19:15:47.946621 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b1202b2-ce2c-42de-b65a-5176f5b55db6-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-crsfn\" (UID: \"7b1202b2-ce2c-42de-b65a-5176f5b55db6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn"
Jul 15 19:15:47.946995 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946642    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/feb09d05-4fb6-4254-8c5e-600e9de57790-node-exporter-tls\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:47.946995 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/77c666ab-c766-4239-90aa-f10646b718b8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:47.946995 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946706    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/feb09d05-4fb6-4254-8c5e-600e9de57790-metrics-client-ca\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:47.946995 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946730    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rftv2\" (UniqueName: \"kubernetes.io/projected/feb09d05-4fb6-4254-8c5e-600e9de57790-kube-api-access-rftv2\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:47.946995 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946758    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/77c666ab-c766-4239-90aa-f10646b718b8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:47.946995 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.946957    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77c666ab-c766-4239-90aa-f10646b718b8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:47.947364 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:47.947070    2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 15 19:15:47.947364 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.947078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/77c666ab-c766-4239-90aa-f10646b718b8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:47.947364 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:47.947129    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77c666ab-c766-4239-90aa-f10646b718b8-kube-state-metrics-tls podName:77c666ab-c766-4239-90aa-f10646b718b8 nodeName:}" failed. No retries permitted until 2026-07-15 19:15:48.44711118 +0000 UTC m=+72.385149630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/77c666ab-c766-4239-90aa-f10646b718b8-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-wmb6z" (UID: "77c666ab-c766-4239-90aa-f10646b718b8") : secret "kube-state-metrics-tls" not found
Jul 15 19:15:47.947364 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.947254    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/77c666ab-c766-4239-90aa-f10646b718b8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:47.947594 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.947451    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b1202b2-ce2c-42de-b65a-5176f5b55db6-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-crsfn\" (UID: \"7b1202b2-ce2c-42de-b65a-5176f5b55db6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn"
Jul 15 19:15:47.949131 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.949106    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77c666ab-c766-4239-90aa-f10646b718b8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:47.949354 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.949326    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b1202b2-ce2c-42de-b65a-5176f5b55db6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-crsfn\" (UID: \"7b1202b2-ce2c-42de-b65a-5176f5b55db6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn"
Jul 15 19:15:47.949507 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.949491    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b1202b2-ce2c-42de-b65a-5176f5b55db6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-crsfn\" (UID: \"7b1202b2-ce2c-42de-b65a-5176f5b55db6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn"
Jul 15 19:15:47.956352 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.956312    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5p2s\" (UniqueName: \"kubernetes.io/projected/7b1202b2-ce2c-42de-b65a-5176f5b55db6-kube-api-access-l5p2s\") pod \"openshift-state-metrics-84bd68b896-crsfn\" (UID: \"7b1202b2-ce2c-42de-b65a-5176f5b55db6\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn"
Jul 15 19:15:47.956460 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:47.956436    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l56cz\" (UniqueName: \"kubernetes.io/projected/77c666ab-c766-4239-90aa-f10646b718b8-kube-api-access-l56cz\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:48.047433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.047347    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/feb09d05-4fb6-4254-8c5e-600e9de57790-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.047433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.047394    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/feb09d05-4fb6-4254-8c5e-600e9de57790-node-exporter-tls\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.047708 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.047675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/feb09d05-4fb6-4254-8c5e-600e9de57790-metrics-client-ca\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.047759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.047734    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rftv2\" (UniqueName: \"kubernetes.io/projected/feb09d05-4fb6-4254-8c5e-600e9de57790-kube-api-access-rftv2\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.047949 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.047794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/feb09d05-4fb6-4254-8c5e-600e9de57790-sys\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.047998 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.047972    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/feb09d05-4fb6-4254-8c5e-600e9de57790-node-exporter-textfile\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.048037 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.048021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/feb09d05-4fb6-4254-8c5e-600e9de57790-node-exporter-wtmp\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.048090 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.048073    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/feb09d05-4fb6-4254-8c5e-600e9de57790-node-exporter-accelerators-collector-config\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.048129 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.048116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/feb09d05-4fb6-4254-8c5e-600e9de57790-root\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.052560 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.048261    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/feb09d05-4fb6-4254-8c5e-600e9de57790-sys\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.052560 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.048306    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/feb09d05-4fb6-4254-8c5e-600e9de57790-root\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.052560 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.048459    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/feb09d05-4fb6-4254-8c5e-600e9de57790-node-exporter-wtmp\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.052560 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.048802    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/feb09d05-4fb6-4254-8c5e-600e9de57790-metrics-client-ca\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.052560 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.048830    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/feb09d05-4fb6-4254-8c5e-600e9de57790-node-exporter-accelerators-collector-config\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.052560 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.049031    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/feb09d05-4fb6-4254-8c5e-600e9de57790-node-exporter-textfile\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.052560 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.050592    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/feb09d05-4fb6-4254-8c5e-600e9de57790-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.052956 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.052666    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/feb09d05-4fb6-4254-8c5e-600e9de57790-node-exporter-tls\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.059567 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.059545    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rftv2\" (UniqueName: \"kubernetes.io/projected/feb09d05-4fb6-4254-8c5e-600e9de57790-kube-api-access-rftv2\") pod \"node-exporter-p2rnr\" (UID: \"feb09d05-4fb6-4254-8c5e-600e9de57790\") " pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.074311 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.074289    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn"
Jul 15 19:15:48.118326 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.118299    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p2rnr"
Jul 15 19:15:48.451527 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.451494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/77c666ab-c766-4239-90aa-f10646b718b8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:48.454184 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.454163    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/77c666ab-c766-4239-90aa-f10646b718b8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-wmb6z\" (UID: \"77c666ab-c766-4239-90aa-f10646b718b8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:48.693047 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.693015    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"
Jul 15 19:15:48.850065 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.850032    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 19:15:48.854784 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.854759    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:48.857943 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.857295    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 15 19:15:48.857943 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.857534    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 15 19:15:48.857943 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.857713    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 15 19:15:48.858134 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.857945    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r4m4h\""
Jul 15 19:15:48.858238 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.858193    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 15 19:15:48.858450 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.858412    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 15 19:15:48.858612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.858597    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 15 19:15:48.859480 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.859076    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 15 19:15:48.859480 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.859077    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 15 19:15:48.859827 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.859806    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 15 19:15:48.870357 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.870336    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 19:15:48.955314 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.955225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-config-volume\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:48.955314 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.955284    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5hrz\" (UniqueName: \"kubernetes.io/projected/698207f2-6e70-4570-a564-822511f6a4aa-kube-api-access-j5hrz\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:48.955541 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.955365    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/698207f2-6e70-4570-a564-822511f6a4aa-config-out\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:48.955541 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.955399    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-web-config\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:48.955541 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.955428    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/698207f2-6e70-4570-a564-822511f6a4aa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:48.955541 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.955492    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/698207f2-6e70-4570-a564-822511f6a4aa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:48.955541 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.955531    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:48.955782 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.955564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:48.955782 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.955640    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/698207f2-6e70-4570-a564-822511f6a4aa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:48.955782 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.955680    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:48.955782 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.955740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:48.955782 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.955768    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/698207f2-6e70-4570-a564-822511f6a4aa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:48.955986 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:48.955794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.056841 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.056806    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-config-volume\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.056841 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.056852    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5hrz\" (UniqueName: \"kubernetes.io/projected/698207f2-6e70-4570-a564-822511f6a4aa-kube-api-access-j5hrz\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.057096 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.056901    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/698207f2-6e70-4570-a564-822511f6a4aa-config-out\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.057096 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.056928    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-web-config\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.057096 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.056949    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/698207f2-6e70-4570-a564-822511f6a4aa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.057293 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.057234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/698207f2-6e70-4570-a564-822511f6a4aa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.057293 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.057283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.057397 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.057370    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/698207f2-6e70-4570-a564-822511f6a4aa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.057475 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.057445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.057537 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.057498    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/698207f2-6e70-4570-a564-822511f6a4aa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.057596 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:49.057538    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/698207f2-6e70-4570-a564-822511f6a4aa-alertmanager-trusted-ca-bundle podName:698207f2-6e70-4570-a564-822511f6a4aa nodeName:}" failed. No retries permitted until 2026-07-15 19:15:49.557499485 +0000 UTC m=+73.495537943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/698207f2-6e70-4570-a564-822511f6a4aa-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "698207f2-6e70-4570-a564-822511f6a4aa") : configmap references non-existent config key: ca-bundle.crt
Jul 15 19:15:49.057667 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.057602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.057667 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.057651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.057764 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.057676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/698207f2-6e70-4570-a564-822511f6a4aa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.057764 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.057705    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.058832 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.058799    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/698207f2-6e70-4570-a564-822511f6a4aa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.060509 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.060484    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.060620 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.060544    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/698207f2-6e70-4570-a564-822511f6a4aa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.060620 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.060574    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-config-volume\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.060970 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.060930    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/698207f2-6e70-4570-a564-822511f6a4aa-config-out\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.061406 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.061386    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.061488 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.061447    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-web-config\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.062144 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.062114    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.062257 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.062146    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.062646 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.062630    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.068632 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.068613    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5hrz\" (UniqueName: \"kubernetes.io/projected/698207f2-6e70-4570-a564-822511f6a4aa-kube-api-access-j5hrz\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.333993 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.333919    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-b6tsh"]
Jul 15 19:15:49.340633 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:15:49.340585    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1220340b_be76_4b6b_a382_49ec608a1054.slice/crio-afc0cfcc3641ba4af6a7e6cfe8ada0e4458cd7ef6ae61e9c6c3116399acbf132 WatchSource:0}: Error finding container afc0cfcc3641ba4af6a7e6cfe8ada0e4458cd7ef6ae61e9c6c3116399acbf132: Status 404 returned error can't find the container with id afc0cfcc3641ba4af6a7e6cfe8ada0e4458cd7ef6ae61e9c6c3116399acbf132
Jul 15 19:15:49.350606 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.350576    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-wmb6z"]
Jul 15 19:15:49.353397 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:15:49.353372    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c666ab_c766_4239_90aa_f10646b718b8.slice/crio-4b424a951eea13cd5a20f7b833f84b967427f8f2e7dceaea332f5b225f7a3636 WatchSource:0}: Error finding container 4b424a951eea13cd5a20f7b833f84b967427f8f2e7dceaea332f5b225f7a3636: Status 404 returned error can't find the container with id 4b424a951eea13cd5a20f7b833f84b967427f8f2e7dceaea332f5b225f7a3636
Jul 15 19:15:49.366577 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.366549    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn"]
Jul 15 19:15:49.368855 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:15:49.368830    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b1202b2_ce2c_42de_b65a_5176f5b55db6.slice/crio-265bb528a0fd42036a93c496d1e8a6aa25b74133293765e4e78c251ea1dfb4ef WatchSource:0}: Error finding container 265bb528a0fd42036a93c496d1e8a6aa25b74133293765e4e78c251ea1dfb4ef: Status 404 returned error can't find the container with id 265bb528a0fd42036a93c496d1e8a6aa25b74133293765e4e78c251ea1dfb4ef
Jul 15 19:15:49.560627 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.560589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/698207f2-6e70-4570-a564-822511f6a4aa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.561403 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.561383    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/698207f2-6e70-4570-a564-822511f6a4aa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.767060 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.766978    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:15:49.869940 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.869897    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-569d4cb59c-65njw"]
Jul 15 19:15:49.873155 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.873132    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:49.876218 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.876150    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-t8kdv\""
Jul 15 19:15:49.876606 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.876483    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 15 19:15:49.876606 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.876484    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-46qe8k9dksr1g\""
Jul 15 19:15:49.876892 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.876877    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 15 19:15:49.877158 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.877142    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 15 19:15:49.877485 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.877447    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 15 19:15:49.877485 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.877472    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 15 19:15:49.889030 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.888975    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-569d4cb59c-65njw"]
Jul 15 19:15:49.928894 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.928866    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 19:15:49.963649 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.963603    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2929e077-432a-4052-9f8c-ac570d5ab22e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:49.963649 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.963646    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2929e077-432a-4052-9f8c-ac570d5ab22e-secret-grpc-tls\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:49.963870 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.963688    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2929e077-432a-4052-9f8c-ac570d5ab22e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:49.963870 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.963750    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2929e077-432a-4052-9f8c-ac570d5ab22e-secret-thanos-querier-tls\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:49.963870 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.963791    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2929e077-432a-4052-9f8c-ac570d5ab22e-metrics-client-ca\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:49.963870 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.963820    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trhb4\" (UniqueName: \"kubernetes.io/projected/2929e077-432a-4052-9f8c-ac570d5ab22e-kube-api-access-trhb4\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:49.964050 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.963897    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2929e077-432a-4052-9f8c-ac570d5ab22e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:49.964050 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:49.963924    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2929e077-432a-4052-9f8c-ac570d5ab22e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:50.065111 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.065028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2929e077-432a-4052-9f8c-ac570d5ab22e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:50.065111 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.065078    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2929e077-432a-4052-9f8c-ac570d5ab22e-secret-grpc-tls\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:50.065111 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.065109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2929e077-432a-4052-9f8c-ac570d5ab22e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:50.065416 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.065162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2929e077-432a-4052-9f8c-ac570d5ab22e-secret-thanos-querier-tls\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:50.065416 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.065194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2929e077-432a-4052-9f8c-ac570d5ab22e-metrics-client-ca\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:50.065416 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.065231    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trhb4\" (UniqueName: \"kubernetes.io/projected/2929e077-432a-4052-9f8c-ac570d5ab22e-kube-api-access-trhb4\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:50.065416 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.065250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2929e077-432a-4052-9f8c-ac570d5ab22e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:50.065416 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.065267    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2929e077-432a-4052-9f8c-ac570d5ab22e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:50.067273 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.066534    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2929e077-432a-4052-9f8c-ac570d5ab22e-metrics-client-ca\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:50.069001 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.068951    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2929e077-432a-4052-9f8c-ac570d5ab22e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:50.069520 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.069366    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2929e077-432a-4052-9f8c-ac570d5ab22e-secret-thanos-querier-tls\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:50.070071 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.070019    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2929e077-432a-4052-9f8c-ac570d5ab22e-secret-grpc-tls\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:50.071476 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.071432    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2929e077-432a-4052-9f8c-ac570d5ab22e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:50.072149 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.072107    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2929e077-432a-4052-9f8c-ac570d5ab22e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:50.072861 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.072824    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2929e077-432a-4052-9f8c-ac570d5ab22e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:50.076904 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.076864    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trhb4\" (UniqueName: \"kubernetes.io/projected/2929e077-432a-4052-9f8c-ac570d5ab22e-kube-api-access-trhb4\") pod \"thanos-querier-569d4cb59c-65njw\" (UID: \"2929e077-432a-4052-9f8c-ac570d5ab22e\") " pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:50.124545 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.124456    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z" event={"ID":"77c666ab-c766-4239-90aa-f10646b718b8","Type":"ContainerStarted","Data":"4b424a951eea13cd5a20f7b833f84b967427f8f2e7dceaea332f5b225f7a3636"}
Jul 15 19:15:50.125942 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.125854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-b6tsh" event={"ID":"1220340b-be76-4b6b-a382-49ec608a1054","Type":"ContainerStarted","Data":"afc0cfcc3641ba4af6a7e6cfe8ada0e4458cd7ef6ae61e9c6c3116399acbf132"}
Jul 15 19:15:50.127519 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.127434    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p2rnr" event={"ID":"feb09d05-4fb6-4254-8c5e-600e9de57790","Type":"ContainerStarted","Data":"83b356faae2ad28507ff366b883c832d684cacf7eb03cea5dc2c39985990ad90"}
Jul 15 19:15:50.130436 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.129609    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n844l" event={"ID":"433b5ca5-5a13-436f-8794-aed9e142b74d","Type":"ContainerStarted","Data":"94c3145c93984e7ab2609cc1be5f5e836ca27acf7845b80a1ed7df030b31edaf"}
Jul 15 19:15:50.130436 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.130375    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:15:50.132021 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.131888    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kqpm4" event={"ID":"c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0","Type":"ContainerStarted","Data":"58593153c778ce00d969cca38d4024c80adf47485c29f84de8475ababb169a83"}
Jul 15 19:15:50.134928 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.134904    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn" event={"ID":"7b1202b2-ce2c-42de-b65a-5176f5b55db6","Type":"ContainerStarted","Data":"fdff6ad7fa140e6becfe64b04e21b22dfae3caafa3021414d18942c564d0752d"}
Jul 15 19:15:50.135013 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.134961    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn" event={"ID":"7b1202b2-ce2c-42de-b65a-5176f5b55db6","Type":"ContainerStarted","Data":"05a7fe7c47a24ec595a5c90662866571f1a85ebbef58e8019ddce69ed5b7a022"}
Jul 15 19:15:50.135013 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.134990    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn" event={"ID":"7b1202b2-ce2c-42de-b65a-5176f5b55db6","Type":"ContainerStarted","Data":"265bb528a0fd42036a93c496d1e8a6aa25b74133293765e4e78c251ea1dfb4ef"}
Jul 15 19:15:50.147812 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:15:50.147784    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod698207f2_6e70_4570_a564_822511f6a4aa.slice/crio-5c76af261aa13e6f7e47f37e7966c090d26a7e5f67fce2ad794e36305f30c9c2 WatchSource:0}: Error finding container 5c76af261aa13e6f7e47f37e7966c090d26a7e5f67fce2ad794e36305f30c9c2: Status 404 returned error can't find the container with id 5c76af261aa13e6f7e47f37e7966c090d26a7e5f67fce2ad794e36305f30c9c2
Jul 15 19:15:50.152127 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.152031    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n844l" podStartSLOduration=68.369100352 podStartE2EDuration="1m13.152012707s" totalImagesPullingTime="4.782912355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:50.150186061 +0000 UTC m=+74.088224530" watchObservedRunningTime="2026-07-15 19:15:50.152012707 +0000 UTC m=+74.090051176"
Jul 15 19:15:50.168119 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.168084    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kqpm4" podStartSLOduration=66.541900918 podStartE2EDuration="1m13.168071396s" totalImagesPullingTime="6.626170478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:50.167600471 +0000 UTC m=+74.105638940" watchObservedRunningTime="2026-07-15 19:15:50.168071396 +0000 UTC m=+74.106109864"
Jul 15 19:15:50.184477 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.184453    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:50.352647 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:50.352509    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-569d4cb59c-65njw"]
Jul 15 19:15:50.386542 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:15:50.386507    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2929e077_432a_4052_9f8c_ac570d5ab22e.slice/crio-87d0567f9c4fef313a15afc74c35d302d5770efdc92b0cb573d3d0d545e6d991 WatchSource:0}: Error finding container 87d0567f9c4fef313a15afc74c35d302d5770efdc92b0cb573d3d0d545e6d991: Status 404 returned error can't find the container with id 87d0567f9c4fef313a15afc74c35d302d5770efdc92b0cb573d3d0d545e6d991
Jul 15 19:15:51.144526 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:51.143967    2565 generic.go:356] "Generic (PLEG): container finished" podID="feb09d05-4fb6-4254-8c5e-600e9de57790" containerID="ef089c002645bb8a288f7924f728feb62dbc2132c1ed8c15eb4cf3c790082de2" exitCode=0
Jul 15 19:15:51.144526 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:51.144063    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p2rnr" event={"ID":"feb09d05-4fb6-4254-8c5e-600e9de57790","Type":"ContainerDied","Data":"ef089c002645bb8a288f7924f728feb62dbc2132c1ed8c15eb4cf3c790082de2"}
Jul 15 19:15:51.146823 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:51.146736    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"698207f2-6e70-4570-a564-822511f6a4aa","Type":"ContainerStarted","Data":"5c76af261aa13e6f7e47f37e7966c090d26a7e5f67fce2ad794e36305f30c9c2"}
Jul 15 19:15:51.164903 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:51.164723    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn" event={"ID":"7b1202b2-ce2c-42de-b65a-5176f5b55db6","Type":"ContainerStarted","Data":"9de78ac7d5f50c89b2364e89aa41a409992f0886a7dc9a478be7eb516bb4ff1c"}
Jul 15 19:15:51.175418 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:51.175392    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z" event={"ID":"77c666ab-c766-4239-90aa-f10646b718b8","Type":"ContainerStarted","Data":"6be8c645aa7fec299e6ac151e7eb342b248007efe71c214f08e11503f9b75d02"}
Jul 15 19:15:51.177635 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:51.177617    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw" event={"ID":"2929e077-432a-4052-9f8c-ac570d5ab22e","Type":"ContainerStarted","Data":"87d0567f9c4fef313a15afc74c35d302d5770efdc92b0cb573d3d0d545e6d991"}
Jul 15 19:15:51.191634 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:51.191375    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-crsfn" podStartSLOduration=2.625293738 podStartE2EDuration="4.191355224s" totalImagesPullingTime="1.566061486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:51.190477224 +0000 UTC m=+75.128515694" watchObservedRunningTime="2026-07-15 19:15:51.191355224 +0000 UTC m=+75.129393694"
Jul 15 19:15:52.179421 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.179389    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-669449d7c6-lrdrw"]
Jul 15 19:15:52.181946 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.181926    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.185272 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.184869    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 15 19:15:52.185272 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.184904    2565 generic.go:356] "Generic (PLEG): container finished" podID="698207f2-6e70-4570-a564-822511f6a4aa" containerID="d659cd5ad015f74d632194a9afdcee56151266ad915863126b2810b3bba0f519" exitCode=0
Jul 15 19:15:52.185272 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.184960    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6mcfpbj6if9f6\""
Jul 15 19:15:52.185272 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.184867    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 19:15:52.185272 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.185035    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"698207f2-6e70-4570-a564-822511f6a4aa","Type":"ContainerDied","Data":"d659cd5ad015f74d632194a9afdcee56151266ad915863126b2810b3bba0f519"}
Jul 15 19:15:52.185702 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.185327    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 15 19:15:52.185702 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.185337    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7zbp8\""
Jul 15 19:15:52.185702 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.185435    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 15 19:15:52.188585 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.188495    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z" event={"ID":"77c666ab-c766-4239-90aa-f10646b718b8","Type":"ContainerStarted","Data":"2e5e1a17ec41fab032f737fb925122d33f8a60f14d88d1c7ff43632d78d8a9d5"}
Jul 15 19:15:52.188585 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.188552    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z" event={"ID":"77c666ab-c766-4239-90aa-f10646b718b8","Type":"ContainerStarted","Data":"5d25d49a38fd86e40aba1ce0727334e89b11b6db49b24d5f96ae64c740dde0e0"}
Jul 15 19:15:52.191031 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.191004    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p2rnr" event={"ID":"feb09d05-4fb6-4254-8c5e-600e9de57790","Type":"ContainerStarted","Data":"f46396ad436e912709650fbf06d0e029281dacdbc7391e54e37796f2d103298d"}
Jul 15 19:15:52.191129 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.191087    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p2rnr" event={"ID":"feb09d05-4fb6-4254-8c5e-600e9de57790","Type":"ContainerStarted","Data":"489043a580dc9e989e794e7fcd4632c9d0657d9cd4673f76b80cf99621056d09"}
Jul 15 19:15:52.193469 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.193444    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-669449d7c6-lrdrw"]
Jul 15 19:15:52.228460 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.228409    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-wmb6z" podStartSLOduration=3.546048506 podStartE2EDuration="5.228393864s" totalImagesPullingTime="1.682345358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:52.227400624 +0000 UTC m=+76.165439089" watchObservedRunningTime="2026-07-15 19:15:52.228393864 +0000 UTC m=+76.166432333"
Jul 15 19:15:52.246933 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.246885    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p2rnr" podStartSLOduration=4.162484642 podStartE2EDuration="5.246868594s" totalImagesPullingTime="993.111083ms" totalInitContainerRuntime="91.272869ms" isStatefulPod=true podCreationTimestamp="2026-07-15 19:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:52.246064879 +0000 UTC m=+76.184103361" watchObservedRunningTime="2026-07-15 19:15:52.246868594 +0000 UTC m=+76.184907097"
Jul 15 19:15:52.284253 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.284220    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mczvf\" (UniqueName: \"kubernetes.io/projected/7c5da22f-7255-48f9-9897-20e39b4464e1-kube-api-access-mczvf\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.284652 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.284629    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7c5da22f-7255-48f9-9897-20e39b4464e1-metrics-server-audit-profiles\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.284977 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.284863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c5da22f-7255-48f9-9897-20e39b4464e1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.285102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.285055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7c5da22f-7255-48f9-9897-20e39b4464e1-audit-log\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.285163 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.285132    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c5da22f-7255-48f9-9897-20e39b4464e1-client-ca-bundle\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.285482 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.285321    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7c5da22f-7255-48f9-9897-20e39b4464e1-secret-metrics-server-tls\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.285482 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.285376    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7c5da22f-7255-48f9-9897-20e39b4464e1-secret-metrics-server-client-certs\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.386263 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.386223    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c5da22f-7255-48f9-9897-20e39b4464e1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.386263 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.386269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7c5da22f-7255-48f9-9897-20e39b4464e1-audit-log\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.386487 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.386290    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c5da22f-7255-48f9-9897-20e39b4464e1-client-ca-bundle\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.386487 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.386330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7c5da22f-7255-48f9-9897-20e39b4464e1-secret-metrics-server-tls\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.386487 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.386358    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7c5da22f-7255-48f9-9897-20e39b4464e1-secret-metrics-server-client-certs\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.386621 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.386503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mczvf\" (UniqueName: \"kubernetes.io/projected/7c5da22f-7255-48f9-9897-20e39b4464e1-kube-api-access-mczvf\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.386621 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.386554    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7c5da22f-7255-48f9-9897-20e39b4464e1-metrics-server-audit-profiles\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.386742 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.386718    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7c5da22f-7255-48f9-9897-20e39b4464e1-audit-log\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.387048 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.387014    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c5da22f-7255-48f9-9897-20e39b4464e1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.387372 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.387354    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7c5da22f-7255-48f9-9897-20e39b4464e1-metrics-server-audit-profiles\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.388796 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.388777    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7c5da22f-7255-48f9-9897-20e39b4464e1-client-ca-bundle\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.388875 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.388863    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7c5da22f-7255-48f9-9897-20e39b4464e1-secret-metrics-server-tls\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.389044 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.389024    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7c5da22f-7255-48f9-9897-20e39b4464e1-secret-metrics-server-client-certs\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.396766 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.396735    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mczvf\" (UniqueName: \"kubernetes.io/projected/7c5da22f-7255-48f9-9897-20e39b4464e1-kube-api-access-mczvf\") pod \"metrics-server-669449d7c6-lrdrw\" (UID: \"7c5da22f-7255-48f9-9897-20e39b4464e1\") " pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.494963 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.494880    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:15:52.567939 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.567906    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-lphqw"]
Jul 15 19:15:52.571306 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.571282    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lphqw"
Jul 15 19:15:52.574017 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.573991    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 15 19:15:52.574156 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.573993    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-5btmv\""
Jul 15 19:15:52.582344 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.582315    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-lphqw"]
Jul 15 19:15:52.649570 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.649546    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-669449d7c6-lrdrw"]
Jul 15 19:15:52.651924 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:15:52.651892    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c5da22f_7255_48f9_9897_20e39b4464e1.slice/crio-8bee7d130cc250ce2f3d2a0721499dc60d98eb86fa6d56231bab65a1ca4868a1 WatchSource:0}: Error finding container 8bee7d130cc250ce2f3d2a0721499dc60d98eb86fa6d56231bab65a1ca4868a1: Status 404 returned error can't find the container with id 8bee7d130cc250ce2f3d2a0721499dc60d98eb86fa6d56231bab65a1ca4868a1
Jul 15 19:15:52.688955 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.688928    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m7mz\" (UniqueName: \"kubernetes.io/projected/9ed2432e-1d94-48cc-8104-26f62fdf152b-kube-api-access-2m7mz\") pod \"monitoring-plugin-5f68df7f58-lphqw\" (UID: \"9ed2432e-1d94-48cc-8104-26f62fdf152b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lphqw"
Jul 15 19:15:52.689059 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.688969    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9ed2432e-1d94-48cc-8104-26f62fdf152b-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-lphqw\" (UID: \"9ed2432e-1d94-48cc-8104-26f62fdf152b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lphqw"
Jul 15 19:15:52.790244 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.790156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m7mz\" (UniqueName: \"kubernetes.io/projected/9ed2432e-1d94-48cc-8104-26f62fdf152b-kube-api-access-2m7mz\") pod \"monitoring-plugin-5f68df7f58-lphqw\" (UID: \"9ed2432e-1d94-48cc-8104-26f62fdf152b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lphqw"
Jul 15 19:15:52.790244 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.790236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9ed2432e-1d94-48cc-8104-26f62fdf152b-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-lphqw\" (UID: \"9ed2432e-1d94-48cc-8104-26f62fdf152b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lphqw"
Jul 15 19:15:52.790455 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:52.790390    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 15 19:15:52.790510 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:15:52.790475    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ed2432e-1d94-48cc-8104-26f62fdf152b-monitoring-plugin-cert podName:9ed2432e-1d94-48cc-8104-26f62fdf152b nodeName:}" failed. No retries permitted until 2026-07-15 19:15:53.290452654 +0000 UTC m=+77.228491104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9ed2432e-1d94-48cc-8104-26f62fdf152b-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-lphqw" (UID: "9ed2432e-1d94-48cc-8104-26f62fdf152b") : secret "monitoring-plugin-cert" not found
Jul 15 19:15:52.803300 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.803271    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m7mz\" (UniqueName: \"kubernetes.io/projected/9ed2432e-1d94-48cc-8104-26f62fdf152b-kube-api-access-2m7mz\") pod \"monitoring-plugin-5f68df7f58-lphqw\" (UID: \"9ed2432e-1d94-48cc-8104-26f62fdf152b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lphqw"
Jul 15 19:15:52.994167 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.993944    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-84fc887489-d8mr6"]
Jul 15 19:15:52.996759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.996741    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:52.999386 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.999324    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 15 19:15:52.999533 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.999507    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-snq4j\""
Jul 15 19:15:52.999656 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.999511    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 15 19:15:53.000015 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.999870    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 15 19:15:53.000015 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:52.999909    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 15 19:15:53.000471 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.000272    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 15 19:15:53.004581 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.004560    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 15 19:15:53.016544 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.016478    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84fc887489-d8mr6"]
Jul 15 19:15:53.092223 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.092098    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a5f8957-d340-4d8b-968d-4d076be11482-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.092223 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.092151    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgf26\" (UniqueName: \"kubernetes.io/projected/3a5f8957-d340-4d8b-968d-4d076be11482-kube-api-access-kgf26\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.092464 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.092231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3a5f8957-d340-4d8b-968d-4d076be11482-federate-client-tls\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.092464 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.092260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a5f8957-d340-4d8b-968d-4d076be11482-serving-certs-ca-bundle\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.092464 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.092280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a5f8957-d340-4d8b-968d-4d076be11482-metrics-client-ca\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.092464 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.092345    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3a5f8957-d340-4d8b-968d-4d076be11482-secret-telemeter-client\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.092464 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.092416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3a5f8957-d340-4d8b-968d-4d076be11482-telemeter-client-tls\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.092464 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.092447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a5f8957-d340-4d8b-968d-4d076be11482-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.192924 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.192891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3a5f8957-d340-4d8b-968d-4d076be11482-federate-client-tls\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.193417 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.192936    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a5f8957-d340-4d8b-968d-4d076be11482-serving-certs-ca-bundle\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.193417 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.192963    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a5f8957-d340-4d8b-968d-4d076be11482-metrics-client-ca\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.193417 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.192999    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3a5f8957-d340-4d8b-968d-4d076be11482-secret-telemeter-client\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.193417 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.193061    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3a5f8957-d340-4d8b-968d-4d076be11482-telemeter-client-tls\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.193417 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.193090    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a5f8957-d340-4d8b-968d-4d076be11482-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.193417 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.193159    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a5f8957-d340-4d8b-968d-4d076be11482-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.193417 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.193180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgf26\" (UniqueName: \"kubernetes.io/projected/3a5f8957-d340-4d8b-968d-4d076be11482-kube-api-access-kgf26\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.194223 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.193796    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a5f8957-d340-4d8b-968d-4d076be11482-serving-certs-ca-bundle\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.194223 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.193809    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a5f8957-d340-4d8b-968d-4d076be11482-metrics-client-ca\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.194637 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.194592    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a5f8957-d340-4d8b-968d-4d076be11482-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.195960 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.195936    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3a5f8957-d340-4d8b-968d-4d076be11482-federate-client-tls\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.196220 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.196179    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3a5f8957-d340-4d8b-968d-4d076be11482-telemeter-client-tls\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.196776 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.196753    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a5f8957-d340-4d8b-968d-4d076be11482-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.197410 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.197387    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3a5f8957-d340-4d8b-968d-4d076be11482-secret-telemeter-client\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.198785 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.198758    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw" event={"ID":"7c5da22f-7255-48f9-9897-20e39b4464e1","Type":"ContainerStarted","Data":"8bee7d130cc250ce2f3d2a0721499dc60d98eb86fa6d56231bab65a1ca4868a1"}
Jul 15 19:15:53.203178 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.203148    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgf26\" (UniqueName: \"kubernetes.io/projected/3a5f8957-d340-4d8b-968d-4d076be11482-kube-api-access-kgf26\") pod \"telemeter-client-84fc887489-d8mr6\" (UID: \"3a5f8957-d340-4d8b-968d-4d076be11482\") " pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.294392 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.294358    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9ed2432e-1d94-48cc-8104-26f62fdf152b-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-lphqw\" (UID: \"9ed2432e-1d94-48cc-8104-26f62fdf152b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lphqw"
Jul 15 19:15:53.298623 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.298593    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9ed2432e-1d94-48cc-8104-26f62fdf152b-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-lphqw\" (UID: \"9ed2432e-1d94-48cc-8104-26f62fdf152b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lphqw"
Jul 15 19:15:53.308814 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.308588    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6"
Jul 15 19:15:53.482144 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.482111    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lphqw"
Jul 15 19:15:53.490379 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:53.490298    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84fc887489-d8mr6"]
Jul 15 19:15:53.989092 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:15:53.989052    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a5f8957_d340_4d8b_968d_4d076be11482.slice/crio-d28afc0d083b1477e010d7ec9bce4bb90e01de1e3d5d0a203532a9aa555cefd1 WatchSource:0}: Error finding container d28afc0d083b1477e010d7ec9bce4bb90e01de1e3d5d0a203532a9aa555cefd1: Status 404 returned error can't find the container with id d28afc0d083b1477e010d7ec9bce4bb90e01de1e3d5d0a203532a9aa555cefd1
Jul 15 19:15:54.135436 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.133668    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 19:15:54.139520 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.139500    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.144730 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.142280    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 19:15:54.144730 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.142504    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 19:15:54.147893 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.147271    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 19:15:54.147893 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.147497    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 19:15:54.147893 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.147664    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 19:15:54.147893 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.147750    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 19:15:54.150791 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.148972    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 19:15:54.150791 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.149819    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 19:15:54.150791 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.150455    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 19:15:54.160977 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.157899    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gj8t9\""
Jul 15 19:15:54.160977 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.158389    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c03npkgrmh4f6\""
Jul 15 19:15:54.160977 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.158833    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 19:15:54.160977 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.160579    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 19:15:54.164240 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.164193    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 19:15:54.167230 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.167165    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 19:15:54.169475 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.169271    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 19:15:54.169933 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.169912    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 19:15:54.177628 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.177609    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-lphqw"]
Jul 15 19:15:54.204791 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.204759    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205226 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.204802    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205226 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.204834    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205226 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.204866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205226 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.204890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205226 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.204915    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4746ae07-1627-452c-a572-fd9be0d3fd27-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205226 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.204940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205226 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.204963    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-web-config\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205226 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.205000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205226 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.205022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205226 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.205046    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205226 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.205088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205226 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.205169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-config\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205226 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.205224    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4746ae07-1627-452c-a572-fd9be0d3fd27-config-out\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205861 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.205251    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205861 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.205315    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr7hj\" (UniqueName: \"kubernetes.io/projected/4746ae07-1627-452c-a572-fd9be0d3fd27-kube-api-access-fr7hj\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205861 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.205367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205861 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.205460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205861 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.205510    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.205861 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.205580    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.207479 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.207451    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6" event={"ID":"3a5f8957-d340-4d8b-968d-4d076be11482","Type":"ContainerStarted","Data":"d28afc0d083b1477e010d7ec9bce4bb90e01de1e3d5d0a203532a9aa555cefd1"}
Jul 15 19:15:54.307655 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.306512    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.307655 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.306573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.307655 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.306603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-config\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.307655 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.306627    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4746ae07-1627-452c-a572-fd9be0d3fd27-config-out\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.307655 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.306653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.307655 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.306679    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr7hj\" (UniqueName: \"kubernetes.io/projected/4746ae07-1627-452c-a572-fd9be0d3fd27-kube-api-access-fr7hj\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.307655 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.306707    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.307655 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.306747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.307655 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.306774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.307655 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.306823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.307655 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.306867    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.307655 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.306890    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.307655 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.306918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.307655 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.306945    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.308538 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.306969    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.308538 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.306992    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4746ae07-1627-452c-a572-fd9be0d3fd27-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.308538 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.307014    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.308538 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.307037    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-web-config\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.308538 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.307072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.308538 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.307095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.308538 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.307992    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.311965 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.311937    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-config\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.312639 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.312614    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.313099 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.313071    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.316230 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.313962    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.316230 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.314283    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.316230 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.315032    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.316230 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.315166    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.316230 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.315666    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.316914 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.316273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.316914 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.316810    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.317236 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.316968    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-web-config\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.317236 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.317161    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4746ae07-1627-452c-a572-fd9be0d3fd27-config-out\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.317444 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.317421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4746ae07-1627-452c-a572-fd9be0d3fd27-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.318231 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.317728    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.318231 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.318175    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.319068 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.319043    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.319643 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.319600    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.319738 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.319672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.325504 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.325439    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr7hj\" (UniqueName: \"kubernetes.io/projected/4746ae07-1627-452c-a572-fd9be0d3fd27-kube-api-access-fr7hj\") pod \"prometheus-k8s-0\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.468657 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.468617    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:15:54.761343 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:15:54.761304    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed2432e_1d94_48cc_8104_26f62fdf152b.slice/crio-dc640e6218a26d1fcdac03ea1ab60aea15869ead32a6649268c9c75be997888f WatchSource:0}: Error finding container dc640e6218a26d1fcdac03ea1ab60aea15869ead32a6649268c9c75be997888f: Status 404 returned error can't find the container with id dc640e6218a26d1fcdac03ea1ab60aea15869ead32a6649268c9c75be997888f
Jul 15 19:15:54.938180 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:54.937430    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 19:15:54.948036 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:15:54.948002    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4746ae07_1627_452c_a572_fd9be0d3fd27.slice/crio-96c86b76decf706d84b806a3b425fcd36bdd064ffa7564b02d97e56bcd1232ee WatchSource:0}: Error finding container 96c86b76decf706d84b806a3b425fcd36bdd064ffa7564b02d97e56bcd1232ee: Status 404 returned error can't find the container with id 96c86b76decf706d84b806a3b425fcd36bdd064ffa7564b02d97e56bcd1232ee
Jul 15 19:15:55.214353 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:55.214308    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw" event={"ID":"7c5da22f-7255-48f9-9897-20e39b4464e1","Type":"ContainerStarted","Data":"2a6e010a0dc2474f84c9a6d5d3f1050cc1345f5743ce186273e967fc2f7f35d9"}
Jul 15 19:15:55.216232 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:55.216190    2565 generic.go:356] "Generic (PLEG): container finished" podID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerID="ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7" exitCode=0
Jul 15 19:15:55.216327 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:55.216309    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4746ae07-1627-452c-a572-fd9be0d3fd27","Type":"ContainerDied","Data":"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7"}
Jul 15 19:15:55.216400 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:55.216387    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4746ae07-1627-452c-a572-fd9be0d3fd27","Type":"ContainerStarted","Data":"96c86b76decf706d84b806a3b425fcd36bdd064ffa7564b02d97e56bcd1232ee"}
Jul 15 19:15:55.219060 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:55.219039    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lphqw" event={"ID":"9ed2432e-1d94-48cc-8104-26f62fdf152b","Type":"ContainerStarted","Data":"dc640e6218a26d1fcdac03ea1ab60aea15869ead32a6649268c9c75be997888f"}
Jul 15 19:15:55.222913 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:55.222895    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"698207f2-6e70-4570-a564-822511f6a4aa","Type":"ContainerStarted","Data":"7f6c55f35cf4e38761fed50f227fbf1419a34c7af0514f796b148b873aead70f"}
Jul 15 19:15:55.222998 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:55.222947    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"698207f2-6e70-4570-a564-822511f6a4aa","Type":"ContainerStarted","Data":"d1774de32f11b49a09b15cf607ae0b92f5eafbc46ce31bfde04bab2403640117"}
Jul 15 19:15:55.222998 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:55.222973    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"698207f2-6e70-4570-a564-822511f6a4aa","Type":"ContainerStarted","Data":"cf68ddef3c8bc797f6c1c76b1989f13eba3d365d5b3a7d31cef6322b21778d81"}
Jul 15 19:15:55.223110 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:55.223003    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"698207f2-6e70-4570-a564-822511f6a4aa","Type":"ContainerStarted","Data":"d061501f3d04c39717d5ecbf84dead82ab1a65dcb9b517195e0b7c2177141ebc"}
Jul 15 19:15:55.223110 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:55.223030    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"698207f2-6e70-4570-a564-822511f6a4aa","Type":"ContainerStarted","Data":"c681a17fd71eb5c4407a1c89053a1bb9392ef1e4e532d310fdd7429a3f47527f"}
Jul 15 19:15:55.235427 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:55.235345    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw" podStartSLOduration=1.092781347 podStartE2EDuration="3.235328297s" totalImagesPullingTime="2.14254695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:55.234467944 +0000 UTC m=+79.172506413" watchObservedRunningTime="2026-07-15 19:15:55.235328297 +0000 UTC m=+79.173366766"
Jul 15 19:15:56.231086 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:56.231053    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw" event={"ID":"2929e077-432a-4052-9f8c-ac570d5ab22e","Type":"ContainerStarted","Data":"30063ed8d962de4829d01248014680950268e02e729a6c82780b969e63c62471"}
Jul 15 19:15:56.231469 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:56.231172    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw" event={"ID":"2929e077-432a-4052-9f8c-ac570d5ab22e","Type":"ContainerStarted","Data":"a304d07954f4bafb2b338859222d8a9a955d7b3ed24c338cdf6e083d50912df0"}
Jul 15 19:15:56.231469 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:56.231233    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw" event={"ID":"2929e077-432a-4052-9f8c-ac570d5ab22e","Type":"ContainerStarted","Data":"cb370985a36baa6ab7000f79f0389dfd28fc0774ce7403ae0d5e9bfb2eaaacb9"}
Jul 15 19:15:57.243937 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:57.243548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"698207f2-6e70-4570-a564-822511f6a4aa","Type":"ContainerStarted","Data":"cde4dbec56f1544ecbcc1789fc3308b80b927b5fc4f6ef06aad3e35b4649b4de"}
Jul 15 19:15:57.247954 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:57.247164    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6" event={"ID":"3a5f8957-d340-4d8b-968d-4d076be11482","Type":"ContainerStarted","Data":"e0e4549b43e2dc30d115bcfbf18310c0eb51fcdf6a464d1e066d21b3fabf3805"}
Jul 15 19:15:57.247954 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:57.247259    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6" event={"ID":"3a5f8957-d340-4d8b-968d-4d076be11482","Type":"ContainerStarted","Data":"63a74c4537042169f7f64d473d4044f464b9daa234f2d2101c0b6940299836cd"}
Jul 15 19:15:57.247954 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:57.247293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6" event={"ID":"3a5f8957-d340-4d8b-968d-4d076be11482","Type":"ContainerStarted","Data":"7fbd3551b57c88a9ff96f8e73c1deb959be37d226cf8d942e4cc500b5b424351"}
Jul 15 19:15:57.256351 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:57.256162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw" event={"ID":"2929e077-432a-4052-9f8c-ac570d5ab22e","Type":"ContainerStarted","Data":"9be3780250f7f6195db7761f130ff7af5a7db616213df5822330068406c92dda"}
Jul 15 19:15:57.256351 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:57.256256    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw" event={"ID":"2929e077-432a-4052-9f8c-ac570d5ab22e","Type":"ContainerStarted","Data":"259e0e8fc5b8bb4ad3bdc9385df870f649cfa6a64315e8434d802c3a39d7f99f"}
Jul 15 19:15:57.256351 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:57.256298    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw" event={"ID":"2929e077-432a-4052-9f8c-ac570d5ab22e","Type":"ContainerStarted","Data":"734cc4a8e19b90f5b338b96fd8c6000d57a258b937f8a321202c339c81f3cd4f"}
Jul 15 19:15:57.256651 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:57.256468    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:15:57.303165 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:57.303113    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.170147572 podStartE2EDuration="9.303097469s" totalImagesPullingTime="5.115783723s" totalInitContainerRuntime="17.166174ms" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:57.276099663 +0000 UTC m=+81.214138188" watchObservedRunningTime="2026-07-15 19:15:57.303097469 +0000 UTC m=+81.241135915"
Jul 15 19:15:57.303397 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:57.303279    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-84fc887489-d8mr6" podStartSLOduration=2.327775729 podStartE2EDuration="5.303273893s" totalImagesPullingTime="2.975498164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:57.301845691 +0000 UTC m=+81.239884162" watchObservedRunningTime="2026-07-15 19:15:57.303273893 +0000 UTC m=+81.241312364"
Jul 15 19:15:58.263547 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:58.263426    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lphqw" event={"ID":"9ed2432e-1d94-48cc-8104-26f62fdf152b","Type":"ContainerStarted","Data":"2326e21dfd5d5a783f0c6b46379b329bf3100469ebabcfefe59f8002cdfc776f"}
Jul 15 19:15:58.264409 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:58.264348    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lphqw"
Jul 15 19:15:58.272579 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:58.272541    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lphqw"
Jul 15 19:15:58.295457 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:58.294491    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw" podStartSLOduration=2.952282356 podStartE2EDuration="9.294469289s" totalImagesPullingTime="6.342186933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:57.331020151 +0000 UTC m=+81.269058620" watchObservedRunningTime="2026-07-15 19:15:58.294469289 +0000 UTC m=+82.232507756"
Jul 15 19:15:58.296781 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:15:58.296671    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lphqw" podStartSLOduration=2.9617521350000002 podStartE2EDuration="6.296656512s" totalImagesPullingTime="3.334904377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:15:58.295841613 +0000 UTC m=+82.233880086" watchObservedRunningTime="2026-07-15 19:15:58.296656512 +0000 UTC m=+82.234694982"
Jul 15 19:16:01.284697 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:01.284612    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4746ae07-1627-452c-a572-fd9be0d3fd27","Type":"ContainerStarted","Data":"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada"}
Jul 15 19:16:01.284697 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:01.284694    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4746ae07-1627-452c-a572-fd9be0d3fd27","Type":"ContainerStarted","Data":"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8"}
Jul 15 19:16:01.285107 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:01.284731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4746ae07-1627-452c-a572-fd9be0d3fd27","Type":"ContainerStarted","Data":"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c"}
Jul 15 19:16:01.285107 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:01.284767    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4746ae07-1627-452c-a572-fd9be0d3fd27","Type":"ContainerStarted","Data":"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47"}
Jul 15 19:16:01.285107 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:01.284809    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4746ae07-1627-452c-a572-fd9be0d3fd27","Type":"ContainerStarted","Data":"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452"}
Jul 15 19:16:01.285107 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:01.284846    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4746ae07-1627-452c-a572-fd9be0d3fd27","Type":"ContainerStarted","Data":"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c"}
Jul 15 19:16:01.321043 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:01.320991    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.777766208 podStartE2EDuration="7.320975525s" totalImagesPullingTime="5.515582335s" totalInitContainerRuntime="27.626982ms" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:01.318305032 +0000 UTC m=+85.256343502" watchObservedRunningTime="2026-07-15 19:16:01.320975525 +0000 UTC m=+85.259013994"
Jul 15 19:16:03.271191 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:03.271161    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-569d4cb59c-65njw"
Jul 15 19:16:04.469627 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:04.469597    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:16:11.337153 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:11.337113    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-b6tsh" event={"ID":"1220340b-be76-4b6b-a382-49ec608a1054","Type":"ContainerStarted","Data":"edfdbc44cd6ebba73c3770fd237969a9e6873272158513bacd7e96cf9ea3086b"}
Jul 15 19:16:11.337671 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:11.337491    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-b6tsh"
Jul 15 19:16:11.351854 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:11.351830    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-b6tsh"
Jul 15 19:16:11.357344 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:11.357306    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-b6tsh" podStartSLOduration=3.879537606 podStartE2EDuration="25.357290972s" totalImagesPullingTime="21.477753366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:11.35624467 +0000 UTC m=+95.294283132" watchObservedRunningTime="2026-07-15 19:16:11.357290972 +0000 UTC m=+95.295329441"
Jul 15 19:16:12.495835 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:12.495799    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:16:12.496322 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:12.495865    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:16:22.193612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:22.193582    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n844l"
Jul 15 19:16:32.500634 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:32.500599    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:16:32.504470 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:32.504445    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-669449d7c6-lrdrw"
Jul 15 19:16:54.469355 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:54.469317    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:16:54.526625 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:54.526599    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:16:54.541380 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:16:54.541346    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:08.267523 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:08.267489    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 19:17:08.268077 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:08.267863    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="alertmanager" containerID="cri-o://c681a17fd71eb5c4407a1c89053a1bb9392ef1e4e532d310fdd7429a3f47527f" gracePeriod=120
Jul 15 19:17:08.268077 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:08.267986    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="kube-rbac-proxy" containerID="cri-o://d1774de32f11b49a09b15cf607ae0b92f5eafbc46ce31bfde04bab2403640117" gracePeriod=120
Jul 15 19:17:08.268251 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:08.268084    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="kube-rbac-proxy-web" containerID="cri-o://cf68ddef3c8bc797f6c1c76b1989f13eba3d365d5b3a7d31cef6322b21778d81" gracePeriod=120
Jul 15 19:17:08.268251 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:08.268139    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="kube-rbac-proxy-metric" containerID="cri-o://7f6c55f35cf4e38761fed50f227fbf1419a34c7af0514f796b148b873aead70f" gracePeriod=120
Jul 15 19:17:08.268251 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:08.268155    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="config-reloader" containerID="cri-o://d061501f3d04c39717d5ecbf84dead82ab1a65dcb9b517195e0b7c2177141ebc" gracePeriod=120
Jul 15 19:17:08.268416 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:08.268067    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="prom-label-proxy" containerID="cri-o://cde4dbec56f1544ecbcc1789fc3308b80b927b5fc4f6ef06aad3e35b4649b4de" gracePeriod=120
Jul 15 19:17:08.589281 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:08.589172    2565 generic.go:356] "Generic (PLEG): container finished" podID="698207f2-6e70-4570-a564-822511f6a4aa" containerID="cde4dbec56f1544ecbcc1789fc3308b80b927b5fc4f6ef06aad3e35b4649b4de" exitCode=0
Jul 15 19:17:08.589281 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:08.589211    2565 generic.go:356] "Generic (PLEG): container finished" podID="698207f2-6e70-4570-a564-822511f6a4aa" containerID="d1774de32f11b49a09b15cf607ae0b92f5eafbc46ce31bfde04bab2403640117" exitCode=0
Jul 15 19:17:08.589281 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:08.589219    2565 generic.go:356] "Generic (PLEG): container finished" podID="698207f2-6e70-4570-a564-822511f6a4aa" containerID="d061501f3d04c39717d5ecbf84dead82ab1a65dcb9b517195e0b7c2177141ebc" exitCode=0
Jul 15 19:17:08.589281 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:08.589229    2565 generic.go:356] "Generic (PLEG): container finished" podID="698207f2-6e70-4570-a564-822511f6a4aa" containerID="c681a17fd71eb5c4407a1c89053a1bb9392ef1e4e532d310fdd7429a3f47527f" exitCode=0
Jul 15 19:17:08.589281 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:08.589236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"698207f2-6e70-4570-a564-822511f6a4aa","Type":"ContainerDied","Data":"cde4dbec56f1544ecbcc1789fc3308b80b927b5fc4f6ef06aad3e35b4649b4de"}
Jul 15 19:17:08.589564 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:08.589317    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"698207f2-6e70-4570-a564-822511f6a4aa","Type":"ContainerDied","Data":"d1774de32f11b49a09b15cf607ae0b92f5eafbc46ce31bfde04bab2403640117"}
Jul 15 19:17:08.589564 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:08.589355    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"698207f2-6e70-4570-a564-822511f6a4aa","Type":"ContainerDied","Data":"d061501f3d04c39717d5ecbf84dead82ab1a65dcb9b517195e0b7c2177141ebc"}
Jul 15 19:17:08.589564 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:08.589392    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"698207f2-6e70-4570-a564-822511f6a4aa","Type":"ContainerDied","Data":"c681a17fd71eb5c4407a1c89053a1bb9392ef1e4e532d310fdd7429a3f47527f"}
Jul 15 19:17:09.516006 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.515983    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.567230 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.567133    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-kube-rbac-proxy\") pod \"698207f2-6e70-4570-a564-822511f6a4aa\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") "
Jul 15 19:17:09.567230 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.567177    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/698207f2-6e70-4570-a564-822511f6a4aa-alertmanager-main-db\") pod \"698207f2-6e70-4570-a564-822511f6a4aa\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") "
Jul 15 19:17:09.567230 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.567213    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-main-tls\") pod \"698207f2-6e70-4570-a564-822511f6a4aa\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") "
Jul 15 19:17:09.567498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.567241    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-config-volume\") pod \"698207f2-6e70-4570-a564-822511f6a4aa\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") "
Jul 15 19:17:09.567498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.567270    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-web-config\") pod \"698207f2-6e70-4570-a564-822511f6a4aa\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") "
Jul 15 19:17:09.567498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.567315    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5hrz\" (UniqueName: \"kubernetes.io/projected/698207f2-6e70-4570-a564-822511f6a4aa-kube-api-access-j5hrz\") pod \"698207f2-6e70-4570-a564-822511f6a4aa\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") "
Jul 15 19:17:09.567498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.567339    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/698207f2-6e70-4570-a564-822511f6a4aa-config-out\") pod \"698207f2-6e70-4570-a564-822511f6a4aa\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") "
Jul 15 19:17:09.567498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.567391    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/698207f2-6e70-4570-a564-822511f6a4aa-metrics-client-ca\") pod \"698207f2-6e70-4570-a564-822511f6a4aa\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") "
Jul 15 19:17:09.567498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.567422    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-kube-rbac-proxy-web\") pod \"698207f2-6e70-4570-a564-822511f6a4aa\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") "
Jul 15 19:17:09.567498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.567450    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"698207f2-6e70-4570-a564-822511f6a4aa\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") "
Jul 15 19:17:09.567498 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.567480    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/698207f2-6e70-4570-a564-822511f6a4aa-tls-assets\") pod \"698207f2-6e70-4570-a564-822511f6a4aa\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") "
Jul 15 19:17:09.567942 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.567511    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-cluster-tls-config\") pod \"698207f2-6e70-4570-a564-822511f6a4aa\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") "
Jul 15 19:17:09.567942 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.567522    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/698207f2-6e70-4570-a564-822511f6a4aa-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "698207f2-6e70-4570-a564-822511f6a4aa" (UID: "698207f2-6e70-4570-a564-822511f6a4aa"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:17:09.567942 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.567545    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/698207f2-6e70-4570-a564-822511f6a4aa-alertmanager-trusted-ca-bundle\") pod \"698207f2-6e70-4570-a564-822511f6a4aa\" (UID: \"698207f2-6e70-4570-a564-822511f6a4aa\") "
Jul 15 19:17:09.567942 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.567847    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/698207f2-6e70-4570-a564-822511f6a4aa-alertmanager-main-db\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:09.568197 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.568169    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/698207f2-6e70-4570-a564-822511f6a4aa-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "698207f2-6e70-4570-a564-822511f6a4aa" (UID: "698207f2-6e70-4570-a564-822511f6a4aa"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:17:09.568297 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.568249    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/698207f2-6e70-4570-a564-822511f6a4aa-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "698207f2-6e70-4570-a564-822511f6a4aa" (UID: "698207f2-6e70-4570-a564-822511f6a4aa"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:17:09.572664 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.572626    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/698207f2-6e70-4570-a564-822511f6a4aa-config-out" (OuterVolumeSpecName: "config-out") pod "698207f2-6e70-4570-a564-822511f6a4aa" (UID: "698207f2-6e70-4570-a564-822511f6a4aa"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:17:09.572960 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.572819    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "698207f2-6e70-4570-a564-822511f6a4aa" (UID: "698207f2-6e70-4570-a564-822511f6a4aa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:17:09.573042 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.572972    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/698207f2-6e70-4570-a564-822511f6a4aa-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "698207f2-6e70-4570-a564-822511f6a4aa" (UID: "698207f2-6e70-4570-a564-822511f6a4aa"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:17:09.573099 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.573046    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/698207f2-6e70-4570-a564-822511f6a4aa-kube-api-access-j5hrz" (OuterVolumeSpecName: "kube-api-access-j5hrz") pod "698207f2-6e70-4570-a564-822511f6a4aa" (UID: "698207f2-6e70-4570-a564-822511f6a4aa"). InnerVolumeSpecName "kube-api-access-j5hrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:17:09.573289 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.573249    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "698207f2-6e70-4570-a564-822511f6a4aa" (UID: "698207f2-6e70-4570-a564-822511f6a4aa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:17:09.573388 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.573364    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "698207f2-6e70-4570-a564-822511f6a4aa" (UID: "698207f2-6e70-4570-a564-822511f6a4aa"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:17:09.573511 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.573482    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-config-volume" (OuterVolumeSpecName: "config-volume") pod "698207f2-6e70-4570-a564-822511f6a4aa" (UID: "698207f2-6e70-4570-a564-822511f6a4aa"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:17:09.574079 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.574051    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "698207f2-6e70-4570-a564-822511f6a4aa" (UID: "698207f2-6e70-4570-a564-822511f6a4aa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:17:09.578156 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.578131    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "698207f2-6e70-4570-a564-822511f6a4aa" (UID: "698207f2-6e70-4570-a564-822511f6a4aa"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:17:09.583719 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.583692    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-web-config" (OuterVolumeSpecName: "web-config") pod "698207f2-6e70-4570-a564-822511f6a4aa" (UID: "698207f2-6e70-4570-a564-822511f6a4aa"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:17:09.596529 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.596503    2565 generic.go:356] "Generic (PLEG): container finished" podID="698207f2-6e70-4570-a564-822511f6a4aa" containerID="7f6c55f35cf4e38761fed50f227fbf1419a34c7af0514f796b148b873aead70f" exitCode=0
Jul 15 19:17:09.596529 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.596525    2565 generic.go:356] "Generic (PLEG): container finished" podID="698207f2-6e70-4570-a564-822511f6a4aa" containerID="cf68ddef3c8bc797f6c1c76b1989f13eba3d365d5b3a7d31cef6322b21778d81" exitCode=0
Jul 15 19:17:09.596677 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.596591    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"698207f2-6e70-4570-a564-822511f6a4aa","Type":"ContainerDied","Data":"7f6c55f35cf4e38761fed50f227fbf1419a34c7af0514f796b148b873aead70f"}
Jul 15 19:17:09.596677 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.596616    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.596738 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.596682    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"698207f2-6e70-4570-a564-822511f6a4aa","Type":"ContainerDied","Data":"cf68ddef3c8bc797f6c1c76b1989f13eba3d365d5b3a7d31cef6322b21778d81"}
Jul 15 19:17:09.596738 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.596727    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"698207f2-6e70-4570-a564-822511f6a4aa","Type":"ContainerDied","Data":"5c76af261aa13e6f7e47f37e7966c090d26a7e5f67fce2ad794e36305f30c9c2"}
Jul 15 19:17:09.596800 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.596747    2565 scope.go:117] "RemoveContainer" containerID="cde4dbec56f1544ecbcc1789fc3308b80b927b5fc4f6ef06aad3e35b4649b4de"
Jul 15 19:17:09.605861 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.605842    2565 scope.go:117] "RemoveContainer" containerID="7f6c55f35cf4e38761fed50f227fbf1419a34c7af0514f796b148b873aead70f"
Jul 15 19:17:09.612916 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.612899    2565 scope.go:117] "RemoveContainer" containerID="d1774de32f11b49a09b15cf607ae0b92f5eafbc46ce31bfde04bab2403640117"
Jul 15 19:17:09.619636 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.619620    2565 scope.go:117] "RemoveContainer" containerID="cf68ddef3c8bc797f6c1c76b1989f13eba3d365d5b3a7d31cef6322b21778d81"
Jul 15 19:17:09.623045 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.623024    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 19:17:09.627454 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.627433    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 19:17:09.628449 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.628431    2565 scope.go:117] "RemoveContainer" containerID="d061501f3d04c39717d5ecbf84dead82ab1a65dcb9b517195e0b7c2177141ebc"
Jul 15 19:17:09.635397 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.635380    2565 scope.go:117] "RemoveContainer" containerID="c681a17fd71eb5c4407a1c89053a1bb9392ef1e4e532d310fdd7429a3f47527f"
Jul 15 19:17:09.642307 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.642292    2565 scope.go:117] "RemoveContainer" containerID="d659cd5ad015f74d632194a9afdcee56151266ad915863126b2810b3bba0f519"
Jul 15 19:17:09.649456 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.649436    2565 scope.go:117] "RemoveContainer" containerID="cde4dbec56f1544ecbcc1789fc3308b80b927b5fc4f6ef06aad3e35b4649b4de"
Jul 15 19:17:09.649722 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:17:09.649699    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cde4dbec56f1544ecbcc1789fc3308b80b927b5fc4f6ef06aad3e35b4649b4de\": container with ID starting with cde4dbec56f1544ecbcc1789fc3308b80b927b5fc4f6ef06aad3e35b4649b4de not found: ID does not exist" containerID="cde4dbec56f1544ecbcc1789fc3308b80b927b5fc4f6ef06aad3e35b4649b4de"
Jul 15 19:17:09.649767 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.649732    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cde4dbec56f1544ecbcc1789fc3308b80b927b5fc4f6ef06aad3e35b4649b4de"} err="failed to get container status \"cde4dbec56f1544ecbcc1789fc3308b80b927b5fc4f6ef06aad3e35b4649b4de\": rpc error: code = NotFound desc = could not find container \"cde4dbec56f1544ecbcc1789fc3308b80b927b5fc4f6ef06aad3e35b4649b4de\": container with ID starting with cde4dbec56f1544ecbcc1789fc3308b80b927b5fc4f6ef06aad3e35b4649b4de not found: ID does not exist"
Jul 15 19:17:09.649814 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.649767    2565 scope.go:117] "RemoveContainer" containerID="7f6c55f35cf4e38761fed50f227fbf1419a34c7af0514f796b148b873aead70f"
Jul 15 19:17:09.649984 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:17:09.649965    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f6c55f35cf4e38761fed50f227fbf1419a34c7af0514f796b148b873aead70f\": container with ID starting with 7f6c55f35cf4e38761fed50f227fbf1419a34c7af0514f796b148b873aead70f not found: ID does not exist" containerID="7f6c55f35cf4e38761fed50f227fbf1419a34c7af0514f796b148b873aead70f"
Jul 15 19:17:09.650034 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.649985    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f6c55f35cf4e38761fed50f227fbf1419a34c7af0514f796b148b873aead70f"} err="failed to get container status \"7f6c55f35cf4e38761fed50f227fbf1419a34c7af0514f796b148b873aead70f\": rpc error: code = NotFound desc = could not find container \"7f6c55f35cf4e38761fed50f227fbf1419a34c7af0514f796b148b873aead70f\": container with ID starting with 7f6c55f35cf4e38761fed50f227fbf1419a34c7af0514f796b148b873aead70f not found: ID does not exist"
Jul 15 19:17:09.650034 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.649998    2565 scope.go:117] "RemoveContainer" containerID="d1774de32f11b49a09b15cf607ae0b92f5eafbc46ce31bfde04bab2403640117"
Jul 15 19:17:09.650196 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:17:09.650180    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1774de32f11b49a09b15cf607ae0b92f5eafbc46ce31bfde04bab2403640117\": container with ID starting with d1774de32f11b49a09b15cf607ae0b92f5eafbc46ce31bfde04bab2403640117 not found: ID does not exist" containerID="d1774de32f11b49a09b15cf607ae0b92f5eafbc46ce31bfde04bab2403640117"
Jul 15 19:17:09.650196 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.650220    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1774de32f11b49a09b15cf607ae0b92f5eafbc46ce31bfde04bab2403640117"} err="failed to get container status \"d1774de32f11b49a09b15cf607ae0b92f5eafbc46ce31bfde04bab2403640117\": rpc error: code = NotFound desc = could not find container \"d1774de32f11b49a09b15cf607ae0b92f5eafbc46ce31bfde04bab2403640117\": container with ID starting with d1774de32f11b49a09b15cf607ae0b92f5eafbc46ce31bfde04bab2403640117 not found: ID does not exist"
Jul 15 19:17:09.650196 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.650241    2565 scope.go:117] "RemoveContainer" containerID="cf68ddef3c8bc797f6c1c76b1989f13eba3d365d5b3a7d31cef6322b21778d81"
Jul 15 19:17:09.650465 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:17:09.650450    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf68ddef3c8bc797f6c1c76b1989f13eba3d365d5b3a7d31cef6322b21778d81\": container with ID starting with cf68ddef3c8bc797f6c1c76b1989f13eba3d365d5b3a7d31cef6322b21778d81 not found: ID does not exist" containerID="cf68ddef3c8bc797f6c1c76b1989f13eba3d365d5b3a7d31cef6322b21778d81"
Jul 15 19:17:09.650508 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.650468    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf68ddef3c8bc797f6c1c76b1989f13eba3d365d5b3a7d31cef6322b21778d81"} err="failed to get container status \"cf68ddef3c8bc797f6c1c76b1989f13eba3d365d5b3a7d31cef6322b21778d81\": rpc error: code = NotFound desc = could not find container \"cf68ddef3c8bc797f6c1c76b1989f13eba3d365d5b3a7d31cef6322b21778d81\": container with ID starting with cf68ddef3c8bc797f6c1c76b1989f13eba3d365d5b3a7d31cef6322b21778d81 not found: ID does not exist"
Jul 15 19:17:09.650508 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.650481    2565 scope.go:117] "RemoveContainer" containerID="d061501f3d04c39717d5ecbf84dead82ab1a65dcb9b517195e0b7c2177141ebc"
Jul 15 19:17:09.650682 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:17:09.650664    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d061501f3d04c39717d5ecbf84dead82ab1a65dcb9b517195e0b7c2177141ebc\": container with ID starting with d061501f3d04c39717d5ecbf84dead82ab1a65dcb9b517195e0b7c2177141ebc not found: ID does not exist" containerID="d061501f3d04c39717d5ecbf84dead82ab1a65dcb9b517195e0b7c2177141ebc"
Jul 15 19:17:09.650730 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.650688    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d061501f3d04c39717d5ecbf84dead82ab1a65dcb9b517195e0b7c2177141ebc"} err="failed to get container status \"d061501f3d04c39717d5ecbf84dead82ab1a65dcb9b517195e0b7c2177141ebc\": rpc error: code = NotFound desc = could not find container \"d061501f3d04c39717d5ecbf84dead82ab1a65dcb9b517195e0b7c2177141ebc\": container with ID starting with d061501f3d04c39717d5ecbf84dead82ab1a65dcb9b517195e0b7c2177141ebc not found: ID does not exist"
Jul 15 19:17:09.650730 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.650704    2565 scope.go:117] "RemoveContainer" containerID="c681a17fd71eb5c4407a1c89053a1bb9392ef1e4e532d310fdd7429a3f47527f"
Jul 15 19:17:09.650918 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:17:09.650903    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c681a17fd71eb5c4407a1c89053a1bb9392ef1e4e532d310fdd7429a3f47527f\": container with ID starting with c681a17fd71eb5c4407a1c89053a1bb9392ef1e4e532d310fdd7429a3f47527f not found: ID does not exist" containerID="c681a17fd71eb5c4407a1c89053a1bb9392ef1e4e532d310fdd7429a3f47527f"
Jul 15 19:17:09.650961 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.650922    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c681a17fd71eb5c4407a1c89053a1bb9392ef1e4e532d310fdd7429a3f47527f"} err="failed to get container status \"c681a17fd71eb5c4407a1c89053a1bb9392ef1e4e532d310fdd7429a3f47527f\": rpc error: code = NotFound desc = could not find container \"c681a17fd71eb5c4407a1c89053a1bb9392ef1e4e532d310fdd7429a3f47527f\": container with ID starting with c681a17fd71eb5c4407a1c89053a1bb9392ef1e4e532d310fdd7429a3f47527f not found: ID does not exist"
Jul 15 19:17:09.650961 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.650935    2565 scope.go:117] "RemoveContainer" containerID="d659cd5ad015f74d632194a9afdcee56151266ad915863126b2810b3bba0f519"
Jul 15 19:17:09.651119 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:17:09.651106    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d659cd5ad015f74d632194a9afdcee56151266ad915863126b2810b3bba0f519\": container with ID starting with d659cd5ad015f74d632194a9afdcee56151266ad915863126b2810b3bba0f519 not found: ID does not exist" containerID="d659cd5ad015f74d632194a9afdcee56151266ad915863126b2810b3bba0f519"
Jul 15 19:17:09.651156 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.651122    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d659cd5ad015f74d632194a9afdcee56151266ad915863126b2810b3bba0f519"} err="failed to get container status \"d659cd5ad015f74d632194a9afdcee56151266ad915863126b2810b3bba0f519\": rpc error: code = NotFound desc = could not find container \"d659cd5ad015f74d632194a9afdcee56151266ad915863126b2810b3bba0f519\": container with ID starting with d659cd5ad015f74d632194a9afdcee56151266ad915863126b2810b3bba0f519 not found: ID does not exist"
Jul 15 19:17:09.651156 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.651135    2565 scope.go:117] "RemoveContainer" containerID="cde4dbec56f1544ecbcc1789fc3308b80b927b5fc4f6ef06aad3e35b4649b4de"
Jul 15 19:17:09.651350 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.651334    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cde4dbec56f1544ecbcc1789fc3308b80b927b5fc4f6ef06aad3e35b4649b4de"} err="failed to get container status \"cde4dbec56f1544ecbcc1789fc3308b80b927b5fc4f6ef06aad3e35b4649b4de\": rpc error: code = NotFound desc = could not find container \"cde4dbec56f1544ecbcc1789fc3308b80b927b5fc4f6ef06aad3e35b4649b4de\": container with ID starting with cde4dbec56f1544ecbcc1789fc3308b80b927b5fc4f6ef06aad3e35b4649b4de not found: ID does not exist"
Jul 15 19:17:09.651389 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.651351    2565 scope.go:117] "RemoveContainer" containerID="7f6c55f35cf4e38761fed50f227fbf1419a34c7af0514f796b148b873aead70f"
Jul 15 19:17:09.651562 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.651545    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f6c55f35cf4e38761fed50f227fbf1419a34c7af0514f796b148b873aead70f"} err="failed to get container status \"7f6c55f35cf4e38761fed50f227fbf1419a34c7af0514f796b148b873aead70f\": rpc error: code = NotFound desc = could not find container \"7f6c55f35cf4e38761fed50f227fbf1419a34c7af0514f796b148b873aead70f\": container with ID starting with 7f6c55f35cf4e38761fed50f227fbf1419a34c7af0514f796b148b873aead70f not found: ID does not exist"
Jul 15 19:17:09.651634 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.651564    2565 scope.go:117] "RemoveContainer" containerID="d1774de32f11b49a09b15cf607ae0b92f5eafbc46ce31bfde04bab2403640117"
Jul 15 19:17:09.651777 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.651762    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1774de32f11b49a09b15cf607ae0b92f5eafbc46ce31bfde04bab2403640117"} err="failed to get container status \"d1774de32f11b49a09b15cf607ae0b92f5eafbc46ce31bfde04bab2403640117\": rpc error: code = NotFound desc = could not find container \"d1774de32f11b49a09b15cf607ae0b92f5eafbc46ce31bfde04bab2403640117\": container with ID starting with d1774de32f11b49a09b15cf607ae0b92f5eafbc46ce31bfde04bab2403640117 not found: ID does not exist"
Jul 15 19:17:09.651821 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.651779    2565 scope.go:117] "RemoveContainer" containerID="cf68ddef3c8bc797f6c1c76b1989f13eba3d365d5b3a7d31cef6322b21778d81"
Jul 15 19:17:09.652012 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.651994    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf68ddef3c8bc797f6c1c76b1989f13eba3d365d5b3a7d31cef6322b21778d81"} err="failed to get container status \"cf68ddef3c8bc797f6c1c76b1989f13eba3d365d5b3a7d31cef6322b21778d81\": rpc error: code = NotFound desc = could not find container \"cf68ddef3c8bc797f6c1c76b1989f13eba3d365d5b3a7d31cef6322b21778d81\": container with ID starting with cf68ddef3c8bc797f6c1c76b1989f13eba3d365d5b3a7d31cef6322b21778d81 not found: ID does not exist"
Jul 15 19:17:09.652083 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.652015    2565 scope.go:117] "RemoveContainer" containerID="d061501f3d04c39717d5ecbf84dead82ab1a65dcb9b517195e0b7c2177141ebc"
Jul 15 19:17:09.652289 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.652196    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d061501f3d04c39717d5ecbf84dead82ab1a65dcb9b517195e0b7c2177141ebc"} err="failed to get container status \"d061501f3d04c39717d5ecbf84dead82ab1a65dcb9b517195e0b7c2177141ebc\": rpc error: code = NotFound desc = could not find container \"d061501f3d04c39717d5ecbf84dead82ab1a65dcb9b517195e0b7c2177141ebc\": container with ID starting with d061501f3d04c39717d5ecbf84dead82ab1a65dcb9b517195e0b7c2177141ebc not found: ID does not exist"
Jul 15 19:17:09.652289 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.652246    2565 scope.go:117] "RemoveContainer" containerID="c681a17fd71eb5c4407a1c89053a1bb9392ef1e4e532d310fdd7429a3f47527f"
Jul 15 19:17:09.652485 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.652467    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c681a17fd71eb5c4407a1c89053a1bb9392ef1e4e532d310fdd7429a3f47527f"} err="failed to get container status \"c681a17fd71eb5c4407a1c89053a1bb9392ef1e4e532d310fdd7429a3f47527f\": rpc error: code = NotFound desc = could not find container \"c681a17fd71eb5c4407a1c89053a1bb9392ef1e4e532d310fdd7429a3f47527f\": container with ID starting with c681a17fd71eb5c4407a1c89053a1bb9392ef1e4e532d310fdd7429a3f47527f not found: ID does not exist"
Jul 15 19:17:09.652537 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.652486    2565 scope.go:117] "RemoveContainer" containerID="d659cd5ad015f74d632194a9afdcee56151266ad915863126b2810b3bba0f519"
Jul 15 19:17:09.652677 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.652658    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d659cd5ad015f74d632194a9afdcee56151266ad915863126b2810b3bba0f519"} err="failed to get container status \"d659cd5ad015f74d632194a9afdcee56151266ad915863126b2810b3bba0f519\": rpc error: code = NotFound desc = could not find container \"d659cd5ad015f74d632194a9afdcee56151266ad915863126b2810b3bba0f519\": container with ID starting with d659cd5ad015f74d632194a9afdcee56151266ad915863126b2810b3bba0f519 not found: ID does not exist"
Jul 15 19:17:09.657287 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657268    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 19:17:09.657595 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657580    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="init-config-reloader"
Jul 15 19:17:09.657636 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657599    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="init-config-reloader"
Jul 15 19:17:09.657636 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657611    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="config-reloader"
Jul 15 19:17:09.657636 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657619    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="config-reloader"
Jul 15 19:17:09.657636 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657625    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="kube-rbac-proxy-metric"
Jul 15 19:17:09.657636 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657631    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="kube-rbac-proxy-metric"
Jul 15 19:17:09.657779 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657641    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="kube-rbac-proxy"
Jul 15 19:17:09.657779 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657647    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="kube-rbac-proxy"
Jul 15 19:17:09.657779 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657658    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="kube-rbac-proxy-web"
Jul 15 19:17:09.657779 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657663    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="kube-rbac-proxy-web"
Jul 15 19:17:09.657779 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657680    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="alertmanager"
Jul 15 19:17:09.657779 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657692    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="alertmanager"
Jul 15 19:17:09.657779 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657703    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="prom-label-proxy"
Jul 15 19:17:09.657779 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657708    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="prom-label-proxy"
Jul 15 19:17:09.657779 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657755    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="kube-rbac-proxy-web"
Jul 15 19:17:09.657779 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657765    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="alertmanager"
Jul 15 19:17:09.657779 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657771    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="config-reloader"
Jul 15 19:17:09.657779 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657775    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="kube-rbac-proxy-metric"
Jul 15 19:17:09.657779 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657782    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="prom-label-proxy"
Jul 15 19:17:09.658124 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.657787    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="698207f2-6e70-4570-a564-822511f6a4aa" containerName="kube-rbac-proxy"
Jul 15 19:17:09.667037 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.667013    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.668276 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24c78229-a44a-49eb-9ebd-4a3ec843a88a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.668361 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668297    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24c78229-a44a-49eb-9ebd-4a3ec843a88a-config-out\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.668361 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668351    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-web-config\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.668430 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668396    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.668430 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24c78229-a44a-49eb-9ebd-4a3ec843a88a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.668507 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668470    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.668507 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7xjc\" (UniqueName: \"kubernetes.io/projected/24c78229-a44a-49eb-9ebd-4a3ec843a88a-kube-api-access-m7xjc\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.668577 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668532    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.668577 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.668640 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668574    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24c78229-a44a-49eb-9ebd-4a3ec843a88a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.668640 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-config-volume\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.668640 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24c78229-a44a-49eb-9ebd-4a3ec843a88a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.668640 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.668753 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668675    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5hrz\" (UniqueName: \"kubernetes.io/projected/698207f2-6e70-4570-a564-822511f6a4aa-kube-api-access-j5hrz\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:09.668753 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668686    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/698207f2-6e70-4570-a564-822511f6a4aa-config-out\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:09.668753 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668695    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/698207f2-6e70-4570-a564-822511f6a4aa-metrics-client-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:09.668753 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668703    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:09.668753 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668712    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:09.668753 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668720    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/698207f2-6e70-4570-a564-822511f6a4aa-tls-assets\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:09.668753 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668729    2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-cluster-tls-config\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:09.668753 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668737    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/698207f2-6e70-4570-a564-822511f6a4aa-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:09.668753 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668746    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:09.668753 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668754    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-secret-alertmanager-main-tls\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:09.669027 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668763    2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-config-volume\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:09.669027 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.668770    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/698207f2-6e70-4570-a564-822511f6a4aa-web-config\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:09.669573 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.669559    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 15 19:17:09.669817 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.669796    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 15 19:17:09.669817 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.669812    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 15 19:17:09.670011 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.669895    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 15 19:17:09.670011 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.669896    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 15 19:17:09.670011 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.669958    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 15 19:17:09.670011 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.669975    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 15 19:17:09.672378 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.670023    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r4m4h\""
Jul 15 19:17:09.672378 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.670130    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 15 19:17:09.675973 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.675954    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 15 19:17:09.676219 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.676182    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 19:17:09.769559 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.769530    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24c78229-a44a-49eb-9ebd-4a3ec843a88a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.769712 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.769566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.769712 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.769589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24c78229-a44a-49eb-9ebd-4a3ec843a88a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.769712 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.769698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24c78229-a44a-49eb-9ebd-4a3ec843a88a-config-out\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.769859 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.769745    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-web-config\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.769859 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.769782    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.769859 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.769808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24c78229-a44a-49eb-9ebd-4a3ec843a88a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.769859 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.769850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.770046 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.769884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7xjc\" (UniqueName: \"kubernetes.io/projected/24c78229-a44a-49eb-9ebd-4a3ec843a88a-kube-api-access-m7xjc\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.770046 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.769923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.770046 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.769975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.770046 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.769998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24c78229-a44a-49eb-9ebd-4a3ec843a88a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.770046 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.770025    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-config-volume\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.770327 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.770192    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24c78229-a44a-49eb-9ebd-4a3ec843a88a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.771860 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.771829    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24c78229-a44a-49eb-9ebd-4a3ec843a88a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.772724 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.772690    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.772847 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.772803    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24c78229-a44a-49eb-9ebd-4a3ec843a88a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.773134 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.773090    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-web-config\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.773616 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.773400    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.773616 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.773577    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24c78229-a44a-49eb-9ebd-4a3ec843a88a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.774416 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.774368    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24c78229-a44a-49eb-9ebd-4a3ec843a88a-config-out\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.774636 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.774619    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-config-volume\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.774864 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.774841    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.775071 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.775053    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.775809 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.775780    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24c78229-a44a-49eb-9ebd-4a3ec843a88a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.787019 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.787001    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7xjc\" (UniqueName: \"kubernetes.io/projected/24c78229-a44a-49eb-9ebd-4a3ec843a88a-kube-api-access-m7xjc\") pod \"alertmanager-main-0\" (UID: \"24c78229-a44a-49eb-9ebd-4a3ec843a88a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:09.980855 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:09.980819    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:17:10.125423 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:10.125390    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 19:17:10.128852 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:17:10.128823    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24c78229_a44a_49eb_9ebd_4a3ec843a88a.slice/crio-b2de4dd216956035b75e00766390b6605a305af3f2e37e53062774c7582aa7ab WatchSource:0}: Error finding container b2de4dd216956035b75e00766390b6605a305af3f2e37e53062774c7582aa7ab: Status 404 returned error can't find the container with id b2de4dd216956035b75e00766390b6605a305af3f2e37e53062774c7582aa7ab
Jul 15 19:17:10.602116 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:10.602087    2565 generic.go:356] "Generic (PLEG): container finished" podID="24c78229-a44a-49eb-9ebd-4a3ec843a88a" containerID="cee19b2d5d25090ff46dfac4a750e75be1691d95c2a4e9e135662b2092ec963b" exitCode=0
Jul 15 19:17:10.602521 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:10.602177    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24c78229-a44a-49eb-9ebd-4a3ec843a88a","Type":"ContainerDied","Data":"cee19b2d5d25090ff46dfac4a750e75be1691d95c2a4e9e135662b2092ec963b"}
Jul 15 19:17:10.602521 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:10.602261    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24c78229-a44a-49eb-9ebd-4a3ec843a88a","Type":"ContainerStarted","Data":"b2de4dd216956035b75e00766390b6605a305af3f2e37e53062774c7582aa7ab"}
Jul 15 19:17:10.688695 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:10.688667    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="698207f2-6e70-4570-a564-822511f6a4aa" path="/var/lib/kubelet/pods/698207f2-6e70-4570-a564-822511f6a4aa/volumes"
Jul 15 19:17:11.610494 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:11.610459    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24c78229-a44a-49eb-9ebd-4a3ec843a88a","Type":"ContainerStarted","Data":"13263e14ad1263d13c248c27909b131828a5fa0f6d52bdfd384abb299c160c99"}
Jul 15 19:17:11.610849 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:11.610569    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24c78229-a44a-49eb-9ebd-4a3ec843a88a","Type":"ContainerStarted","Data":"4d304cb3bf29218c5998a93faea83308a030dc5707250d41a03650c39056c966"}
Jul 15 19:17:11.610849 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:11.610600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24c78229-a44a-49eb-9ebd-4a3ec843a88a","Type":"ContainerStarted","Data":"893d61bce9de31335bdc048002120ebe485ae10739d9d9ca36f4e19e846ae873"}
Jul 15 19:17:11.610849 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:11.610623    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24c78229-a44a-49eb-9ebd-4a3ec843a88a","Type":"ContainerStarted","Data":"0f023e3c52c0aa33f361447b80c260f297f92a9ca16371cefdd4a2da07a75e3a"}
Jul 15 19:17:11.610849 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:11.610646    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24c78229-a44a-49eb-9ebd-4a3ec843a88a","Type":"ContainerStarted","Data":"74b7aef094fec60fa40ef9fe939b21be1fc620aa787adbc6fde796a69749585c"}
Jul 15 19:17:11.610849 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:11.610668    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24c78229-a44a-49eb-9ebd-4a3ec843a88a","Type":"ContainerStarted","Data":"ea3671fa80f8877cea8294cc08e86307ab2767cda84b55e509de78aa1c26d549"}
Jul 15 19:17:11.641423 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:11.641369    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.625623163 podStartE2EDuration="2.641354381s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.731218ms" isStatefulPod=false podCreationTimestamp="2026-07-15 19:17:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:17:11.639137634 +0000 UTC m=+155.577176141" watchObservedRunningTime="2026-07-15 19:17:11.641354381 +0000 UTC m=+155.579392849"
Jul 15 19:17:12.517382 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.517344    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 19:17:12.517697 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.517666    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="prometheus" containerID="cri-o://36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c" gracePeriod=600
Jul 15 19:17:12.517879 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.517697    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="kube-rbac-proxy" containerID="cri-o://28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8" gracePeriod=600
Jul 15 19:17:12.517879 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.517717    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="config-reloader" containerID="cri-o://5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452" gracePeriod=600
Jul 15 19:17:12.517879 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.517733    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="kube-rbac-proxy-web" containerID="cri-o://7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c" gracePeriod=600
Jul 15 19:17:12.517879 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.517762    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="kube-rbac-proxy-thanos" containerID="cri-o://75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada" gracePeriod=600
Jul 15 19:17:12.517879 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.517706    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="thanos-sidecar" containerID="cri-o://36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47" gracePeriod=600
Jul 15 19:17:12.779275 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.779251    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:12.794320 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794288    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.794464 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794323    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-grpc-tls\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.794464 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794349    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4746ae07-1627-452c-a572-fd9be0d3fd27-config-out\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.794464 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794394    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-db\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.794464 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794421    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4746ae07-1627-452c-a572-fd9be0d3fd27-tls-assets\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.794464 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794443    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-web-config\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.794713 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794477    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-rulefiles-1\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.794713 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794537    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-rulefiles-2\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.794713 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794567    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.794713 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794601    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-trusted-ca-bundle\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.794713 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794637    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-kube-rbac-proxy\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.794713 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794665    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-configmap-kubelet-serving-ca-bundle\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.794713 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794701    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-config\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.795035 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794732    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-configmap-metrics-client-ca\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.795035 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794772    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-rulefiles-0\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.795035 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794797    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-prometheus-k8s-tls\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.795035 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794826    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-metrics-client-certs\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.795035 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794868    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr7hj\" (UniqueName: \"kubernetes.io/projected/4746ae07-1627-452c-a572-fd9be0d3fd27-kube-api-access-fr7hj\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.795035 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794923    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-thanos-prometheus-http-client-file\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.795035 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.794964    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-configmap-serving-certs-ca-bundle\") pod \"4746ae07-1627-452c-a572-fd9be0d3fd27\" (UID: \"4746ae07-1627-452c-a572-fd9be0d3fd27\") "
Jul 15 19:17:12.795444 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.795413    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:17:12.795562 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.795541    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:17:12.795632 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.795571    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:17:12.796318 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.796288    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:17:12.796804 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.796749    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:17:12.797430 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.797073    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:17:12.797430 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.797162    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:17:12.797430 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.797194    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:17:12.798014 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.797983    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:17:12.798232 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.798190    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4746ae07-1627-452c-a572-fd9be0d3fd27-config-out" (OuterVolumeSpecName: "config-out") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:17:12.798501 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.798467    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:17:12.799447 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.799413    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-config" (OuterVolumeSpecName: "config") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:17:12.801170 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.801096    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4746ae07-1627-452c-a572-fd9be0d3fd27-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:17:12.801170 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.801134    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:17:12.801339 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.801269    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:17:12.801481 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.801456    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4746ae07-1627-452c-a572-fd9be0d3fd27-kube-api-access-fr7hj" (OuterVolumeSpecName: "kube-api-access-fr7hj") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "kube-api-access-fr7hj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:17:12.801777 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.801743    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:17:12.802419 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.802306    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:17:12.802419 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.802384    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:17:12.810572 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.810551    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-web-config" (OuterVolumeSpecName: "web-config") pod "4746ae07-1627-452c-a572-fd9be0d3fd27" (UID: "4746ae07-1627-452c-a572-fd9be0d3fd27"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:17:12.896400 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896364    2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896400 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896394    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896400 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896405    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896415    2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-grpc-tls\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896423    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4746ae07-1627-452c-a572-fd9be0d3fd27-config-out\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896431    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-db\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896439    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4746ae07-1627-452c-a572-fd9be0d3fd27-tls-assets\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896450    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-web-config\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896457    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896465    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896473    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896481    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896490    2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-kube-rbac-proxy\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896498    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896509    2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-config\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896516    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-configmap-metrics-client-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896524    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4746ae07-1627-452c-a572-fd9be0d3fd27-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896533    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896542    2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4746ae07-1627-452c-a572-fd9be0d3fd27-secret-metrics-client-certs\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:12.896612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:12.896550    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr7hj\" (UniqueName: \"kubernetes.io/projected/4746ae07-1627-452c-a572-fd9be0d3fd27-kube-api-access-fr7hj\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:17:13.623909 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.623871    2565 generic.go:356] "Generic (PLEG): container finished" podID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerID="75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada" exitCode=0
Jul 15 19:17:13.623909 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.623903    2565 generic.go:356] "Generic (PLEG): container finished" podID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerID="28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8" exitCode=0
Jul 15 19:17:13.623909 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.623910    2565 generic.go:356] "Generic (PLEG): container finished" podID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerID="7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c" exitCode=0
Jul 15 19:17:13.623909 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.623916    2565 generic.go:356] "Generic (PLEG): container finished" podID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerID="36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47" exitCode=0
Jul 15 19:17:13.624190 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.623922    2565 generic.go:356] "Generic (PLEG): container finished" podID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerID="5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452" exitCode=0
Jul 15 19:17:13.624190 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.623927    2565 generic.go:356] "Generic (PLEG): container finished" podID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerID="36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c" exitCode=0
Jul 15 19:17:13.624190 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.623944    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.624190 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.623951    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4746ae07-1627-452c-a572-fd9be0d3fd27","Type":"ContainerDied","Data":"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada"}
Jul 15 19:17:13.624190 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.624018    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4746ae07-1627-452c-a572-fd9be0d3fd27","Type":"ContainerDied","Data":"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8"}
Jul 15 19:17:13.624190 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.624046    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4746ae07-1627-452c-a572-fd9be0d3fd27","Type":"ContainerDied","Data":"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c"}
Jul 15 19:17:13.624190 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.624072    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4746ae07-1627-452c-a572-fd9be0d3fd27","Type":"ContainerDied","Data":"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47"}
Jul 15 19:17:13.624190 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.624084    2565 scope.go:117] "RemoveContainer" containerID="75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada"
Jul 15 19:17:13.624190 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.624096    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4746ae07-1627-452c-a572-fd9be0d3fd27","Type":"ContainerDied","Data":"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452"}
Jul 15 19:17:13.624190 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.624121    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4746ae07-1627-452c-a572-fd9be0d3fd27","Type":"ContainerDied","Data":"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c"}
Jul 15 19:17:13.624190 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.624143    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4746ae07-1627-452c-a572-fd9be0d3fd27","Type":"ContainerDied","Data":"96c86b76decf706d84b806a3b425fcd36bdd064ffa7564b02d97e56bcd1232ee"}
Jul 15 19:17:13.633113 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.633101    2565 scope.go:117] "RemoveContainer" containerID="28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8"
Jul 15 19:17:13.641163 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.641141    2565 scope.go:117] "RemoveContainer" containerID="7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c"
Jul 15 19:17:13.649622 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.649603    2565 scope.go:117] "RemoveContainer" containerID="36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47"
Jul 15 19:17:13.651330 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.651313    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 19:17:13.656957 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.656941    2565 scope.go:117] "RemoveContainer" containerID="5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452"
Jul 15 19:17:13.659221 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.659185    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 19:17:13.664137 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.664118    2565 scope.go:117] "RemoveContainer" containerID="36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c"
Jul 15 19:17:13.670918 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.670905    2565 scope.go:117] "RemoveContainer" containerID="ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7"
Jul 15 19:17:13.677192 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.677180    2565 scope.go:117] "RemoveContainer" containerID="75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada"
Jul 15 19:17:13.677458 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:17:13.677437    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada\": container with ID starting with 75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada not found: ID does not exist" containerID="75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada"
Jul 15 19:17:13.677529 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.677469    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada"} err="failed to get container status \"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada\": rpc error: code = NotFound desc = could not find container \"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada\": container with ID starting with 75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada not found: ID does not exist"
Jul 15 19:17:13.677529 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.677496    2565 scope.go:117] "RemoveContainer" containerID="28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8"
Jul 15 19:17:13.677746 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:17:13.677729    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8\": container with ID starting with 28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8 not found: ID does not exist" containerID="28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8"
Jul 15 19:17:13.677832 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.677752    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8"} err="failed to get container status \"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8\": rpc error: code = NotFound desc = could not find container \"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8\": container with ID starting with 28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8 not found: ID does not exist"
Jul 15 19:17:13.677832 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.677770    2565 scope.go:117] "RemoveContainer" containerID="7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c"
Jul 15 19:17:13.677986 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:17:13.677967    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c\": container with ID starting with 7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c not found: ID does not exist" containerID="7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c"
Jul 15 19:17:13.678049 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.677993    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c"} err="failed to get container status \"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c\": rpc error: code = NotFound desc = could not find container \"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c\": container with ID starting with 7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c not found: ID does not exist"
Jul 15 19:17:13.678049 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.678013    2565 scope.go:117] "RemoveContainer" containerID="36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47"
Jul 15 19:17:13.678255 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:17:13.678241    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47\": container with ID starting with 36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47 not found: ID does not exist" containerID="36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47"
Jul 15 19:17:13.678299 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.678259    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47"} err="failed to get container status \"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47\": rpc error: code = NotFound desc = could not find container \"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47\": container with ID starting with 36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47 not found: ID does not exist"
Jul 15 19:17:13.678299 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.678277    2565 scope.go:117] "RemoveContainer" containerID="5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452"
Jul 15 19:17:13.678470 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:17:13.678454    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452\": container with ID starting with 5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452 not found: ID does not exist" containerID="5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452"
Jul 15 19:17:13.678539 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.678476    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452"} err="failed to get container status \"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452\": rpc error: code = NotFound desc = could not find container \"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452\": container with ID starting with 5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452 not found: ID does not exist"
Jul 15 19:17:13.678539 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.678490    2565 scope.go:117] "RemoveContainer" containerID="36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c"
Jul 15 19:17:13.678714 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:17:13.678700    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c\": container with ID starting with 36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c not found: ID does not exist" containerID="36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c"
Jul 15 19:17:13.678754 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.678716    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c"} err="failed to get container status \"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c\": rpc error: code = NotFound desc = could not find container \"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c\": container with ID starting with 36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c not found: ID does not exist"
Jul 15 19:17:13.678754 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.678728    2565 scope.go:117] "RemoveContainer" containerID="ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7"
Jul 15 19:17:13.678901 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:17:13.678888    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7\": container with ID starting with ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7 not found: ID does not exist" containerID="ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7"
Jul 15 19:17:13.678939 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.678903    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7"} err="failed to get container status \"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7\": rpc error: code = NotFound desc = could not find container \"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7\": container with ID starting with ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7 not found: ID does not exist"
Jul 15 19:17:13.678939 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.678913    2565 scope.go:117] "RemoveContainer" containerID="75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada"
Jul 15 19:17:13.679127 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.679110    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada"} err="failed to get container status \"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada\": rpc error: code = NotFound desc = could not find container \"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada\": container with ID starting with 75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada not found: ID does not exist"
Jul 15 19:17:13.679172 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.679128    2565 scope.go:117] "RemoveContainer" containerID="28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8"
Jul 15 19:17:13.679333 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.679307    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8"} err="failed to get container status \"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8\": rpc error: code = NotFound desc = could not find container \"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8\": container with ID starting with 28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8 not found: ID does not exist"
Jul 15 19:17:13.679333 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.679334    2565 scope.go:117] "RemoveContainer" containerID="7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c"
Jul 15 19:17:13.679541 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.679513    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c"} err="failed to get container status \"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c\": rpc error: code = NotFound desc = could not find container \"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c\": container with ID starting with 7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c not found: ID does not exist"
Jul 15 19:17:13.679541 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.679534    2565 scope.go:117] "RemoveContainer" containerID="36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47"
Jul 15 19:17:13.679747 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.679728    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47"} err="failed to get container status \"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47\": rpc error: code = NotFound desc = could not find container \"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47\": container with ID starting with 36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47 not found: ID does not exist"
Jul 15 19:17:13.679817 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.679749    2565 scope.go:117] "RemoveContainer" containerID="5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452"
Jul 15 19:17:13.680003 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.679986    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452"} err="failed to get container status \"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452\": rpc error: code = NotFound desc = could not find container \"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452\": container with ID starting with 5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452 not found: ID does not exist"
Jul 15 19:17:13.680081 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.680004    2565 scope.go:117] "RemoveContainer" containerID="36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c"
Jul 15 19:17:13.680282 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.680231    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c"} err="failed to get container status \"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c\": rpc error: code = NotFound desc = could not find container \"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c\": container with ID starting with 36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c not found: ID does not exist"
Jul 15 19:17:13.680282 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.680253    2565 scope.go:117] "RemoveContainer" containerID="ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7"
Jul 15 19:17:13.680501 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.680470    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7"} err="failed to get container status \"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7\": rpc error: code = NotFound desc = could not find container \"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7\": container with ID starting with ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7 not found: ID does not exist"
Jul 15 19:17:13.680501 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.680493    2565 scope.go:117] "RemoveContainer" containerID="75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada"
Jul 15 19:17:13.680751 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.680733    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada"} err="failed to get container status \"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada\": rpc error: code = NotFound desc = could not find container \"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada\": container with ID starting with 75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada not found: ID does not exist"
Jul 15 19:17:13.680751 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.680751    2565 scope.go:117] "RemoveContainer" containerID="28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8"
Jul 15 19:17:13.681047 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.681026    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8"} err="failed to get container status \"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8\": rpc error: code = NotFound desc = could not find container \"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8\": container with ID starting with 28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8 not found: ID does not exist"
Jul 15 19:17:13.681118 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.681047    2565 scope.go:117] "RemoveContainer" containerID="7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c"
Jul 15 19:17:13.681306 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.681284    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c"} err="failed to get container status \"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c\": rpc error: code = NotFound desc = could not find container \"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c\": container with ID starting with 7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c not found: ID does not exist"
Jul 15 19:17:13.681306 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.681304    2565 scope.go:117] "RemoveContainer" containerID="36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47"
Jul 15 19:17:13.681527 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.681509    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47"} err="failed to get container status \"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47\": rpc error: code = NotFound desc = could not find container \"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47\": container with ID starting with 36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47 not found: ID does not exist"
Jul 15 19:17:13.681571 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.681527    2565 scope.go:117] "RemoveContainer" containerID="5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452"
Jul 15 19:17:13.681728 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.681713    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452"} err="failed to get container status \"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452\": rpc error: code = NotFound desc = could not find container \"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452\": container with ID starting with 5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452 not found: ID does not exist"
Jul 15 19:17:13.681765 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.681730    2565 scope.go:117] "RemoveContainer" containerID="36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c"
Jul 15 19:17:13.681944 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.681923    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c"} err="failed to get container status \"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c\": rpc error: code = NotFound desc = could not find container \"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c\": container with ID starting with 36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c not found: ID does not exist"
Jul 15 19:17:13.682023 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.681945    2565 scope.go:117] "RemoveContainer" containerID="ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7"
Jul 15 19:17:13.682156 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.682140    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7"} err="failed to get container status \"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7\": rpc error: code = NotFound desc = could not find container \"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7\": container with ID starting with ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7 not found: ID does not exist"
Jul 15 19:17:13.682215 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.682157    2565 scope.go:117] "RemoveContainer" containerID="75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada"
Jul 15 19:17:13.682358 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.682336    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada"} err="failed to get container status \"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada\": rpc error: code = NotFound desc = could not find container \"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada\": container with ID starting with 75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada not found: ID does not exist"
Jul 15 19:17:13.682421 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.682359    2565 scope.go:117] "RemoveContainer" containerID="28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8"
Jul 15 19:17:13.682585 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.682563    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8"} err="failed to get container status \"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8\": rpc error: code = NotFound desc = could not find container \"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8\": container with ID starting with 28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8 not found: ID does not exist"
Jul 15 19:17:13.682651 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.682587    2565 scope.go:117] "RemoveContainer" containerID="7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c"
Jul 15 19:17:13.682825 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.682805    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c"} err="failed to get container status \"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c\": rpc error: code = NotFound desc = could not find container \"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c\": container with ID starting with 7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c not found: ID does not exist"
Jul 15 19:17:13.682888 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.682826    2565 scope.go:117] "RemoveContainer" containerID="36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47"
Jul 15 19:17:13.683052 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.683036    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47"} err="failed to get container status \"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47\": rpc error: code = NotFound desc = could not find container \"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47\": container with ID starting with 36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47 not found: ID does not exist"
Jul 15 19:17:13.683100 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.683053    2565 scope.go:117] "RemoveContainer" containerID="5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452"
Jul 15 19:17:13.683264 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.683247    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452"} err="failed to get container status \"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452\": rpc error: code = NotFound desc = could not find container \"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452\": container with ID starting with 5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452 not found: ID does not exist"
Jul 15 19:17:13.683315 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.683265    2565 scope.go:117] "RemoveContainer" containerID="36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c"
Jul 15 19:17:13.683496 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.683480    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c"} err="failed to get container status \"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c\": rpc error: code = NotFound desc = could not find container \"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c\": container with ID starting with 36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c not found: ID does not exist"
Jul 15 19:17:13.683547 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.683497    2565 scope.go:117] "RemoveContainer" containerID="ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7"
Jul 15 19:17:13.683673 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.683654    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7"} err="failed to get container status \"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7\": rpc error: code = NotFound desc = could not find container \"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7\": container with ID starting with ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7 not found: ID does not exist"
Jul 15 19:17:13.683770 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.683674    2565 scope.go:117] "RemoveContainer" containerID="75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada"
Jul 15 19:17:13.683864 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.683848    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada"} err="failed to get container status \"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada\": rpc error: code = NotFound desc = could not find container \"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada\": container with ID starting with 75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada not found: ID does not exist"
Jul 15 19:17:13.683902 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.683865    2565 scope.go:117] "RemoveContainer" containerID="28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8"
Jul 15 19:17:13.684060 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.684042    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8"} err="failed to get container status \"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8\": rpc error: code = NotFound desc = could not find container \"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8\": container with ID starting with 28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8 not found: ID does not exist"
Jul 15 19:17:13.684126 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.684063    2565 scope.go:117] "RemoveContainer" containerID="7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c"
Jul 15 19:17:13.684383 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.684368    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c"} err="failed to get container status \"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c\": rpc error: code = NotFound desc = could not find container \"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c\": container with ID starting with 7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c not found: ID does not exist"
Jul 15 19:17:13.684447 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.684383    2565 scope.go:117] "RemoveContainer" containerID="36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47"
Jul 15 19:17:13.684592 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.684570    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47"} err="failed to get container status \"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47\": rpc error: code = NotFound desc = could not find container \"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47\": container with ID starting with 36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47 not found: ID does not exist"
Jul 15 19:17:13.684592 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.684591    2565 scope.go:117] "RemoveContainer" containerID="5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452"
Jul 15 19:17:13.684745 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.684727    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452"} err="failed to get container status \"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452\": rpc error: code = NotFound desc = could not find container \"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452\": container with ID starting with 5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452 not found: ID does not exist"
Jul 15 19:17:13.684790 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.684745    2565 scope.go:117] "RemoveContainer" containerID="36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c"
Jul 15 19:17:13.684947 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.684932    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c"} err="failed to get container status \"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c\": rpc error: code = NotFound desc = could not find container \"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c\": container with ID starting with 36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c not found: ID does not exist"
Jul 15 19:17:13.684992 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.684947    2565 scope.go:117] "RemoveContainer" containerID="ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7"
Jul 15 19:17:13.685149 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.685132    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7"} err="failed to get container status \"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7\": rpc error: code = NotFound desc = could not find container \"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7\": container with ID starting with ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7 not found: ID does not exist"
Jul 15 19:17:13.685149 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.685148    2565 scope.go:117] "RemoveContainer" containerID="75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada"
Jul 15 19:17:13.685342 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.685327    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada"} err="failed to get container status \"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada\": rpc error: code = NotFound desc = could not find container \"75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada\": container with ID starting with 75992fca48316c036aabe6692c9bc9147c83362a9f47fc67b4a15b8f53a4eada not found: ID does not exist"
Jul 15 19:17:13.685383 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.685341    2565 scope.go:117] "RemoveContainer" containerID="28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8"
Jul 15 19:17:13.685532 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.685516    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8"} err="failed to get container status \"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8\": rpc error: code = NotFound desc = could not find container \"28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8\": container with ID starting with 28a6898288ed979cf7387841ae6efad2b95f3da08e4d4810bf53c065947676b8 not found: ID does not exist"
Jul 15 19:17:13.685572 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.685532    2565 scope.go:117] "RemoveContainer" containerID="7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c"
Jul 15 19:17:13.685707 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.685691    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c"} err="failed to get container status \"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c\": rpc error: code = NotFound desc = could not find container \"7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c\": container with ID starting with 7b13726ec565bc5233f0ecbfc2cf7bc3a10de5124f661a540fe7d38a1b965f3c not found: ID does not exist"
Jul 15 19:17:13.685748 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.685707    2565 scope.go:117] "RemoveContainer" containerID="36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47"
Jul 15 19:17:13.685868 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.685851    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47"} err="failed to get container status \"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47\": rpc error: code = NotFound desc = could not find container \"36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47\": container with ID starting with 36bb91c2b08daa0b436b379bb5271b2ccccb0a056e9d3a1acf4d9b3e43e2aa47 not found: ID does not exist"
Jul 15 19:17:13.685905 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.685869    2565 scope.go:117] "RemoveContainer" containerID="5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452"
Jul 15 19:17:13.686018 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.686002    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452"} err="failed to get container status \"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452\": rpc error: code = NotFound desc = could not find container \"5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452\": container with ID starting with 5bf4fa1a0ab8bebeee87f328642c14ebc537f2d265524b1a2ffb765aff00c452 not found: ID does not exist"
Jul 15 19:17:13.686061 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.686018    2565 scope.go:117] "RemoveContainer" containerID="36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c"
Jul 15 19:17:13.686215 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.686184    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c"} err="failed to get container status \"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c\": rpc error: code = NotFound desc = could not find container \"36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c\": container with ID starting with 36a59a4c249fc43f6d07a9d306955900667a5fc2b2d191ad18619c7d98138a9c not found: ID does not exist"
Jul 15 19:17:13.686268 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.686223    2565 scope.go:117] "RemoveContainer" containerID="ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7"
Jul 15 19:17:13.686402 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.686386    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7"} err="failed to get container status \"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7\": rpc error: code = NotFound desc = could not find container \"ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7\": container with ID starting with ce0f971419e9add166cb06f86ce461294927f07c2ee990cd038076936eb238f7 not found: ID does not exist"
Jul 15 19:17:13.690867 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.690846    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 19:17:13.691172 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691156    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="thanos-sidecar"
Jul 15 19:17:13.691301 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691176    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="thanos-sidecar"
Jul 15 19:17:13.691301 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691192    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="prometheus"
Jul 15 19:17:13.691301 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691219    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="prometheus"
Jul 15 19:17:13.691301 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691233    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="init-config-reloader"
Jul 15 19:17:13.691301 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691241    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="init-config-reloader"
Jul 15 19:17:13.691301 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691252    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="kube-rbac-proxy-web"
Jul 15 19:17:13.691301 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691260    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="kube-rbac-proxy-web"
Jul 15 19:17:13.691301 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691283    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="kube-rbac-proxy"
Jul 15 19:17:13.691301 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691292    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="kube-rbac-proxy"
Jul 15 19:17:13.691764 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691309    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="config-reloader"
Jul 15 19:17:13.691764 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691317    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="config-reloader"
Jul 15 19:17:13.691764 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691335    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="kube-rbac-proxy-thanos"
Jul 15 19:17:13.691764 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691344    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="kube-rbac-proxy-thanos"
Jul 15 19:17:13.691764 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691428    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="thanos-sidecar"
Jul 15 19:17:13.691764 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691440    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="kube-rbac-proxy"
Jul 15 19:17:13.691764 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691449    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="kube-rbac-proxy-thanos"
Jul 15 19:17:13.691764 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691458    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="prometheus"
Jul 15 19:17:13.691764 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691468    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="config-reloader"
Jul 15 19:17:13.691764 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.691481    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" containerName="kube-rbac-proxy-web"
Jul 15 19:17:13.697111 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.697092    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.699586 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.699568    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 19:17:13.700113 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.700098    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 19:17:13.701378 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.701362    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 19:17:13.701693 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.701679    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 19:17:13.702114 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702092    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 19:17:13.702114 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702094    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.702328 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702136    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 19:17:13.702328 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.702328 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702244    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.702328 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702274    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.702328 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702284    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 19:17:13.703056 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702344    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 19:17:13.703056 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702412    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb784d21-0c9d-48fa-9b60-144c236e0531-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.703056 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.703056 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702507    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.703056 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702534    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-web-config\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.703056 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702555    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gj8t9\""
Jul 15 19:17:13.703056 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702597    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-config\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.703056 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702642    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.703056 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.703056 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702726    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cb784d21-0c9d-48fa-9b60-144c236e0531-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.703056 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb784d21-0c9d-48fa-9b60-144c236e0531-config-out\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.703056 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.702944    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.703056 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.703045    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 19:17:13.703781 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.703074    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 19:17:13.703781 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.703074    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.703781 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.703264    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv45m\" (UniqueName: \"kubernetes.io/projected/cb784d21-0c9d-48fa-9b60-144c236e0531-kube-api-access-wv45m\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.703781 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.703346    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c03npkgrmh4f6\""
Jul 15 19:17:13.703781 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.703352    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.703781 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.703395    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 19:17:13.703781 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.703397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.703781 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.703591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.703781 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.703647    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.704447 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.704427    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 19:17:13.705931 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.705911    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 19:17:13.709431 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.709412    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 19:17:13.717354 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.717336    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 19:17:13.804085 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.804085 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804036    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv45m\" (UniqueName: \"kubernetes.io/projected/cb784d21-0c9d-48fa-9b60-144c236e0531-kube-api-access-wv45m\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.804085 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804057    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.804085 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.804703 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804105    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.804703 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804130    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.804703 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804159    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.804703 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804182    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.804703 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.804703 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804271    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.804703 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb784d21-0c9d-48fa-9b60-144c236e0531-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.804703 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804318    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.804703 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804349    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.804703 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-web-config\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.804703 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-config\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.804703 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.804703 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804467    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.804703 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cb784d21-0c9d-48fa-9b60-144c236e0531-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.805436 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804538    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb784d21-0c9d-48fa-9b60-144c236e0531-config-out\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.805436 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.805436 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.804835    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.805436 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.805119    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.806533 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.805773    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.806533 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.806040    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.806533 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.806119    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cb784d21-0c9d-48fa-9b60-144c236e0531-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.806533 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.806259    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.806867 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.806776    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.807345 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.807320    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.807529 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.807507    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.808460 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.808414    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cb784d21-0c9d-48fa-9b60-144c236e0531-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.808921 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.808895    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.809194 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.809171    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb784d21-0c9d-48fa-9b60-144c236e0531-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.809301 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.809178    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-web-config\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.809571 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.809523    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.809571 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.809539    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb784d21-0c9d-48fa-9b60-144c236e0531-config-out\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.809933 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.809909    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.810003 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.809977    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.810475 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.810451    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.810630 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.810613    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cb784d21-0c9d-48fa-9b60-144c236e0531-config\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:13.813339 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:13.813321    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv45m\" (UniqueName: \"kubernetes.io/projected/cb784d21-0c9d-48fa-9b60-144c236e0531-kube-api-access-wv45m\") pod \"prometheus-k8s-0\" (UID: \"cb784d21-0c9d-48fa-9b60-144c236e0531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:14.006959 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:14.006917    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:17:14.150805 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:14.150625    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 19:17:14.153395 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:17:14.153363    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb784d21_0c9d_48fa_9b60_144c236e0531.slice/crio-2991e3fa7cea0a1818e4039304e5fad2918bf3e70cdf7d7005b7388192ea4521 WatchSource:0}: Error finding container 2991e3fa7cea0a1818e4039304e5fad2918bf3e70cdf7d7005b7388192ea4521: Status 404 returned error can't find the container with id 2991e3fa7cea0a1818e4039304e5fad2918bf3e70cdf7d7005b7388192ea4521
Jul 15 19:17:14.628866 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:14.628830    2565 generic.go:356] "Generic (PLEG): container finished" podID="cb784d21-0c9d-48fa-9b60-144c236e0531" containerID="93d14999aaead0189882f4676f991dbd44cfe29e89abc17e53e970410f7619cc" exitCode=0
Jul 15 19:17:14.629044 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:14.628922    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb784d21-0c9d-48fa-9b60-144c236e0531","Type":"ContainerDied","Data":"93d14999aaead0189882f4676f991dbd44cfe29e89abc17e53e970410f7619cc"}
Jul 15 19:17:14.629044 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:14.629013    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb784d21-0c9d-48fa-9b60-144c236e0531","Type":"ContainerStarted","Data":"2991e3fa7cea0a1818e4039304e5fad2918bf3e70cdf7d7005b7388192ea4521"}
Jul 15 19:17:14.687937 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:14.687902    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4746ae07-1627-452c-a572-fd9be0d3fd27" path="/var/lib/kubelet/pods/4746ae07-1627-452c-a572-fd9be0d3fd27/volumes"
Jul 15 19:17:15.637615 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:15.637578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb784d21-0c9d-48fa-9b60-144c236e0531","Type":"ContainerStarted","Data":"6b0d22f46f0636cd0eb05b1e8d8992c4428304419df000702395f655832eae91"}
Jul 15 19:17:15.638009 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:15.637680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb784d21-0c9d-48fa-9b60-144c236e0531","Type":"ContainerStarted","Data":"240ebdb97190f89073725804b3f80ab986404e9c63244e8ce2b4989b35b4c165"}
Jul 15 19:17:15.638009 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:15.637709    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb784d21-0c9d-48fa-9b60-144c236e0531","Type":"ContainerStarted","Data":"4d9aeeba9c232e7d26f4dadb6fa9dbe287152a167b78ead67bd5286edfafaf0a"}
Jul 15 19:17:15.638009 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:15.637738    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb784d21-0c9d-48fa-9b60-144c236e0531","Type":"ContainerStarted","Data":"fbe22c8de17922aad46095a0d255601c65f235efe6a212a9df61071b5674d523"}
Jul 15 19:17:15.638009 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:15.637769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb784d21-0c9d-48fa-9b60-144c236e0531","Type":"ContainerStarted","Data":"fef61521dd8ad6ea5e38b7b75230786d36719a3423cc7f0571cc70425e8b38c0"}
Jul 15 19:17:15.638009 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:15.637792    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cb784d21-0c9d-48fa-9b60-144c236e0531","Type":"ContainerStarted","Data":"2113d398f45f5cae1093d8c9715ee578c4b685ec174035c83bdc47720215450c"}
Jul 15 19:17:15.673837 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:15.673780    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.65299867 podStartE2EDuration="2.673762456s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.763786ms" isStatefulPod=false podCreationTimestamp="2026-07-15 19:17:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:17:15.670762581 +0000 UTC m=+159.608801087" watchObservedRunningTime="2026-07-15 19:17:15.673762456 +0000 UTC m=+159.611800925"
Jul 15 19:17:19.007154 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:17:19.007119    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:18:14.008039 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:14.008003    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:18:14.023723 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:14.023698    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:18:14.898509 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:14.898484    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 19:18:42.330685 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:42.330643    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-skckh"]
Jul 15 19:18:42.332859 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:42.332834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-skckh"
Jul 15 19:18:42.335322 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:42.335301    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 19:18:42.335966 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:42.335945    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rglkl\""
Jul 15 19:18:42.336050 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:42.336032    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 19:18:42.348438 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:42.348412    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-skckh"]
Jul 15 19:18:42.466670 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:42.466627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5bf75e55-0b8f-4758-a8b7-d79e4e794511-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-skckh\" (UID: \"5bf75e55-0b8f-4758-a8b7-d79e4e794511\") " pod="cert-manager/cert-manager-webhook-6486ffd997-skckh"
Jul 15 19:18:42.466845 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:42.466759    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpxhj\" (UniqueName: \"kubernetes.io/projected/5bf75e55-0b8f-4758-a8b7-d79e4e794511-kube-api-access-dpxhj\") pod \"cert-manager-webhook-6486ffd997-skckh\" (UID: \"5bf75e55-0b8f-4758-a8b7-d79e4e794511\") " pod="cert-manager/cert-manager-webhook-6486ffd997-skckh"
Jul 15 19:18:42.567513 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:42.567473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpxhj\" (UniqueName: \"kubernetes.io/projected/5bf75e55-0b8f-4758-a8b7-d79e4e794511-kube-api-access-dpxhj\") pod \"cert-manager-webhook-6486ffd997-skckh\" (UID: \"5bf75e55-0b8f-4758-a8b7-d79e4e794511\") " pod="cert-manager/cert-manager-webhook-6486ffd997-skckh"
Jul 15 19:18:42.567689 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:42.567534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5bf75e55-0b8f-4758-a8b7-d79e4e794511-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-skckh\" (UID: \"5bf75e55-0b8f-4758-a8b7-d79e4e794511\") " pod="cert-manager/cert-manager-webhook-6486ffd997-skckh"
Jul 15 19:18:42.595037 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:42.594972    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5bf75e55-0b8f-4758-a8b7-d79e4e794511-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-skckh\" (UID: \"5bf75e55-0b8f-4758-a8b7-d79e4e794511\") " pod="cert-manager/cert-manager-webhook-6486ffd997-skckh"
Jul 15 19:18:42.595183 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:42.595158    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpxhj\" (UniqueName: \"kubernetes.io/projected/5bf75e55-0b8f-4758-a8b7-d79e4e794511-kube-api-access-dpxhj\") pod \"cert-manager-webhook-6486ffd997-skckh\" (UID: \"5bf75e55-0b8f-4758-a8b7-d79e4e794511\") " pod="cert-manager/cert-manager-webhook-6486ffd997-skckh"
Jul 15 19:18:42.653880 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:42.653836    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-skckh"
Jul 15 19:18:42.784654 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:42.784574    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-skckh"]
Jul 15 19:18:42.786908 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:18:42.786880    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bf75e55_0b8f_4758_a8b7_d79e4e794511.slice/crio-ffebfa36ab7336d815d6dca9c0c6e0d64bf919022bfd7ade1eb2dd38a44c2696 WatchSource:0}: Error finding container ffebfa36ab7336d815d6dca9c0c6e0d64bf919022bfd7ade1eb2dd38a44c2696: Status 404 returned error can't find the container with id ffebfa36ab7336d815d6dca9c0c6e0d64bf919022bfd7ade1eb2dd38a44c2696
Jul 15 19:18:42.995344 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:42.995310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-skckh" event={"ID":"5bf75e55-0b8f-4758-a8b7-d79e4e794511","Type":"ContainerStarted","Data":"ffebfa36ab7336d815d6dca9c0c6e0d64bf919022bfd7ade1eb2dd38a44c2696"}
Jul 15 19:18:46.012549 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:46.012464    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-skckh" event={"ID":"5bf75e55-0b8f-4758-a8b7-d79e4e794511","Type":"ContainerStarted","Data":"fd31d9e484a808242916d1739284d13639b62e55c24e508262d52b13d5733238"}
Jul 15 19:18:46.012908 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:46.012564    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-skckh"
Jul 15 19:18:46.031960 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:46.031898    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-skckh" podStartSLOduration=1.075332821 podStartE2EDuration="4.03187154s" totalImagesPullingTime="2.956538719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:18:46.030512429 +0000 UTC m=+249.968550898" watchObservedRunningTime="2026-07-15 19:18:46.03187154 +0000 UTC m=+249.969910008"
Jul 15 19:18:52.019619 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:52.019581    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-skckh"
Jul 15 19:18:52.946755 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:52.946718    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-76dpb"]
Jul 15 19:18:52.949389 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:52.949368    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-76dpb"
Jul 15 19:18:52.951789 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:52.951765    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-f8pzq\""
Jul 15 19:18:52.961001 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:52.960974    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-76dpb"]
Jul 15 19:18:53.058578 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:53.058539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5bb91840-6b1f-487b-8225-3cbb9332ba8e-bound-sa-token\") pod \"cert-manager-55b4d954d5-76dpb\" (UID: \"5bb91840-6b1f-487b-8225-3cbb9332ba8e\") " pod="cert-manager/cert-manager-55b4d954d5-76dpb"
Jul 15 19:18:53.058968 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:53.058586    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m862v\" (UniqueName: \"kubernetes.io/projected/5bb91840-6b1f-487b-8225-3cbb9332ba8e-kube-api-access-m862v\") pod \"cert-manager-55b4d954d5-76dpb\" (UID: \"5bb91840-6b1f-487b-8225-3cbb9332ba8e\") " pod="cert-manager/cert-manager-55b4d954d5-76dpb"
Jul 15 19:18:53.159513 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:53.159477    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5bb91840-6b1f-487b-8225-3cbb9332ba8e-bound-sa-token\") pod \"cert-manager-55b4d954d5-76dpb\" (UID: \"5bb91840-6b1f-487b-8225-3cbb9332ba8e\") " pod="cert-manager/cert-manager-55b4d954d5-76dpb"
Jul 15 19:18:53.159694 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:53.159522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m862v\" (UniqueName: \"kubernetes.io/projected/5bb91840-6b1f-487b-8225-3cbb9332ba8e-kube-api-access-m862v\") pod \"cert-manager-55b4d954d5-76dpb\" (UID: \"5bb91840-6b1f-487b-8225-3cbb9332ba8e\") " pod="cert-manager/cert-manager-55b4d954d5-76dpb"
Jul 15 19:18:53.170916 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:53.170880    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5bb91840-6b1f-487b-8225-3cbb9332ba8e-bound-sa-token\") pod \"cert-manager-55b4d954d5-76dpb\" (UID: \"5bb91840-6b1f-487b-8225-3cbb9332ba8e\") " pod="cert-manager/cert-manager-55b4d954d5-76dpb"
Jul 15 19:18:53.171058 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:53.171009    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m862v\" (UniqueName: \"kubernetes.io/projected/5bb91840-6b1f-487b-8225-3cbb9332ba8e-kube-api-access-m862v\") pod \"cert-manager-55b4d954d5-76dpb\" (UID: \"5bb91840-6b1f-487b-8225-3cbb9332ba8e\") " pod="cert-manager/cert-manager-55b4d954d5-76dpb"
Jul 15 19:18:53.259093 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:53.259003    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-76dpb"
Jul 15 19:18:53.392082 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:53.392056    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-76dpb"]
Jul 15 19:18:53.394231 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:18:53.394192    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bb91840_6b1f_487b_8225_3cbb9332ba8e.slice/crio-0c13ecfd3638f500d8c6eee388c39971e7e263fd680aad40673b617372702e39 WatchSource:0}: Error finding container 0c13ecfd3638f500d8c6eee388c39971e7e263fd680aad40673b617372702e39: Status 404 returned error can't find the container with id 0c13ecfd3638f500d8c6eee388c39971e7e263fd680aad40673b617372702e39
Jul 15 19:18:54.048252 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:54.048189    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-76dpb" event={"ID":"5bb91840-6b1f-487b-8225-3cbb9332ba8e","Type":"ContainerStarted","Data":"5efe5767f08e3ca4a4201d13c938aa23b6c30ea47de1af7a2b35cbde25275f91"}
Jul 15 19:18:54.048252 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:54.048263    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-76dpb" event={"ID":"5bb91840-6b1f-487b-8225-3cbb9332ba8e","Type":"ContainerStarted","Data":"0c13ecfd3638f500d8c6eee388c39971e7e263fd680aad40673b617372702e39"}
Jul 15 19:18:54.067323 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:18:54.067267    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-76dpb" podStartSLOduration=2.0672476 podStartE2EDuration="2.0672476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:18:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:18:54.065063833 +0000 UTC m=+258.003102303" watchObservedRunningTime="2026-07-15 19:18:54.0672476 +0000 UTC m=+258.005286068"
Jul 15 19:19:16.714562 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.714511    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"]
Jul 15 19:19:16.717908 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.717888    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:16.722663 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.722633    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 19:19:16.722760 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.722723    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 19:19:16.722760 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.722742    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 19:19:16.723018 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.723005    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-c6zmb\""
Jul 15 19:19:16.724438 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.724417    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 19:19:16.758499 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.758473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07ad3215-d7e9-4d58-94de-638a382f7bf6-tmp\") pod \"opendatahub-operator-controller-manager-5d9998b69-zljwb\" (UID: \"07ad3215-d7e9-4d58-94de-638a382f7bf6\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:16.758583 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.758553    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07ad3215-d7e9-4d58-94de-638a382f7bf6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d9998b69-zljwb\" (UID: \"07ad3215-d7e9-4d58-94de-638a382f7bf6\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:16.758622 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.758581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrzjz\" (UniqueName: \"kubernetes.io/projected/07ad3215-d7e9-4d58-94de-638a382f7bf6-kube-api-access-mrzjz\") pod \"opendatahub-operator-controller-manager-5d9998b69-zljwb\" (UID: \"07ad3215-d7e9-4d58-94de-638a382f7bf6\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:16.758622 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.758605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/07ad3215-d7e9-4d58-94de-638a382f7bf6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d9998b69-zljwb\" (UID: \"07ad3215-d7e9-4d58-94de-638a382f7bf6\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:16.758688 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.758639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/07ad3215-d7e9-4d58-94de-638a382f7bf6-manifests\") pod \"opendatahub-operator-controller-manager-5d9998b69-zljwb\" (UID: \"07ad3215-d7e9-4d58-94de-638a382f7bf6\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:16.765071 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.765048    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"]
Jul 15 19:19:16.859271 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.859235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07ad3215-d7e9-4d58-94de-638a382f7bf6-tmp\") pod \"opendatahub-operator-controller-manager-5d9998b69-zljwb\" (UID: \"07ad3215-d7e9-4d58-94de-638a382f7bf6\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:16.859444 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.859337    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07ad3215-d7e9-4d58-94de-638a382f7bf6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d9998b69-zljwb\" (UID: \"07ad3215-d7e9-4d58-94de-638a382f7bf6\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:16.859444 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.859371    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrzjz\" (UniqueName: \"kubernetes.io/projected/07ad3215-d7e9-4d58-94de-638a382f7bf6-kube-api-access-mrzjz\") pod \"opendatahub-operator-controller-manager-5d9998b69-zljwb\" (UID: \"07ad3215-d7e9-4d58-94de-638a382f7bf6\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:16.859444 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.859400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/07ad3215-d7e9-4d58-94de-638a382f7bf6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d9998b69-zljwb\" (UID: \"07ad3215-d7e9-4d58-94de-638a382f7bf6\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:16.859444 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.859431    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/07ad3215-d7e9-4d58-94de-638a382f7bf6-manifests\") pod \"opendatahub-operator-controller-manager-5d9998b69-zljwb\" (UID: \"07ad3215-d7e9-4d58-94de-638a382f7bf6\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:16.859760 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.859740    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/07ad3215-d7e9-4d58-94de-638a382f7bf6-manifests\") pod \"opendatahub-operator-controller-manager-5d9998b69-zljwb\" (UID: \"07ad3215-d7e9-4d58-94de-638a382f7bf6\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:16.861601 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.861571    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07ad3215-d7e9-4d58-94de-638a382f7bf6-tmp\") pod \"opendatahub-operator-controller-manager-5d9998b69-zljwb\" (UID: \"07ad3215-d7e9-4d58-94de-638a382f7bf6\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:16.861804 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.861787    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07ad3215-d7e9-4d58-94de-638a382f7bf6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d9998b69-zljwb\" (UID: \"07ad3215-d7e9-4d58-94de-638a382f7bf6\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:16.861893 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.861875    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/07ad3215-d7e9-4d58-94de-638a382f7bf6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d9998b69-zljwb\" (UID: \"07ad3215-d7e9-4d58-94de-638a382f7bf6\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:16.874279 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:16.874259    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrzjz\" (UniqueName: \"kubernetes.io/projected/07ad3215-d7e9-4d58-94de-638a382f7bf6-kube-api-access-mrzjz\") pod \"opendatahub-operator-controller-manager-5d9998b69-zljwb\" (UID: \"07ad3215-d7e9-4d58-94de-638a382f7bf6\") " pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:17.029413 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:17.029337    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:17.223834 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:17.223798    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"]
Jul 15 19:19:17.226955 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:19:17.226934    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07ad3215_d7e9_4d58_94de_638a382f7bf6.slice/crio-41d36f0c5dec87b60af2faed209c1434c2277344792f758bb8aa834e78666e56 WatchSource:0}: Error finding container 41d36f0c5dec87b60af2faed209c1434c2277344792f758bb8aa834e78666e56: Status 404 returned error can't find the container with id 41d36f0c5dec87b60af2faed209c1434c2277344792f758bb8aa834e78666e56
Jul 15 19:19:18.148610 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:18.148530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb" event={"ID":"07ad3215-d7e9-4d58-94de-638a382f7bf6","Type":"ContainerStarted","Data":"41d36f0c5dec87b60af2faed209c1434c2277344792f758bb8aa834e78666e56"}
Jul 15 19:19:21.164270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:21.164226    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb" event={"ID":"07ad3215-d7e9-4d58-94de-638a382f7bf6","Type":"ContainerStarted","Data":"c622a8d14515713d62e7cf69360e9a88dd230449158df266082c70500a00e115"}
Jul 15 19:19:22.170157 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:22.170120    2565 generic.go:356] "Generic (PLEG): container finished" podID="07ad3215-d7e9-4d58-94de-638a382f7bf6" containerID="c622a8d14515713d62e7cf69360e9a88dd230449158df266082c70500a00e115" exitCode=0
Jul 15 19:19:22.170552 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:22.170179    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb" event={"ID":"07ad3215-d7e9-4d58-94de-638a382f7bf6","Type":"ContainerDied","Data":"c622a8d14515713d62e7cf69360e9a88dd230449158df266082c70500a00e115"}
Jul 15 19:19:24.180405 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:24.180370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb" event={"ID":"07ad3215-d7e9-4d58-94de-638a382f7bf6","Type":"ContainerStarted","Data":"205c24d7b5606e0800c0dc8c3df68c4e44fb4783b0d338029e5f3d5fd3c9ddf1"}
Jul 15 19:19:24.180763 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:24.180522    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:24.204116 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:24.204062    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb" podStartSLOduration=2.340378412 podStartE2EDuration="8.204041895s" totalImagesPullingTime="4.77583563s" totalInitContainerRuntime="1.087827853s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:19:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:19:24.202310039 +0000 UTC m=+288.140348509" watchObservedRunningTime="2026-07-15 19:19:24.204041895 +0000 UTC m=+288.142080365"
Jul 15 19:19:35.187472 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:35.187438    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d9998b69-zljwb"
Jul 15 19:19:36.472257 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:36.472227    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:19:36.475137 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:36.475114    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:19:36.478183 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:36.478163    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 19:19:46.997402 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:46.997371    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"]
Jul 15 19:19:47.000793 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.000775    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"
Jul 15 19:19:47.006479 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.006455    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 19:19:47.006653 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.006636    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 19:19:47.007554 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.007428    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gzqdv\""
Jul 15 19:19:47.007554 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.007522    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 19:19:47.007689 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.007473    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:19:47.011927 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.011909    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 19:19:47.017902 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.017878    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"]
Jul 15 19:19:47.129989 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.129960    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/817fce24-acdb-4f66-bdec-5f5db48cd1dd-metrics-cert\") pod \"lws-controller-manager-756b7fb4f9-6snlr\" (UID: \"817fce24-acdb-4f66-bdec-5f5db48cd1dd\") " pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"
Jul 15 19:19:47.129989 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.129993    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/817fce24-acdb-4f66-bdec-5f5db48cd1dd-cert\") pod \"lws-controller-manager-756b7fb4f9-6snlr\" (UID: \"817fce24-acdb-4f66-bdec-5f5db48cd1dd\") " pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"
Jul 15 19:19:47.130188 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.130017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/817fce24-acdb-4f66-bdec-5f5db48cd1dd-manager-config\") pod \"lws-controller-manager-756b7fb4f9-6snlr\" (UID: \"817fce24-acdb-4f66-bdec-5f5db48cd1dd\") " pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"
Jul 15 19:19:47.130188 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.130072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2hlc\" (UniqueName: \"kubernetes.io/projected/817fce24-acdb-4f66-bdec-5f5db48cd1dd-kube-api-access-r2hlc\") pod \"lws-controller-manager-756b7fb4f9-6snlr\" (UID: \"817fce24-acdb-4f66-bdec-5f5db48cd1dd\") " pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"
Jul 15 19:19:47.230645 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.230611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/817fce24-acdb-4f66-bdec-5f5db48cd1dd-metrics-cert\") pod \"lws-controller-manager-756b7fb4f9-6snlr\" (UID: \"817fce24-acdb-4f66-bdec-5f5db48cd1dd\") " pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"
Jul 15 19:19:47.230645 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.230644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/817fce24-acdb-4f66-bdec-5f5db48cd1dd-cert\") pod \"lws-controller-manager-756b7fb4f9-6snlr\" (UID: \"817fce24-acdb-4f66-bdec-5f5db48cd1dd\") " pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"
Jul 15 19:19:47.230881 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.230670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/817fce24-acdb-4f66-bdec-5f5db48cd1dd-manager-config\") pod \"lws-controller-manager-756b7fb4f9-6snlr\" (UID: \"817fce24-acdb-4f66-bdec-5f5db48cd1dd\") " pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"
Jul 15 19:19:47.230881 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.230711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2hlc\" (UniqueName: \"kubernetes.io/projected/817fce24-acdb-4f66-bdec-5f5db48cd1dd-kube-api-access-r2hlc\") pod \"lws-controller-manager-756b7fb4f9-6snlr\" (UID: \"817fce24-acdb-4f66-bdec-5f5db48cd1dd\") " pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"
Jul 15 19:19:47.231430 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.231410    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/817fce24-acdb-4f66-bdec-5f5db48cd1dd-manager-config\") pod \"lws-controller-manager-756b7fb4f9-6snlr\" (UID: \"817fce24-acdb-4f66-bdec-5f5db48cd1dd\") " pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"
Jul 15 19:19:47.233172 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.233149    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/817fce24-acdb-4f66-bdec-5f5db48cd1dd-cert\") pod \"lws-controller-manager-756b7fb4f9-6snlr\" (UID: \"817fce24-acdb-4f66-bdec-5f5db48cd1dd\") " pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"
Jul 15 19:19:47.233277 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.233175    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/817fce24-acdb-4f66-bdec-5f5db48cd1dd-metrics-cert\") pod \"lws-controller-manager-756b7fb4f9-6snlr\" (UID: \"817fce24-acdb-4f66-bdec-5f5db48cd1dd\") " pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"
Jul 15 19:19:47.248977 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.248905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2hlc\" (UniqueName: \"kubernetes.io/projected/817fce24-acdb-4f66-bdec-5f5db48cd1dd-kube-api-access-r2hlc\") pod \"lws-controller-manager-756b7fb4f9-6snlr\" (UID: \"817fce24-acdb-4f66-bdec-5f5db48cd1dd\") " pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"
Jul 15 19:19:47.261129 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.261101    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"]
Jul 15 19:19:47.264711 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.264686    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.267282 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.267265    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 19:19:47.268982 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.268951    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-lpz4v\""
Jul 15 19:19:47.269073 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.268998    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 19:19:47.269230 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.269215    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 19:19:47.269292 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.269221    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 19:19:47.269410 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.269390    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 19:19:47.269805 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.269789    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 19:19:47.283872 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.283852    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"]
Jul 15 19:19:47.310428 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.310402    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"
Jul 15 19:19:47.431924 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.431891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/38bdfd7f-8580-495f-979c-fec93b263069-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.432074 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.431954    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjrql\" (UniqueName: \"kubernetes.io/projected/38bdfd7f-8580-495f-979c-fec93b263069-kube-api-access-gjrql\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.432074 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.432023    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/38bdfd7f-8580-495f-979c-fec93b263069-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.432145 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.432078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/38bdfd7f-8580-495f-979c-fec93b263069-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.432182 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.432140    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/38bdfd7f-8580-495f-979c-fec93b263069-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.432182 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.432167    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/38bdfd7f-8580-495f-979c-fec93b263069-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.432289 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.432238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38bdfd7f-8580-495f-979c-fec93b263069-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.454739 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:19:47.454700    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod817fce24_acdb_4f66_bdec_5f5db48cd1dd.slice/crio-2aaa05977e1bf5606fdc68cf0184af3402906eb904424a3793fa9c427e390c79 WatchSource:0}: Error finding container 2aaa05977e1bf5606fdc68cf0184af3402906eb904424a3793fa9c427e390c79: Status 404 returned error can't find the container with id 2aaa05977e1bf5606fdc68cf0184af3402906eb904424a3793fa9c427e390c79
Jul 15 19:19:47.456113 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.456087    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"]
Jul 15 19:19:47.456798 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.456779    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:19:47.532944 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.532857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/38bdfd7f-8580-495f-979c-fec93b263069-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.532944 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.532897    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/38bdfd7f-8580-495f-979c-fec93b263069-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.533130 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.533045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/38bdfd7f-8580-495f-979c-fec93b263069-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.533130 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.533085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/38bdfd7f-8580-495f-979c-fec93b263069-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.533233 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.533146    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38bdfd7f-8580-495f-979c-fec93b263069-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.533292 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.533247    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/38bdfd7f-8580-495f-979c-fec93b263069-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.533351 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.533306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjrql\" (UniqueName: \"kubernetes.io/projected/38bdfd7f-8580-495f-979c-fec93b263069-kube-api-access-gjrql\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.533798 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.533757    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/38bdfd7f-8580-495f-979c-fec93b263069-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.535406 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.535385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/38bdfd7f-8580-495f-979c-fec93b263069-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.535609 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.535587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/38bdfd7f-8580-495f-979c-fec93b263069-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.535743 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.535725    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/38bdfd7f-8580-495f-979c-fec93b263069-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.535859 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.535841    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/38bdfd7f-8580-495f-979c-fec93b263069-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.546028 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.545995    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjrql\" (UniqueName: \"kubernetes.io/projected/38bdfd7f-8580-495f-979c-fec93b263069-kube-api-access-gjrql\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.562957 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.562929    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38bdfd7f-8580-495f-979c-fec93b263069-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2h2qf\" (UID: \"38bdfd7f-8580-495f-979c-fec93b263069\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.573787 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.573768    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:47.782342 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:19:47.782304    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38bdfd7f_8580_495f_979c_fec93b263069.slice/crio-d4f5da44db2669bfdd6a29d336503f3b747da3f8dba1c3c728fc7e2454733e4e WatchSource:0}: Error finding container d4f5da44db2669bfdd6a29d336503f3b747da3f8dba1c3c728fc7e2454733e4e: Status 404 returned error can't find the container with id d4f5da44db2669bfdd6a29d336503f3b747da3f8dba1c3c728fc7e2454733e4e
Jul 15 19:19:47.792909 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:47.792885    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"]
Jul 15 19:19:48.298252 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:48.298164    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr" event={"ID":"817fce24-acdb-4f66-bdec-5f5db48cd1dd","Type":"ContainerStarted","Data":"2aaa05977e1bf5606fdc68cf0184af3402906eb904424a3793fa9c427e390c79"}
Jul 15 19:19:48.299408 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:48.299378    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf" event={"ID":"38bdfd7f-8580-495f-979c-fec93b263069","Type":"ContainerStarted","Data":"d4f5da44db2669bfdd6a29d336503f3b747da3f8dba1c3c728fc7e2454733e4e"}
Jul 15 19:19:51.103986 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:51.103952    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 19:19:51.104331 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:51.104018    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 19:19:51.329972 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:51.329920    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf" event={"ID":"38bdfd7f-8580-495f-979c-fec93b263069","Type":"ContainerStarted","Data":"6f70dc61e7c4ab48cd98d5e2c8765089d8e37fd8bb6a41497041ac5a3f974764"}
Jul 15 19:19:51.330149 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:51.330030    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:19:51.332746 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:51.332610    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr" event={"ID":"817fce24-acdb-4f66-bdec-5f5db48cd1dd","Type":"ContainerStarted","Data":"2cb07134bbeb7bb4ed23489696c029cabd6145e5443140bfb2989d77d47336ea"}
Jul 15 19:19:51.332746 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:51.332675    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"
Jul 15 19:19:51.374765 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:51.374655    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf" podStartSLOduration=1.05523709 podStartE2EDuration="4.374634678s" totalImagesPullingTime="3.319397588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:19:51.374136169 +0000 UTC m=+315.312174642" watchObservedRunningTime="2026-07-15 19:19:51.374634678 +0000 UTC m=+315.312673141"
Jul 15 19:19:51.405599 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:51.405547    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr" podStartSLOduration=1.7602430500000001 podStartE2EDuration="5.405510382s" totalImagesPullingTime="3.645267332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:19:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:19:51.403145874 +0000 UTC m=+315.341184344" watchObservedRunningTime="2026-07-15 19:19:51.405510382 +0000 UTC m=+315.343548853"
Jul 15 19:19:52.339191 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:19:52.339163    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2h2qf"
Jul 15 19:20:02.339018 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:20:02.338987    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-756b7fb4f9-6snlr"
Jul 15 19:21:41.025043 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.025008    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr"]
Jul 15 19:21:41.028091 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.028073    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr"
Jul 15 19:21:41.031369 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.031347    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 19:21:41.031714 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.031692    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-r4m2d\""
Jul 15 19:21:41.031714 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.031708    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 19:21:41.044776 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.044756    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr"]
Jul 15 19:21:41.142141 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.142112    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3856443f-bd16-41ce-bb22-4617d34406f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-dnkdr\" (UID: \"3856443f-bd16-41ce-bb22-4617d34406f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr"
Jul 15 19:21:41.142342 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.142160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vrhp\" (UniqueName: \"kubernetes.io/projected/3856443f-bd16-41ce-bb22-4617d34406f8-kube-api-access-2vrhp\") pod \"kuadrant-operator-controller-manager-55467d9f7-dnkdr\" (UID: \"3856443f-bd16-41ce-bb22-4617d34406f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr"
Jul 15 19:21:41.145593 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.145571    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr"]
Jul 15 19:21:41.145834 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:21:41.145815    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-2vrhp], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr" podUID="3856443f-bd16-41ce-bb22-4617d34406f8"
Jul 15 19:21:41.243464 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.243429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3856443f-bd16-41ce-bb22-4617d34406f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-dnkdr\" (UID: \"3856443f-bd16-41ce-bb22-4617d34406f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr"
Jul 15 19:21:41.243630 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.243471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vrhp\" (UniqueName: \"kubernetes.io/projected/3856443f-bd16-41ce-bb22-4617d34406f8-kube-api-access-2vrhp\") pod \"kuadrant-operator-controller-manager-55467d9f7-dnkdr\" (UID: \"3856443f-bd16-41ce-bb22-4617d34406f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr"
Jul 15 19:21:41.243817 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.243798    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3856443f-bd16-41ce-bb22-4617d34406f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-dnkdr\" (UID: \"3856443f-bd16-41ce-bb22-4617d34406f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr"
Jul 15 19:21:41.247081 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.247058    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr"]
Jul 15 19:21:41.255948 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.255895    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr"]
Jul 15 19:21:41.267640 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:21:41.267620    2565 projected.go:196] Error preparing data for projected volume kube-api-access-2vrhp for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr: failed to fetch token: pods "kuadrant-operator-controller-manager-55467d9f7-dnkdr" not found
Jul 15 19:21:41.267773 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:21:41.267692    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3856443f-bd16-41ce-bb22-4617d34406f8-kube-api-access-2vrhp podName:3856443f-bd16-41ce-bb22-4617d34406f8 nodeName:}" failed. No retries permitted until 2026-07-15 19:21:41.767670944 +0000 UTC m=+425.705709391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2vrhp" (UniqueName: "kubernetes.io/projected/3856443f-bd16-41ce-bb22-4617d34406f8-kube-api-access-2vrhp") pod "kuadrant-operator-controller-manager-55467d9f7-dnkdr" (UID: "3856443f-bd16-41ce-bb22-4617d34406f8") : failed to fetch token: pods "kuadrant-operator-controller-manager-55467d9f7-dnkdr" not found
Jul 15 19:21:41.348374 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.348341    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx"]
Jul 15 19:21:41.354261 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.354238    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx"
Jul 15 19:21:41.371995 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.371969    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx"]
Jul 15 19:21:41.451775 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.451739    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7687b73-1552-4ee2-a5a5-9721697a281e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9dzlx\" (UID: \"c7687b73-1552-4ee2-a5a5-9721697a281e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx"
Jul 15 19:21:41.451927 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.451788    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6lzk\" (UniqueName: \"kubernetes.io/projected/c7687b73-1552-4ee2-a5a5-9721697a281e-kube-api-access-q6lzk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9dzlx\" (UID: \"c7687b73-1552-4ee2-a5a5-9721697a281e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx"
Jul 15 19:21:41.552992 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.552958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7687b73-1552-4ee2-a5a5-9721697a281e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9dzlx\" (UID: \"c7687b73-1552-4ee2-a5a5-9721697a281e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx"
Jul 15 19:21:41.553167 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.552998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6lzk\" (UniqueName: \"kubernetes.io/projected/c7687b73-1552-4ee2-a5a5-9721697a281e-kube-api-access-q6lzk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9dzlx\" (UID: \"c7687b73-1552-4ee2-a5a5-9721697a281e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx"
Jul 15 19:21:41.553444 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.553421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7687b73-1552-4ee2-a5a5-9721697a281e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9dzlx\" (UID: \"c7687b73-1552-4ee2-a5a5-9721697a281e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx"
Jul 15 19:21:41.571259 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.571237    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6lzk\" (UniqueName: \"kubernetes.io/projected/c7687b73-1552-4ee2-a5a5-9721697a281e-kube-api-access-q6lzk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9dzlx\" (UID: \"c7687b73-1552-4ee2-a5a5-9721697a281e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx"
Jul 15 19:21:41.664842 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.664776    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx"
Jul 15 19:21:41.806503 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.806481    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx"]
Jul 15 19:21:41.808107 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:21:41.808081    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7687b73_1552_4ee2_a5a5_9721697a281e.slice/crio-4474f8d29b8400fb363478d1208a18e626c2a22c13af58269df559e43619ef16 WatchSource:0}: Error finding container 4474f8d29b8400fb363478d1208a18e626c2a22c13af58269df559e43619ef16: Status 404 returned error can't find the container with id 4474f8d29b8400fb363478d1208a18e626c2a22c13af58269df559e43619ef16
Jul 15 19:21:41.849391 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.849373    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr"
Jul 15 19:21:41.849504 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.849388    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx" event={"ID":"c7687b73-1552-4ee2-a5a5-9721697a281e","Type":"ContainerStarted","Data":"4474f8d29b8400fb363478d1208a18e626c2a22c13af58269df559e43619ef16"}
Jul 15 19:21:41.854744 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:21:41.854718    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-dnkdr\" is forbidden: User \"system:node:ip-10-0-134-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-30.ec2.internal' and this object" podUID="3856443f-bd16-41ce-bb22-4617d34406f8" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr"
Jul 15 19:21:41.856055 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.856036    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vrhp\" (UniqueName: \"kubernetes.io/projected/3856443f-bd16-41ce-bb22-4617d34406f8-kube-api-access-2vrhp\") pod \"kuadrant-operator-controller-manager-55467d9f7-dnkdr\" (UID: \"3856443f-bd16-41ce-bb22-4617d34406f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr"
Jul 15 19:21:41.857211 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.857177    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr"
Jul 15 19:21:41.859428 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:21:41.859413    2565 projected.go:196] Error preparing data for projected volume kube-api-access-2vrhp for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr: failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-dnkdr" not found
Jul 15 19:21:41.859488 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:21:41.859470    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3856443f-bd16-41ce-bb22-4617d34406f8-kube-api-access-2vrhp podName:3856443f-bd16-41ce-bb22-4617d34406f8 nodeName:}" failed. No retries permitted until 2026-07-15 19:21:42.859454462 +0000 UTC m=+426.797492909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vrhp" (UniqueName: "kubernetes.io/projected/3856443f-bd16-41ce-bb22-4617d34406f8-kube-api-access-2vrhp") pod "kuadrant-operator-controller-manager-55467d9f7-dnkdr" (UID: "3856443f-bd16-41ce-bb22-4617d34406f8") : failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-dnkdr" not found
Jul 15 19:21:41.860565 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:21:41.860545    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-dnkdr\" is forbidden: User \"system:node:ip-10-0-134-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-30.ec2.internal' and this object" podUID="3856443f-bd16-41ce-bb22-4617d34406f8" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr"
Jul 15 19:21:41.957076 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.956996    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3856443f-bd16-41ce-bb22-4617d34406f8-extensions-socket-volume\") pod \"3856443f-bd16-41ce-bb22-4617d34406f8\" (UID: \"3856443f-bd16-41ce-bb22-4617d34406f8\") "
Jul 15 19:21:41.957290 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.957269    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3856443f-bd16-41ce-bb22-4617d34406f8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3856443f-bd16-41ce-bb22-4617d34406f8" (UID: "3856443f-bd16-41ce-bb22-4617d34406f8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:21:41.957389 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.957377    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3856443f-bd16-41ce-bb22-4617d34406f8-extensions-socket-volume\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:21:41.957424 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:41.957391    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vrhp\" (UniqueName: \"kubernetes.io/projected/3856443f-bd16-41ce-bb22-4617d34406f8-kube-api-access-2vrhp\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:21:42.689646 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:42.689615    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3856443f-bd16-41ce-bb22-4617d34406f8" path="/var/lib/kubelet/pods/3856443f-bd16-41ce-bb22-4617d34406f8/volumes"
Jul 15 19:21:42.856023 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:42.855994    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr"
Jul 15 19:21:42.860619 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:21:42.860590    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-dnkdr\" is forbidden: User \"system:node:ip-10-0-134-30.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-30.ec2.internal' and this object" podUID="3856443f-bd16-41ce-bb22-4617d34406f8" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dnkdr"
Jul 15 19:21:47.882751 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:47.882711    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx" event={"ID":"c7687b73-1552-4ee2-a5a5-9721697a281e","Type":"ContainerStarted","Data":"ec998d835dba66af0b5d7f6849bf1243ac3df05927e48ac88649c60d2be71779"}
Jul 15 19:21:47.883163 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:47.882897    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx"
Jul 15 19:21:47.903370 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:47.903323    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx" podStartSLOduration=1.5194470230000001 podStartE2EDuration="6.90330854s" totalImagesPullingTime="5.383861517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:21:47.903188938 +0000 UTC m=+431.841227407" watchObservedRunningTime="2026-07-15 19:21:47.90330854 +0000 UTC m=+431.841347008"
Jul 15 19:21:53.477735 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.477695    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx"]
Jul 15 19:21:53.478147 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.477903    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx" podUID="c7687b73-1552-4ee2-a5a5-9721697a281e" containerName="manager" containerID="cri-o://ec998d835dba66af0b5d7f6849bf1243ac3df05927e48ac88649c60d2be71779" gracePeriod=10
Jul 15 19:21:53.479875 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.479850    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx"
Jul 15 19:21:53.733044 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.732973    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx"
Jul 15 19:21:53.875272 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.875236    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7687b73-1552-4ee2-a5a5-9721697a281e-extensions-socket-volume\") pod \"c7687b73-1552-4ee2-a5a5-9721697a281e\" (UID: \"c7687b73-1552-4ee2-a5a5-9721697a281e\") "
Jul 15 19:21:53.875437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.875359    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6lzk\" (UniqueName: \"kubernetes.io/projected/c7687b73-1552-4ee2-a5a5-9721697a281e-kube-api-access-q6lzk\") pod \"c7687b73-1552-4ee2-a5a5-9721697a281e\" (UID: \"c7687b73-1552-4ee2-a5a5-9721697a281e\") "
Jul 15 19:21:53.875706 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.875679    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7687b73-1552-4ee2-a5a5-9721697a281e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c7687b73-1552-4ee2-a5a5-9721697a281e" (UID: "c7687b73-1552-4ee2-a5a5-9721697a281e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:21:53.877641 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.877617    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7687b73-1552-4ee2-a5a5-9721697a281e-kube-api-access-q6lzk" (OuterVolumeSpecName: "kube-api-access-q6lzk") pod "c7687b73-1552-4ee2-a5a5-9721697a281e" (UID: "c7687b73-1552-4ee2-a5a5-9721697a281e"). InnerVolumeSpecName "kube-api-access-q6lzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:21:53.912603 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.912567    2565 generic.go:356] "Generic (PLEG): container finished" podID="c7687b73-1552-4ee2-a5a5-9721697a281e" containerID="ec998d835dba66af0b5d7f6849bf1243ac3df05927e48ac88649c60d2be71779" exitCode=0
Jul 15 19:21:53.912794 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.912614    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx"
Jul 15 19:21:53.912794 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.912658    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx" event={"ID":"c7687b73-1552-4ee2-a5a5-9721697a281e","Type":"ContainerDied","Data":"ec998d835dba66af0b5d7f6849bf1243ac3df05927e48ac88649c60d2be71779"}
Jul 15 19:21:53.912794 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.912716    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx" event={"ID":"c7687b73-1552-4ee2-a5a5-9721697a281e","Type":"ContainerDied","Data":"4474f8d29b8400fb363478d1208a18e626c2a22c13af58269df559e43619ef16"}
Jul 15 19:21:53.912794 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.912747    2565 scope.go:117] "RemoveContainer" containerID="ec998d835dba66af0b5d7f6849bf1243ac3df05927e48ac88649c60d2be71779"
Jul 15 19:21:53.922535 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.922517    2565 scope.go:117] "RemoveContainer" containerID="ec998d835dba66af0b5d7f6849bf1243ac3df05927e48ac88649c60d2be71779"
Jul 15 19:21:53.922859 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:21:53.922839    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec998d835dba66af0b5d7f6849bf1243ac3df05927e48ac88649c60d2be71779\": container with ID starting with ec998d835dba66af0b5d7f6849bf1243ac3df05927e48ac88649c60d2be71779 not found: ID does not exist" containerID="ec998d835dba66af0b5d7f6849bf1243ac3df05927e48ac88649c60d2be71779"
Jul 15 19:21:53.922920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.922872    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec998d835dba66af0b5d7f6849bf1243ac3df05927e48ac88649c60d2be71779"} err="failed to get container status \"ec998d835dba66af0b5d7f6849bf1243ac3df05927e48ac88649c60d2be71779\": rpc error: code = NotFound desc = could not find container \"ec998d835dba66af0b5d7f6849bf1243ac3df05927e48ac88649c60d2be71779\": container with ID starting with ec998d835dba66af0b5d7f6849bf1243ac3df05927e48ac88649c60d2be71779 not found: ID does not exist"
Jul 15 19:21:53.938172 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.938138    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx"]
Jul 15 19:21:53.952562 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.952531    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dzlx"]
Jul 15 19:21:53.976564 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.976530    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6lzk\" (UniqueName: \"kubernetes.io/projected/c7687b73-1552-4ee2-a5a5-9721697a281e-kube-api-access-q6lzk\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:21:53.976564 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:53.976562    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7687b73-1552-4ee2-a5a5-9721697a281e-extensions-socket-volume\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:21:54.688911 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:21:54.688877    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7687b73-1552-4ee2-a5a5-9721697a281e" path="/var/lib/kubelet/pods/c7687b73-1552-4ee2-a5a5-9721697a281e/volumes"
Jul 15 19:22:12.887533 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:12.887452    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"]
Jul 15 19:22:12.887888 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:12.887814    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7687b73-1552-4ee2-a5a5-9721697a281e" containerName="manager"
Jul 15 19:22:12.887888 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:12.887824    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7687b73-1552-4ee2-a5a5-9721697a281e" containerName="manager"
Jul 15 19:22:12.887961 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:12.887904    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7687b73-1552-4ee2-a5a5-9721697a281e" containerName="manager"
Jul 15 19:22:12.893696 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:12.893675    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"
Jul 15 19:22:12.896499 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:12.896472    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 19:22:12.896629 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:12.896472    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 19:22:12.897353 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:12.897339    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fj8vl\""
Jul 15 19:22:12.897353 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:12.897351    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 19:22:12.908183 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:12.908153    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"]
Jul 15 19:22:12.955255 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:12.955225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc3a4776-7662-4eb4-9033-7f573bd8bf3f-config-file\") pod \"limitador-limitador-64c94fd64f-r6jzt\" (UID: \"fc3a4776-7662-4eb4-9033-7f573bd8bf3f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"
Jul 15 19:22:12.955255 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:12.955258    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pn6j\" (UniqueName: \"kubernetes.io/projected/fc3a4776-7662-4eb4-9033-7f573bd8bf3f-kube-api-access-6pn6j\") pod \"limitador-limitador-64c94fd64f-r6jzt\" (UID: \"fc3a4776-7662-4eb4-9033-7f573bd8bf3f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"
Jul 15 19:22:12.962614 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:12.962585    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"]
Jul 15 19:22:13.056068 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:13.056028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc3a4776-7662-4eb4-9033-7f573bd8bf3f-config-file\") pod \"limitador-limitador-64c94fd64f-r6jzt\" (UID: \"fc3a4776-7662-4eb4-9033-7f573bd8bf3f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"
Jul 15 19:22:13.056068 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:13.056070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pn6j\" (UniqueName: \"kubernetes.io/projected/fc3a4776-7662-4eb4-9033-7f573bd8bf3f-kube-api-access-6pn6j\") pod \"limitador-limitador-64c94fd64f-r6jzt\" (UID: \"fc3a4776-7662-4eb4-9033-7f573bd8bf3f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"
Jul 15 19:22:13.056684 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:13.056664    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc3a4776-7662-4eb4-9033-7f573bd8bf3f-config-file\") pod \"limitador-limitador-64c94fd64f-r6jzt\" (UID: \"fc3a4776-7662-4eb4-9033-7f573bd8bf3f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"
Jul 15 19:22:13.067070 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:13.067040    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pn6j\" (UniqueName: \"kubernetes.io/projected/fc3a4776-7662-4eb4-9033-7f573bd8bf3f-kube-api-access-6pn6j\") pod \"limitador-limitador-64c94fd64f-r6jzt\" (UID: \"fc3a4776-7662-4eb4-9033-7f573bd8bf3f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"
Jul 15 19:22:13.203406 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:13.203321    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"
Jul 15 19:22:13.347666 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:13.347631    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"]
Jul 15 19:22:13.350594 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:22:13.350565    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc3a4776_7662_4eb4_9033_7f573bd8bf3f.slice/crio-4a75516338890ff809e1d0f27d88b81ebb0be647d690261ff45c5d06c2ac3841 WatchSource:0}: Error finding container 4a75516338890ff809e1d0f27d88b81ebb0be647d690261ff45c5d06c2ac3841: Status 404 returned error can't find the container with id 4a75516338890ff809e1d0f27d88b81ebb0be647d690261ff45c5d06c2ac3841
Jul 15 19:22:14.009036 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:14.008999    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6jzt" event={"ID":"fc3a4776-7662-4eb4-9033-7f573bd8bf3f","Type":"ContainerStarted","Data":"4a75516338890ff809e1d0f27d88b81ebb0be647d690261ff45c5d06c2ac3841"}
Jul 15 19:22:17.027318 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:17.027266    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6jzt" event={"ID":"fc3a4776-7662-4eb4-9033-7f573bd8bf3f","Type":"ContainerStarted","Data":"6266397bdc8351d76cf69969bdc19a5a9c141c15fed55ec8ab99b237f2b775fd"}
Jul 15 19:22:17.027723 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:17.027396    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"
Jul 15 19:22:27.470573 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:27.470504    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6jzt" podStartSLOduration=12.471058516 podStartE2EDuration="15.470482525s" totalImagesPullingTime="2.999424009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:22:17.081847814 +0000 UTC m=+461.019886283" watchObservedRunningTime="2026-07-15 19:22:27.470482525 +0000 UTC m=+471.408520995"
Jul 15 19:22:27.472091 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:27.472071    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"]
Jul 15 19:22:27.472328 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:27.472300    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6jzt" podUID="fc3a4776-7662-4eb4-9033-7f573bd8bf3f" containerName="limitador" containerID="cri-o://6266397bdc8351d76cf69969bdc19a5a9c141c15fed55ec8ab99b237f2b775fd" gracePeriod=30
Jul 15 19:22:27.473019 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:27.472914    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"
Jul 15 19:22:28.010026 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:28.009999    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"
Jul 15 19:22:28.080435 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:28.080331    2565 generic.go:356] "Generic (PLEG): container finished" podID="fc3a4776-7662-4eb4-9033-7f573bd8bf3f" containerID="6266397bdc8351d76cf69969bdc19a5a9c141c15fed55ec8ab99b237f2b775fd" exitCode=0
Jul 15 19:22:28.080435 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:28.080381    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"
Jul 15 19:22:28.080435 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:28.080387    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6jzt" event={"ID":"fc3a4776-7662-4eb4-9033-7f573bd8bf3f","Type":"ContainerDied","Data":"6266397bdc8351d76cf69969bdc19a5a9c141c15fed55ec8ab99b237f2b775fd"}
Jul 15 19:22:28.080435 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:28.080430    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6jzt" event={"ID":"fc3a4776-7662-4eb4-9033-7f573bd8bf3f","Type":"ContainerDied","Data":"4a75516338890ff809e1d0f27d88b81ebb0be647d690261ff45c5d06c2ac3841"}
Jul 15 19:22:28.080730 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:28.080451    2565 scope.go:117] "RemoveContainer" containerID="6266397bdc8351d76cf69969bdc19a5a9c141c15fed55ec8ab99b237f2b775fd"
Jul 15 19:22:28.088700 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:28.088672    2565 scope.go:117] "RemoveContainer" containerID="6266397bdc8351d76cf69969bdc19a5a9c141c15fed55ec8ab99b237f2b775fd"
Jul 15 19:22:28.088960 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:22:28.088939    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6266397bdc8351d76cf69969bdc19a5a9c141c15fed55ec8ab99b237f2b775fd\": container with ID starting with 6266397bdc8351d76cf69969bdc19a5a9c141c15fed55ec8ab99b237f2b775fd not found: ID does not exist" containerID="6266397bdc8351d76cf69969bdc19a5a9c141c15fed55ec8ab99b237f2b775fd"
Jul 15 19:22:28.089012 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:28.088970    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6266397bdc8351d76cf69969bdc19a5a9c141c15fed55ec8ab99b237f2b775fd"} err="failed to get container status \"6266397bdc8351d76cf69969bdc19a5a9c141c15fed55ec8ab99b237f2b775fd\": rpc error: code = NotFound desc = could not find container \"6266397bdc8351d76cf69969bdc19a5a9c141c15fed55ec8ab99b237f2b775fd\": container with ID starting with 6266397bdc8351d76cf69969bdc19a5a9c141c15fed55ec8ab99b237f2b775fd not found: ID does not exist"
Jul 15 19:22:28.096280 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:28.096254    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc3a4776-7662-4eb4-9033-7f573bd8bf3f-config-file\") pod \"fc3a4776-7662-4eb4-9033-7f573bd8bf3f\" (UID: \"fc3a4776-7662-4eb4-9033-7f573bd8bf3f\") "
Jul 15 19:22:28.096403 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:28.096293    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pn6j\" (UniqueName: \"kubernetes.io/projected/fc3a4776-7662-4eb4-9033-7f573bd8bf3f-kube-api-access-6pn6j\") pod \"fc3a4776-7662-4eb4-9033-7f573bd8bf3f\" (UID: \"fc3a4776-7662-4eb4-9033-7f573bd8bf3f\") "
Jul 15 19:22:28.096587 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:28.096567    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc3a4776-7662-4eb4-9033-7f573bd8bf3f-config-file" (OuterVolumeSpecName: "config-file") pod "fc3a4776-7662-4eb4-9033-7f573bd8bf3f" (UID: "fc3a4776-7662-4eb4-9033-7f573bd8bf3f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:22:28.098249 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:28.098230    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc3a4776-7662-4eb4-9033-7f573bd8bf3f-kube-api-access-6pn6j" (OuterVolumeSpecName: "kube-api-access-6pn6j") pod "fc3a4776-7662-4eb4-9033-7f573bd8bf3f" (UID: "fc3a4776-7662-4eb4-9033-7f573bd8bf3f"). InnerVolumeSpecName "kube-api-access-6pn6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:22:28.197554 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:28.197513    2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fc3a4776-7662-4eb4-9033-7f573bd8bf3f-config-file\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:22:28.197554 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:28.197544    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pn6j\" (UniqueName: \"kubernetes.io/projected/fc3a4776-7662-4eb4-9033-7f573bd8bf3f-kube-api-access-6pn6j\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:22:28.404942 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:28.404907    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"]
Jul 15 19:22:28.407352 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:28.407326    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6jzt"]
Jul 15 19:22:28.688548 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:28.688470    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc3a4776-7662-4eb4-9033-7f573bd8bf3f" path="/var/lib/kubelet/pods/fc3a4776-7662-4eb4-9033-7f573bd8bf3f/volumes"
Jul 15 19:22:29.436147 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:29.436106    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fjb5k"]
Jul 15 19:22:29.436516 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:29.436499    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc3a4776-7662-4eb4-9033-7f573bd8bf3f" containerName="limitador"
Jul 15 19:22:29.436516 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:29.436516    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc3a4776-7662-4eb4-9033-7f573bd8bf3f" containerName="limitador"
Jul 15 19:22:29.436690 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:29.436583    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc3a4776-7662-4eb4-9033-7f573bd8bf3f" containerName="limitador"
Jul 15 19:22:29.438392 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:29.438374    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fjb5k"
Jul 15 19:22:29.441033 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:29.441005    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-prw67\""
Jul 15 19:22:29.441153 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:29.441093    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:22:29.441153 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:29.441108    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 19:22:29.441624 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:29.441608    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 19:22:29.451624 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:29.451598    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fjb5k"]
Jul 15 19:22:29.508779 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:29.508741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e589e8a3-3c47-49b0-87da-fb0344d380ab-data\") pod \"postgres-69fb4594cf-fjb5k\" (UID: \"e589e8a3-3c47-49b0-87da-fb0344d380ab\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fjb5k"
Jul 15 19:22:29.508965 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:29.508805    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5r9l\" (UniqueName: \"kubernetes.io/projected/e589e8a3-3c47-49b0-87da-fb0344d380ab-kube-api-access-x5r9l\") pod \"postgres-69fb4594cf-fjb5k\" (UID: \"e589e8a3-3c47-49b0-87da-fb0344d380ab\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fjb5k"
Jul 15 19:22:29.609605 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:29.609567    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e589e8a3-3c47-49b0-87da-fb0344d380ab-data\") pod \"postgres-69fb4594cf-fjb5k\" (UID: \"e589e8a3-3c47-49b0-87da-fb0344d380ab\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fjb5k"
Jul 15 19:22:29.609785 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:29.609633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5r9l\" (UniqueName: \"kubernetes.io/projected/e589e8a3-3c47-49b0-87da-fb0344d380ab-kube-api-access-x5r9l\") pod \"postgres-69fb4594cf-fjb5k\" (UID: \"e589e8a3-3c47-49b0-87da-fb0344d380ab\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fjb5k"
Jul 15 19:22:29.609955 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:29.609935    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e589e8a3-3c47-49b0-87da-fb0344d380ab-data\") pod \"postgres-69fb4594cf-fjb5k\" (UID: \"e589e8a3-3c47-49b0-87da-fb0344d380ab\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fjb5k"
Jul 15 19:22:29.620000 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:29.619976    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5r9l\" (UniqueName: \"kubernetes.io/projected/e589e8a3-3c47-49b0-87da-fb0344d380ab-kube-api-access-x5r9l\") pod \"postgres-69fb4594cf-fjb5k\" (UID: \"e589e8a3-3c47-49b0-87da-fb0344d380ab\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fjb5k"
Jul 15 19:22:29.748597 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:29.748512    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fjb5k"
Jul 15 19:22:29.888435 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:29.888403    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fjb5k"]
Jul 15 19:22:29.891469 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:22:29.891437    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode589e8a3_3c47_49b0_87da_fb0344d380ab.slice/crio-f68fe1278a0f43183dcf71232d9c4b814555e1fcc7daecb0ca8af862eafc6c4c WatchSource:0}: Error finding container f68fe1278a0f43183dcf71232d9c4b814555e1fcc7daecb0ca8af862eafc6c4c: Status 404 returned error can't find the container with id f68fe1278a0f43183dcf71232d9c4b814555e1fcc7daecb0ca8af862eafc6c4c
Jul 15 19:22:30.091920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:30.091837    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fjb5k" event={"ID":"e589e8a3-3c47-49b0-87da-fb0344d380ab","Type":"ContainerStarted","Data":"f68fe1278a0f43183dcf71232d9c4b814555e1fcc7daecb0ca8af862eafc6c4c"}
Jul 15 19:22:35.124513 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:35.124476    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fjb5k" event={"ID":"e589e8a3-3c47-49b0-87da-fb0344d380ab","Type":"ContainerStarted","Data":"495ec63aa2ea61a054bd412f2a5c5a623a61b0b26694a7c4b789709f3db4d388"}
Jul 15 19:22:35.124881 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:35.124558    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fjb5k"
Jul 15 19:22:35.154742 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:35.154672    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fjb5k" podStartSLOduration=1.223954593 podStartE2EDuration="6.154648292s" totalImagesPullingTime="4.930693699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:22:35.154159685 +0000 UTC m=+479.092198155" watchObservedRunningTime="2026-07-15 19:22:35.154648292 +0000 UTC m=+479.092686763"
Jul 15 19:22:41.159563 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:41.159532    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fjb5k"
Jul 15 19:22:48.899926 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:48.899887    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57f5fd47cc-2q24g"]
Jul 15 19:22:48.925946 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:48.925908    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57f5fd47cc-2q24g"]
Jul 15 19:22:48.925946 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:48.925944    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57f5fd47cc-2q24g"
Jul 15 19:22:48.928566 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:48.928541    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 19:22:48.928710 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:48.928572    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 19:22:48.928710 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:48.928594    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xd42d\""
Jul 15 19:22:48.991650 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:48.991614    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgc4b\" (UniqueName: \"kubernetes.io/projected/2a444062-44e7-49e5-a6b7-7fd5f73582b5-kube-api-access-kgc4b\") pod \"maas-controller-57f5fd47cc-2q24g\" (UID: \"2a444062-44e7-49e5-a6b7-7fd5f73582b5\") " pod="opendatahub/maas-controller-57f5fd47cc-2q24g"
Jul 15 19:22:48.991818 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:48.991679    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a444062-44e7-49e5-a6b7-7fd5f73582b5-webhook-cert\") pod \"maas-controller-57f5fd47cc-2q24g\" (UID: \"2a444062-44e7-49e5-a6b7-7fd5f73582b5\") " pod="opendatahub/maas-controller-57f5fd47cc-2q24g"
Jul 15 19:22:49.092174 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:49.092127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a444062-44e7-49e5-a6b7-7fd5f73582b5-webhook-cert\") pod \"maas-controller-57f5fd47cc-2q24g\" (UID: \"2a444062-44e7-49e5-a6b7-7fd5f73582b5\") " pod="opendatahub/maas-controller-57f5fd47cc-2q24g"
Jul 15 19:22:49.092377 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:49.092236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgc4b\" (UniqueName: \"kubernetes.io/projected/2a444062-44e7-49e5-a6b7-7fd5f73582b5-kube-api-access-kgc4b\") pod \"maas-controller-57f5fd47cc-2q24g\" (UID: \"2a444062-44e7-49e5-a6b7-7fd5f73582b5\") " pod="opendatahub/maas-controller-57f5fd47cc-2q24g"
Jul 15 19:22:49.092377 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:22:49.092336    2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 15 19:22:49.092448 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:22:49.092412    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a444062-44e7-49e5-a6b7-7fd5f73582b5-webhook-cert podName:2a444062-44e7-49e5-a6b7-7fd5f73582b5 nodeName:}" failed. No retries permitted until 2026-07-15 19:22:49.592385727 +0000 UTC m=+493.530424407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/2a444062-44e7-49e5-a6b7-7fd5f73582b5-webhook-cert") pod "maas-controller-57f5fd47cc-2q24g" (UID: "2a444062-44e7-49e5-a6b7-7fd5f73582b5") : secret "maas-controller-webhook-cert" not found
Jul 15 19:22:49.100054 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:49.096835    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65ff68966d-fgkrq"]
Jul 15 19:22:49.101724 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:49.101691    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65ff68966d-fgkrq"
Jul 15 19:22:49.104887 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:49.104861    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgc4b\" (UniqueName: \"kubernetes.io/projected/2a444062-44e7-49e5-a6b7-7fd5f73582b5-kube-api-access-kgc4b\") pod \"maas-controller-57f5fd47cc-2q24g\" (UID: \"2a444062-44e7-49e5-a6b7-7fd5f73582b5\") " pod="opendatahub/maas-controller-57f5fd47cc-2q24g"
Jul 15 19:22:49.110387 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:49.110348    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65ff68966d-fgkrq"]
Jul 15 19:22:49.192812 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:49.192721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/960053b6-b2f6-4bd4-be73-92c1e11caa03-webhook-cert\") pod \"maas-controller-65ff68966d-fgkrq\" (UID: \"960053b6-b2f6-4bd4-be73-92c1e11caa03\") " pod="opendatahub/maas-controller-65ff68966d-fgkrq"
Jul 15 19:22:49.192812 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:49.192780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7k98\" (UniqueName: \"kubernetes.io/projected/960053b6-b2f6-4bd4-be73-92c1e11caa03-kube-api-access-p7k98\") pod \"maas-controller-65ff68966d-fgkrq\" (UID: \"960053b6-b2f6-4bd4-be73-92c1e11caa03\") " pod="opendatahub/maas-controller-65ff68966d-fgkrq"
Jul 15 19:22:49.293572 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:49.293534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/960053b6-b2f6-4bd4-be73-92c1e11caa03-webhook-cert\") pod \"maas-controller-65ff68966d-fgkrq\" (UID: \"960053b6-b2f6-4bd4-be73-92c1e11caa03\") " pod="opendatahub/maas-controller-65ff68966d-fgkrq"
Jul 15 19:22:49.293734 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:49.293582    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7k98\" (UniqueName: \"kubernetes.io/projected/960053b6-b2f6-4bd4-be73-92c1e11caa03-kube-api-access-p7k98\") pod \"maas-controller-65ff68966d-fgkrq\" (UID: \"960053b6-b2f6-4bd4-be73-92c1e11caa03\") " pod="opendatahub/maas-controller-65ff68966d-fgkrq"
Jul 15 19:22:49.293734 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:22:49.293687    2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 15 19:22:49.293802 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:22:49.293750    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/960053b6-b2f6-4bd4-be73-92c1e11caa03-webhook-cert podName:960053b6-b2f6-4bd4-be73-92c1e11caa03 nodeName:}" failed. No retries permitted until 2026-07-15 19:22:49.793734001 +0000 UTC m=+493.731772451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/960053b6-b2f6-4bd4-be73-92c1e11caa03-webhook-cert") pod "maas-controller-65ff68966d-fgkrq" (UID: "960053b6-b2f6-4bd4-be73-92c1e11caa03") : secret "maas-controller-webhook-cert" not found
Jul 15 19:22:49.304004 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:49.303969    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7k98\" (UniqueName: \"kubernetes.io/projected/960053b6-b2f6-4bd4-be73-92c1e11caa03-kube-api-access-p7k98\") pod \"maas-controller-65ff68966d-fgkrq\" (UID: \"960053b6-b2f6-4bd4-be73-92c1e11caa03\") " pod="opendatahub/maas-controller-65ff68966d-fgkrq"
Jul 15 19:22:49.596504 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:49.596404    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a444062-44e7-49e5-a6b7-7fd5f73582b5-webhook-cert\") pod \"maas-controller-57f5fd47cc-2q24g\" (UID: \"2a444062-44e7-49e5-a6b7-7fd5f73582b5\") " pod="opendatahub/maas-controller-57f5fd47cc-2q24g"
Jul 15 19:22:49.598729 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:49.598707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a444062-44e7-49e5-a6b7-7fd5f73582b5-webhook-cert\") pod \"maas-controller-57f5fd47cc-2q24g\" (UID: \"2a444062-44e7-49e5-a6b7-7fd5f73582b5\") " pod="opendatahub/maas-controller-57f5fd47cc-2q24g"
Jul 15 19:22:49.798020 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:49.797989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/960053b6-b2f6-4bd4-be73-92c1e11caa03-webhook-cert\") pod \"maas-controller-65ff68966d-fgkrq\" (UID: \"960053b6-b2f6-4bd4-be73-92c1e11caa03\") " pod="opendatahub/maas-controller-65ff68966d-fgkrq"
Jul 15 19:22:49.800395 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:49.800371    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/960053b6-b2f6-4bd4-be73-92c1e11caa03-webhook-cert\") pod \"maas-controller-65ff68966d-fgkrq\" (UID: \"960053b6-b2f6-4bd4-be73-92c1e11caa03\") " pod="opendatahub/maas-controller-65ff68966d-fgkrq"
Jul 15 19:22:49.836593 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:49.836561    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57f5fd47cc-2q24g"
Jul 15 19:22:49.976939 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:49.976912    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57f5fd47cc-2q24g"]
Jul 15 19:22:49.978652 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:22:49.978624    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a444062_44e7_49e5_a6b7_7fd5f73582b5.slice/crio-2213c9d616a0383d6f82a9d6b9723aabbb5224e8cb89bc66e49e5f90e8926ef5 WatchSource:0}: Error finding container 2213c9d616a0383d6f82a9d6b9723aabbb5224e8cb89bc66e49e5f90e8926ef5: Status 404 returned error can't find the container with id 2213c9d616a0383d6f82a9d6b9723aabbb5224e8cb89bc66e49e5f90e8926ef5
Jul 15 19:22:50.021699 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:50.021678    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65ff68966d-fgkrq"
Jul 15 19:22:50.160855 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:50.160827    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65ff68966d-fgkrq"]
Jul 15 19:22:50.162560 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:22:50.162532    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960053b6_b2f6_4bd4_be73_92c1e11caa03.slice/crio-b0e2da7a74b5c37eb6f74df6efd3e153fa48695f6c8632d6e61845cd0f79122c WatchSource:0}: Error finding container b0e2da7a74b5c37eb6f74df6efd3e153fa48695f6c8632d6e61845cd0f79122c: Status 404 returned error can't find the container with id b0e2da7a74b5c37eb6f74df6efd3e153fa48695f6c8632d6e61845cd0f79122c
Jul 15 19:22:50.198988 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:50.198952    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57f5fd47cc-2q24g" event={"ID":"2a444062-44e7-49e5-a6b7-7fd5f73582b5","Type":"ContainerStarted","Data":"2213c9d616a0383d6f82a9d6b9723aabbb5224e8cb89bc66e49e5f90e8926ef5"}
Jul 15 19:22:50.199973 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:50.199954    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65ff68966d-fgkrq" event={"ID":"960053b6-b2f6-4bd4-be73-92c1e11caa03","Type":"ContainerStarted","Data":"b0e2da7a74b5c37eb6f74df6efd3e153fa48695f6c8632d6e61845cd0f79122c"}
Jul 15 19:22:53.218219 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:53.218162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57f5fd47cc-2q24g" event={"ID":"2a444062-44e7-49e5-a6b7-7fd5f73582b5","Type":"ContainerStarted","Data":"fad9f579ab9cfae76d2f95ecde4f1488c12c01a10094480fc065742a6fa0c337"}
Jul 15 19:22:53.218686 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:53.218356    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57f5fd47cc-2q24g"
Jul 15 19:22:53.219711 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:53.219679    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65ff68966d-fgkrq" event={"ID":"960053b6-b2f6-4bd4-be73-92c1e11caa03","Type":"ContainerStarted","Data":"e2caedd887774c06bdfcf11cd64f6a041babf1c7659aa428580c7ff6762f0e9e"}
Jul 15 19:22:53.219834 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:53.219804    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65ff68966d-fgkrq"
Jul 15 19:22:53.251054 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:53.251005    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57f5fd47cc-2q24g" podStartSLOduration=2.434172393 podStartE2EDuration="5.250989907s" totalImagesPullingTime="2.816817514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:22:53.248691494 +0000 UTC m=+497.186729964" watchObservedRunningTime="2026-07-15 19:22:53.250989907 +0000 UTC m=+497.189028375"
Jul 15 19:22:53.271826 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:22:53.271773    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65ff68966d-fgkrq" podStartSLOduration=1.628529559 podStartE2EDuration="4.271757366s" totalImagesPullingTime="2.643227807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:22:53.269648356 +0000 UTC m=+497.207686825" watchObservedRunningTime="2026-07-15 19:22:53.271757366 +0000 UTC m=+497.209795835"
Jul 15 19:23:04.225598 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:04.225567    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65ff68966d-fgkrq"
Jul 15 19:23:04.226122 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:04.225651    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57f5fd47cc-2q24g"
Jul 15 19:23:04.300260 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:04.300218    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57f5fd47cc-2q24g"]
Jul 15 19:23:04.300520 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:04.300489    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-57f5fd47cc-2q24g" podUID="2a444062-44e7-49e5-a6b7-7fd5f73582b5" containerName="manager" containerID="cri-o://fad9f579ab9cfae76d2f95ecde4f1488c12c01a10094480fc065742a6fa0c337" gracePeriod=30
Jul 15 19:23:04.549809 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:04.549786    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57f5fd47cc-2q24g"
Jul 15 19:23:04.632905 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:04.632873    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgc4b\" (UniqueName: \"kubernetes.io/projected/2a444062-44e7-49e5-a6b7-7fd5f73582b5-kube-api-access-kgc4b\") pod \"2a444062-44e7-49e5-a6b7-7fd5f73582b5\" (UID: \"2a444062-44e7-49e5-a6b7-7fd5f73582b5\") "
Jul 15 19:23:04.633077 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:04.632975    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a444062-44e7-49e5-a6b7-7fd5f73582b5-webhook-cert\") pod \"2a444062-44e7-49e5-a6b7-7fd5f73582b5\" (UID: \"2a444062-44e7-49e5-a6b7-7fd5f73582b5\") "
Jul 15 19:23:04.635073 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:04.635040    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a444062-44e7-49e5-a6b7-7fd5f73582b5-kube-api-access-kgc4b" (OuterVolumeSpecName: "kube-api-access-kgc4b") pod "2a444062-44e7-49e5-a6b7-7fd5f73582b5" (UID: "2a444062-44e7-49e5-a6b7-7fd5f73582b5"). InnerVolumeSpecName "kube-api-access-kgc4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:23:04.635186 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:04.635122    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a444062-44e7-49e5-a6b7-7fd5f73582b5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2a444062-44e7-49e5-a6b7-7fd5f73582b5" (UID: "2a444062-44e7-49e5-a6b7-7fd5f73582b5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:23:04.733965 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:04.733933    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a444062-44e7-49e5-a6b7-7fd5f73582b5-webhook-cert\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:23:04.733965 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:04.733960    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgc4b\" (UniqueName: \"kubernetes.io/projected/2a444062-44e7-49e5-a6b7-7fd5f73582b5-kube-api-access-kgc4b\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:23:05.276718 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:05.276683    2565 generic.go:356] "Generic (PLEG): container finished" podID="2a444062-44e7-49e5-a6b7-7fd5f73582b5" containerID="fad9f579ab9cfae76d2f95ecde4f1488c12c01a10094480fc065742a6fa0c337" exitCode=0
Jul 15 19:23:05.277242 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:05.276726    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57f5fd47cc-2q24g"
Jul 15 19:23:05.277242 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:05.276770    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57f5fd47cc-2q24g" event={"ID":"2a444062-44e7-49e5-a6b7-7fd5f73582b5","Type":"ContainerDied","Data":"fad9f579ab9cfae76d2f95ecde4f1488c12c01a10094480fc065742a6fa0c337"}
Jul 15 19:23:05.277242 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:05.276842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57f5fd47cc-2q24g" event={"ID":"2a444062-44e7-49e5-a6b7-7fd5f73582b5","Type":"ContainerDied","Data":"2213c9d616a0383d6f82a9d6b9723aabbb5224e8cb89bc66e49e5f90e8926ef5"}
Jul 15 19:23:05.277242 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:05.276883    2565 scope.go:117] "RemoveContainer" containerID="fad9f579ab9cfae76d2f95ecde4f1488c12c01a10094480fc065742a6fa0c337"
Jul 15 19:23:05.285867 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:05.285848    2565 scope.go:117] "RemoveContainer" containerID="fad9f579ab9cfae76d2f95ecde4f1488c12c01a10094480fc065742a6fa0c337"
Jul 15 19:23:05.286167 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:23:05.286144    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fad9f579ab9cfae76d2f95ecde4f1488c12c01a10094480fc065742a6fa0c337\": container with ID starting with fad9f579ab9cfae76d2f95ecde4f1488c12c01a10094480fc065742a6fa0c337 not found: ID does not exist" containerID="fad9f579ab9cfae76d2f95ecde4f1488c12c01a10094480fc065742a6fa0c337"
Jul 15 19:23:05.286288 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:05.286174    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fad9f579ab9cfae76d2f95ecde4f1488c12c01a10094480fc065742a6fa0c337"} err="failed to get container status \"fad9f579ab9cfae76d2f95ecde4f1488c12c01a10094480fc065742a6fa0c337\": rpc error: code = NotFound desc = could not find container \"fad9f579ab9cfae76d2f95ecde4f1488c12c01a10094480fc065742a6fa0c337\": container with ID starting with fad9f579ab9cfae76d2f95ecde4f1488c12c01a10094480fc065742a6fa0c337 not found: ID does not exist"
Jul 15 19:23:05.297377 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:05.297345    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57f5fd47cc-2q24g"]
Jul 15 19:23:05.300480 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:05.300450    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-57f5fd47cc-2q24g"]
Jul 15 19:23:06.689671 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:06.689634    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a444062-44e7-49e5-a6b7-7fd5f73582b5" path="/var/lib/kubelet/pods/2a444062-44e7-49e5-a6b7-7fd5f73582b5/volumes"
Jul 15 19:23:26.602080 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:26.602047    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-745557885d-z2c22"]
Jul 15 19:23:26.602450 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:26.602428    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a444062-44e7-49e5-a6b7-7fd5f73582b5" containerName="manager"
Jul 15 19:23:26.602450 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:26.602440    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a444062-44e7-49e5-a6b7-7fd5f73582b5" containerName="manager"
Jul 15 19:23:26.602521 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:26.602510    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a444062-44e7-49e5-a6b7-7fd5f73582b5" containerName="manager"
Jul 15 19:23:26.607241 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:26.607196    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-745557885d-z2c22"
Jul 15 19:23:26.610736 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:26.610718    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fdc29\""
Jul 15 19:23:26.611495 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:26.611477    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 15 19:23:26.655401 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:26.654948    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-745557885d-z2c22"]
Jul 15 19:23:26.739790 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:26.739753    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f220d278-cec6-47c7-b45e-29449d311485-openshift-service-ca\") pod \"maas-api-745557885d-z2c22\" (UID: \"f220d278-cec6-47c7-b45e-29449d311485\") " pod="odh-ai-gateway-infra/maas-api-745557885d-z2c22"
Jul 15 19:23:26.739790 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:26.739794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4z82\" (UniqueName: \"kubernetes.io/projected/f220d278-cec6-47c7-b45e-29449d311485-kube-api-access-c4z82\") pod \"maas-api-745557885d-z2c22\" (UID: \"f220d278-cec6-47c7-b45e-29449d311485\") " pod="odh-ai-gateway-infra/maas-api-745557885d-z2c22"
Jul 15 19:23:26.740010 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:26.739878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f220d278-cec6-47c7-b45e-29449d311485-maas-api-tls\") pod \"maas-api-745557885d-z2c22\" (UID: \"f220d278-cec6-47c7-b45e-29449d311485\") " pod="odh-ai-gateway-infra/maas-api-745557885d-z2c22"
Jul 15 19:23:26.841266 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:26.841236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f220d278-cec6-47c7-b45e-29449d311485-maas-api-tls\") pod \"maas-api-745557885d-z2c22\" (UID: \"f220d278-cec6-47c7-b45e-29449d311485\") " pod="odh-ai-gateway-infra/maas-api-745557885d-z2c22"
Jul 15 19:23:26.841427 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:26.841326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f220d278-cec6-47c7-b45e-29449d311485-openshift-service-ca\") pod \"maas-api-745557885d-z2c22\" (UID: \"f220d278-cec6-47c7-b45e-29449d311485\") " pod="odh-ai-gateway-infra/maas-api-745557885d-z2c22"
Jul 15 19:23:26.841427 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:26.841349    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4z82\" (UniqueName: \"kubernetes.io/projected/f220d278-cec6-47c7-b45e-29449d311485-kube-api-access-c4z82\") pod \"maas-api-745557885d-z2c22\" (UID: \"f220d278-cec6-47c7-b45e-29449d311485\") " pod="odh-ai-gateway-infra/maas-api-745557885d-z2c22"
Jul 15 19:23:26.842085 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:26.842064    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f220d278-cec6-47c7-b45e-29449d311485-openshift-service-ca\") pod \"maas-api-745557885d-z2c22\" (UID: \"f220d278-cec6-47c7-b45e-29449d311485\") " pod="odh-ai-gateway-infra/maas-api-745557885d-z2c22"
Jul 15 19:23:26.843612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:26.843591    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f220d278-cec6-47c7-b45e-29449d311485-maas-api-tls\") pod \"maas-api-745557885d-z2c22\" (UID: \"f220d278-cec6-47c7-b45e-29449d311485\") " pod="odh-ai-gateway-infra/maas-api-745557885d-z2c22"
Jul 15 19:23:26.851593 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:26.851572    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4z82\" (UniqueName: \"kubernetes.io/projected/f220d278-cec6-47c7-b45e-29449d311485-kube-api-access-c4z82\") pod \"maas-api-745557885d-z2c22\" (UID: \"f220d278-cec6-47c7-b45e-29449d311485\") " pod="odh-ai-gateway-infra/maas-api-745557885d-z2c22"
Jul 15 19:23:26.917359 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:26.917292    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-745557885d-z2c22"
Jul 15 19:23:27.059711 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.059690    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-745557885d-z2c22"]
Jul 15 19:23:27.062375 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:23:27.062345    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf220d278_cec6_47c7_b45e_29449d311485.slice/crio-eba5e67f129cdc4a011c698f8548ae1aa3674d7e4a2c114f54f63e7c0bdbe1af WatchSource:0}: Error finding container eba5e67f129cdc4a011c698f8548ae1aa3674d7e4a2c114f54f63e7c0bdbe1af: Status 404 returned error can't find the container with id eba5e67f129cdc4a011c698f8548ae1aa3674d7e4a2c114f54f63e7c0bdbe1af
Jul 15 19:23:27.378536 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.378503    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-745557885d-z2c22" event={"ID":"f220d278-cec6-47c7-b45e-29449d311485","Type":"ContainerStarted","Data":"eba5e67f129cdc4a011c698f8548ae1aa3674d7e4a2c114f54f63e7c0bdbe1af"}
Jul 15 19:23:27.409803 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.409771    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-khp7q"]
Jul 15 19:23:27.412787 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.412765    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-khp7q"
Jul 15 19:23:27.415619 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.415600    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xk64m\""
Jul 15 19:23:27.415837 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.415821    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 15 19:23:27.425129 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.425110    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-khp7q"]
Jul 15 19:23:27.514312 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.514291    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-jc9j7"]
Jul 15 19:23:27.516591 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.516576    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-jc9j7"
Jul 15 19:23:27.535792 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.535773    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-jc9j7"]
Jul 15 19:23:27.547360 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.547336    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41208604-de23-480c-b7eb-ab8f81054d08-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-khp7q\" (UID: \"41208604-de23-480c-b7eb-ab8f81054d08\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-khp7q"
Jul 15 19:23:27.547488 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.547378    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt94q\" (UniqueName: \"kubernetes.io/projected/41208604-de23-480c-b7eb-ab8f81054d08-kube-api-access-vt94q\") pod \"payload-pre-processing-74584bb9f8-khp7q\" (UID: \"41208604-de23-480c-b7eb-ab8f81054d08\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-khp7q"
Jul 15 19:23:27.648323 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.648244    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67f135b2-4e28-4a97-99c6-4f8cbe76cbde-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-jc9j7\" (UID: \"67f135b2-4e28-4a97-99c6-4f8cbe76cbde\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-jc9j7"
Jul 15 19:23:27.648323 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.648291    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41208604-de23-480c-b7eb-ab8f81054d08-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-khp7q\" (UID: \"41208604-de23-480c-b7eb-ab8f81054d08\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-khp7q"
Jul 15 19:23:27.648704 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.648362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt94q\" (UniqueName: \"kubernetes.io/projected/41208604-de23-480c-b7eb-ab8f81054d08-kube-api-access-vt94q\") pod \"payload-pre-processing-74584bb9f8-khp7q\" (UID: \"41208604-de23-480c-b7eb-ab8f81054d08\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-khp7q"
Jul 15 19:23:27.648704 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.648455    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l25vc\" (UniqueName: \"kubernetes.io/projected/67f135b2-4e28-4a97-99c6-4f8cbe76cbde-kube-api-access-l25vc\") pod \"payload-processing-f9b8d9b9b-jc9j7\" (UID: \"67f135b2-4e28-4a97-99c6-4f8cbe76cbde\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-jc9j7"
Jul 15 19:23:27.649009 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.648989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41208604-de23-480c-b7eb-ab8f81054d08-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-khp7q\" (UID: \"41208604-de23-480c-b7eb-ab8f81054d08\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-khp7q"
Jul 15 19:23:27.659467 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.659447    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt94q\" (UniqueName: \"kubernetes.io/projected/41208604-de23-480c-b7eb-ab8f81054d08-kube-api-access-vt94q\") pod \"payload-pre-processing-74584bb9f8-khp7q\" (UID: \"41208604-de23-480c-b7eb-ab8f81054d08\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-khp7q"
Jul 15 19:23:27.723278 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.723258    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-khp7q"
Jul 15 19:23:27.749989 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.749956    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l25vc\" (UniqueName: \"kubernetes.io/projected/67f135b2-4e28-4a97-99c6-4f8cbe76cbde-kube-api-access-l25vc\") pod \"payload-processing-f9b8d9b9b-jc9j7\" (UID: \"67f135b2-4e28-4a97-99c6-4f8cbe76cbde\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-jc9j7"
Jul 15 19:23:27.750099 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.750032    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67f135b2-4e28-4a97-99c6-4f8cbe76cbde-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-jc9j7\" (UID: \"67f135b2-4e28-4a97-99c6-4f8cbe76cbde\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-jc9j7"
Jul 15 19:23:27.750719 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.750701    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67f135b2-4e28-4a97-99c6-4f8cbe76cbde-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-jc9j7\" (UID: \"67f135b2-4e28-4a97-99c6-4f8cbe76cbde\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-jc9j7"
Jul 15 19:23:27.764952 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.764929    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l25vc\" (UniqueName: \"kubernetes.io/projected/67f135b2-4e28-4a97-99c6-4f8cbe76cbde-kube-api-access-l25vc\") pod \"payload-processing-f9b8d9b9b-jc9j7\" (UID: \"67f135b2-4e28-4a97-99c6-4f8cbe76cbde\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-jc9j7"
Jul 15 19:23:27.826690 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.826654    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-jc9j7"
Jul 15 19:23:27.981629 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:27.981599    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-jc9j7"]
Jul 15 19:23:27.984032 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:23:27.983952    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f135b2_4e28_4a97_99c6_4f8cbe76cbde.slice/crio-35d1a863104bc22d818313534a8e5c15bbbfdb8fe5f6f818bc99dcd4fc83d59f WatchSource:0}: Error finding container 35d1a863104bc22d818313534a8e5c15bbbfdb8fe5f6f818bc99dcd4fc83d59f: Status 404 returned error can't find the container with id 35d1a863104bc22d818313534a8e5c15bbbfdb8fe5f6f818bc99dcd4fc83d59f
Jul 15 19:23:28.067186 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:28.067154    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-khp7q"]
Jul 15 19:23:28.069499 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:23:28.069470    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41208604_de23_480c_b7eb_ab8f81054d08.slice/crio-a7a597b0085b8fe4173797401fd508e498a5a76964570b97b5618463efe7683d WatchSource:0}: Error finding container a7a597b0085b8fe4173797401fd508e498a5a76964570b97b5618463efe7683d: Status 404 returned error can't find the container with id a7a597b0085b8fe4173797401fd508e498a5a76964570b97b5618463efe7683d
Jul 15 19:23:28.383931 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:28.383899    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-jc9j7" event={"ID":"67f135b2-4e28-4a97-99c6-4f8cbe76cbde","Type":"ContainerStarted","Data":"35d1a863104bc22d818313534a8e5c15bbbfdb8fe5f6f818bc99dcd4fc83d59f"}
Jul 15 19:23:28.385291 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:28.385265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-khp7q" event={"ID":"41208604-de23-480c-b7eb-ab8f81054d08","Type":"ContainerStarted","Data":"a7a597b0085b8fe4173797401fd508e498a5a76964570b97b5618463efe7683d"}
Jul 15 19:23:29.393920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:29.393878    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-745557885d-z2c22" event={"ID":"f220d278-cec6-47c7-b45e-29449d311485","Type":"ContainerStarted","Data":"dbedacc78e2ed2cfe3a2b72f26678f38474c30be22e62038069fbd0c31d32019"}
Jul 15 19:23:29.394340 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:29.394034    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-745557885d-z2c22"
Jul 15 19:23:29.415872 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:29.415821    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-745557885d-z2c22" podStartSLOduration=1.63356038 podStartE2EDuration="3.415800803s" totalImagesPullingTime="1.782240423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:23:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:23:29.412993772 +0000 UTC m=+533.351032236" watchObservedRunningTime="2026-07-15 19:23:29.415800803 +0000 UTC m=+533.353839273"
Jul 15 19:23:30.400324 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:30.400286    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-jc9j7" event={"ID":"67f135b2-4e28-4a97-99c6-4f8cbe76cbde","Type":"ContainerStarted","Data":"8d6d648dacae0cbb0ea151c027deae6e66b6e8e5ad319bf10d5fc7e0f4eb69e2"}
Jul 15 19:23:30.400828 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:30.400413    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-jc9j7"
Jul 15 19:23:30.401864 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:30.401835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-khp7q" event={"ID":"41208604-de23-480c-b7eb-ab8f81054d08","Type":"ContainerStarted","Data":"a70814abfce44511344a7fbf1ab79d05f47a07c74b061098f0d2389c2a3469af"}
Jul 15 19:23:30.401977 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:30.401962    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-khp7q"
Jul 15 19:23:30.423069 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:30.423018    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-jc9j7" podStartSLOduration=1.699665844 podStartE2EDuration="3.423001834s" totalImagesPullingTime="1.72333599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:23:30.422230945 +0000 UTC m=+534.360269414" watchObservedRunningTime="2026-07-15 19:23:30.423001834 +0000 UTC m=+534.361040306"
Jul 15 19:23:30.445269 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:30.445228    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-khp7q" podStartSLOduration=1.804774552 podStartE2EDuration="3.445215081s" totalImagesPullingTime="1.640440529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:23:30.443933224 +0000 UTC m=+534.381971694" watchObservedRunningTime="2026-07-15 19:23:30.445215081 +0000 UTC m=+534.383253542"
Jul 15 19:23:35.407680 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:35.407654    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-745557885d-z2c22"
Jul 15 19:23:41.408614 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:41.408577    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-khp7q"
Jul 15 19:23:41.408988 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:41.408653    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-jc9j7"
Jul 15 19:23:59.239871 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.239835    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"]
Jul 15 19:23:59.243292 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.243277    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.248424 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.248403    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 15 19:23:59.249095 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.249078    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 19:23:59.249243 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.249173    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 19:23:59.249350 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.249334    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vclgr\""
Jul 15 19:23:59.261225 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.261192    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"]
Jul 15 19:23:59.346687 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.346649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a7eda3a-71c4-49b8-8324-90108d993732-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jhh6l\" (UID: \"1a7eda3a-71c4-49b8-8324-90108d993732\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.346845 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.346700    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a7eda3a-71c4-49b8-8324-90108d993732-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jhh6l\" (UID: \"1a7eda3a-71c4-49b8-8324-90108d993732\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.346845 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.346725    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a7eda3a-71c4-49b8-8324-90108d993732-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jhh6l\" (UID: \"1a7eda3a-71c4-49b8-8324-90108d993732\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.346845 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.346794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g472r\" (UniqueName: \"kubernetes.io/projected/1a7eda3a-71c4-49b8-8324-90108d993732-kube-api-access-g472r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jhh6l\" (UID: \"1a7eda3a-71c4-49b8-8324-90108d993732\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.346950 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.346891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a7eda3a-71c4-49b8-8324-90108d993732-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jhh6l\" (UID: \"1a7eda3a-71c4-49b8-8324-90108d993732\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.346950 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.346920    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a7eda3a-71c4-49b8-8324-90108d993732-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jhh6l\" (UID: \"1a7eda3a-71c4-49b8-8324-90108d993732\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.447892 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.447857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a7eda3a-71c4-49b8-8324-90108d993732-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jhh6l\" (UID: \"1a7eda3a-71c4-49b8-8324-90108d993732\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.447892 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.447896    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a7eda3a-71c4-49b8-8324-90108d993732-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jhh6l\" (UID: \"1a7eda3a-71c4-49b8-8324-90108d993732\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.448117 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.447923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a7eda3a-71c4-49b8-8324-90108d993732-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jhh6l\" (UID: \"1a7eda3a-71c4-49b8-8324-90108d993732\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.448117 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.448045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a7eda3a-71c4-49b8-8324-90108d993732-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jhh6l\" (UID: \"1a7eda3a-71c4-49b8-8324-90108d993732\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.448117 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.448088    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a7eda3a-71c4-49b8-8324-90108d993732-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jhh6l\" (UID: \"1a7eda3a-71c4-49b8-8324-90108d993732\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.448310 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.448134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g472r\" (UniqueName: \"kubernetes.io/projected/1a7eda3a-71c4-49b8-8324-90108d993732-kube-api-access-g472r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jhh6l\" (UID: \"1a7eda3a-71c4-49b8-8324-90108d993732\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.448310 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.448266    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a7eda3a-71c4-49b8-8324-90108d993732-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jhh6l\" (UID: \"1a7eda3a-71c4-49b8-8324-90108d993732\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.448407 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.448323    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a7eda3a-71c4-49b8-8324-90108d993732-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jhh6l\" (UID: \"1a7eda3a-71c4-49b8-8324-90108d993732\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.448475 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.448452    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a7eda3a-71c4-49b8-8324-90108d993732-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jhh6l\" (UID: \"1a7eda3a-71c4-49b8-8324-90108d993732\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.450101 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.450079    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a7eda3a-71c4-49b8-8324-90108d993732-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jhh6l\" (UID: \"1a7eda3a-71c4-49b8-8324-90108d993732\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.450413 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.450395    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a7eda3a-71c4-49b8-8324-90108d993732-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jhh6l\" (UID: \"1a7eda3a-71c4-49b8-8324-90108d993732\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.463613 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.463587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g472r\" (UniqueName: \"kubernetes.io/projected/1a7eda3a-71c4-49b8-8324-90108d993732-kube-api-access-g472r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jhh6l\" (UID: \"1a7eda3a-71c4-49b8-8324-90108d993732\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.553858 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.553787    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:23:59.707689 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:23:59.707661    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"]
Jul 15 19:23:59.710980 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:23:59.710955    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a7eda3a_71c4_49b8_8324_90108d993732.slice/crio-0ec0d895ed50300911810ecaf937eb585e154bf56c6dabd03cd0ffd5f7242ea3 WatchSource:0}: Error finding container 0ec0d895ed50300911810ecaf937eb585e154bf56c6dabd03cd0ffd5f7242ea3: Status 404 returned error can't find the container with id 0ec0d895ed50300911810ecaf937eb585e154bf56c6dabd03cd0ffd5f7242ea3
Jul 15 19:24:00.550789 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:00.550747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l" event={"ID":"1a7eda3a-71c4-49b8-8324-90108d993732","Type":"ContainerStarted","Data":"0ec0d895ed50300911810ecaf937eb585e154bf56c6dabd03cd0ffd5f7242ea3"}
Jul 15 19:24:01.557491 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:01.557440    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l" event={"ID":"1a7eda3a-71c4-49b8-8324-90108d993732","Type":"ContainerStarted","Data":"aa4e35ea4c915828c3583c9a8e1dcdff57b4efd2b42f224885eda772d10e5e59"}
Jul 15 19:24:01.587020 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:01.586960    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l" podStartSLOduration=1.559717306 podStartE2EDuration="2.586943799s" totalImagesPullingTime="1.027226493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:24:01.584686024 +0000 UTC m=+565.522724494" watchObservedRunningTime="2026-07-15 19:24:01.586943799 +0000 UTC m=+565.524982279"
Jul 15 19:24:09.207607 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.207577    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"]
Jul 15 19:24:09.210976 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.210959    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.213388 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.213369    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 15 19:24:09.222850 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.222817    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"]
Jul 15 19:24:09.341652 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.341617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0f00808-f247-429c-aa5a-985c431e1572-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x42xq\" (UID: \"a0f00808-f247-429c-aa5a-985c431e1572\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.341830 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.341659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjljn\" (UniqueName: \"kubernetes.io/projected/a0f00808-f247-429c-aa5a-985c431e1572-kube-api-access-hjljn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x42xq\" (UID: \"a0f00808-f247-429c-aa5a-985c431e1572\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.341830 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.341771    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0f00808-f247-429c-aa5a-985c431e1572-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x42xq\" (UID: \"a0f00808-f247-429c-aa5a-985c431e1572\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.341830 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.341809    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0f00808-f247-429c-aa5a-985c431e1572-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x42xq\" (UID: \"a0f00808-f247-429c-aa5a-985c431e1572\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.341958 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.341894    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0f00808-f247-429c-aa5a-985c431e1572-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x42xq\" (UID: \"a0f00808-f247-429c-aa5a-985c431e1572\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.341958 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.341938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0f00808-f247-429c-aa5a-985c431e1572-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x42xq\" (UID: \"a0f00808-f247-429c-aa5a-985c431e1572\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.443334 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.443298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjljn\" (UniqueName: \"kubernetes.io/projected/a0f00808-f247-429c-aa5a-985c431e1572-kube-api-access-hjljn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x42xq\" (UID: \"a0f00808-f247-429c-aa5a-985c431e1572\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.443490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.443367    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0f00808-f247-429c-aa5a-985c431e1572-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x42xq\" (UID: \"a0f00808-f247-429c-aa5a-985c431e1572\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.443490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.443386    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0f00808-f247-429c-aa5a-985c431e1572-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x42xq\" (UID: \"a0f00808-f247-429c-aa5a-985c431e1572\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.443490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.443419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0f00808-f247-429c-aa5a-985c431e1572-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x42xq\" (UID: \"a0f00808-f247-429c-aa5a-985c431e1572\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.443490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.443450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0f00808-f247-429c-aa5a-985c431e1572-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x42xq\" (UID: \"a0f00808-f247-429c-aa5a-985c431e1572\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.443490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.443479    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0f00808-f247-429c-aa5a-985c431e1572-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x42xq\" (UID: \"a0f00808-f247-429c-aa5a-985c431e1572\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.443764 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.443742    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0f00808-f247-429c-aa5a-985c431e1572-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x42xq\" (UID: \"a0f00808-f247-429c-aa5a-985c431e1572\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.443898 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.443877    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0f00808-f247-429c-aa5a-985c431e1572-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x42xq\" (UID: \"a0f00808-f247-429c-aa5a-985c431e1572\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.443957 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.443902    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0f00808-f247-429c-aa5a-985c431e1572-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x42xq\" (UID: \"a0f00808-f247-429c-aa5a-985c431e1572\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.445697 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.445678    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0f00808-f247-429c-aa5a-985c431e1572-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x42xq\" (UID: \"a0f00808-f247-429c-aa5a-985c431e1572\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.445932 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.445915    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0f00808-f247-429c-aa5a-985c431e1572-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x42xq\" (UID: \"a0f00808-f247-429c-aa5a-985c431e1572\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.452580 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.452560    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjljn\" (UniqueName: \"kubernetes.io/projected/a0f00808-f247-429c-aa5a-985c431e1572-kube-api-access-hjljn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x42xq\" (UID: \"a0f00808-f247-429c-aa5a-985c431e1572\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.520666 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.520590    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:09.554003 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.553974    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:24:09.554131 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.554042    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:24:09.567763 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.567736    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:24:09.608318 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.608291    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jhh6l"
Jul 15 19:24:09.664480 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:09.664435    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"]
Jul 15 19:24:09.667695 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:24:09.667668    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0f00808_f247_429c_aa5a_985c431e1572.slice/crio-2724d7dbaff2d11f3b95eab3c61e0af61cd44a815f84f84f442c9fb9eb7de1bb WatchSource:0}: Error finding container 2724d7dbaff2d11f3b95eab3c61e0af61cd44a815f84f84f442c9fb9eb7de1bb: Status 404 returned error can't find the container with id 2724d7dbaff2d11f3b95eab3c61e0af61cd44a815f84f84f442c9fb9eb7de1bb
Jul 15 19:24:10.601924 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:10.601889    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq" event={"ID":"a0f00808-f247-429c-aa5a-985c431e1572","Type":"ContainerStarted","Data":"7c86e93a489d52dbcff7cb4093fd75d7f96242444f34ced8af954b4b4ddc855f"}
Jul 15 19:24:10.602337 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:10.601949    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq" event={"ID":"a0f00808-f247-429c-aa5a-985c431e1572","Type":"ContainerStarted","Data":"2724d7dbaff2d11f3b95eab3c61e0af61cd44a815f84f84f442c9fb9eb7de1bb"}
Jul 15 19:24:10.626345 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:10.626254    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq" podStartSLOduration=1.410494309 podStartE2EDuration="1.626235296s" totalImagesPullingTime="215.740987ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:24:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:24:10.625979006 +0000 UTC m=+574.564017477" watchObservedRunningTime="2026-07-15 19:24:10.626235296 +0000 UTC m=+574.564273760"
Jul 15 19:24:19.521451 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:19.521401    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:19.521833 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:19.521477    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:19.534027 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:19.533995    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:19.654083 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:19.654056    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x42xq"
Jul 15 19:24:36.510680 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:36.510656    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:24:36.511776 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:24:36.511751    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:27:10.674285 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:10.674248    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65ff68966d-fgkrq"]
Jul 15 19:27:10.674900 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:10.674488    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-65ff68966d-fgkrq" podUID="960053b6-b2f6-4bd4-be73-92c1e11caa03" containerName="manager" containerID="cri-o://e2caedd887774c06bdfcf11cd64f6a041babf1c7659aa428580c7ff6762f0e9e" gracePeriod=30
Jul 15 19:27:10.922818 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:10.922793    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65ff68966d-fgkrq"
Jul 15 19:27:11.036366 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:11.036287    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/960053b6-b2f6-4bd4-be73-92c1e11caa03-webhook-cert\") pod \"960053b6-b2f6-4bd4-be73-92c1e11caa03\" (UID: \"960053b6-b2f6-4bd4-be73-92c1e11caa03\") "
Jul 15 19:27:11.036366 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:11.036330    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7k98\" (UniqueName: \"kubernetes.io/projected/960053b6-b2f6-4bd4-be73-92c1e11caa03-kube-api-access-p7k98\") pod \"960053b6-b2f6-4bd4-be73-92c1e11caa03\" (UID: \"960053b6-b2f6-4bd4-be73-92c1e11caa03\") "
Jul 15 19:27:11.038332 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:11.038302    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/960053b6-b2f6-4bd4-be73-92c1e11caa03-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "960053b6-b2f6-4bd4-be73-92c1e11caa03" (UID: "960053b6-b2f6-4bd4-be73-92c1e11caa03"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:27:11.038332 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:11.038304    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/960053b6-b2f6-4bd4-be73-92c1e11caa03-kube-api-access-p7k98" (OuterVolumeSpecName: "kube-api-access-p7k98") pod "960053b6-b2f6-4bd4-be73-92c1e11caa03" (UID: "960053b6-b2f6-4bd4-be73-92c1e11caa03"). InnerVolumeSpecName "kube-api-access-p7k98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:27:11.136979 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:11.136944    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/960053b6-b2f6-4bd4-be73-92c1e11caa03-webhook-cert\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:27:11.136979 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:11.136972    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7k98\" (UniqueName: \"kubernetes.io/projected/960053b6-b2f6-4bd4-be73-92c1e11caa03-kube-api-access-p7k98\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:27:11.492325 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:11.492284    2565 generic.go:356] "Generic (PLEG): container finished" podID="960053b6-b2f6-4bd4-be73-92c1e11caa03" containerID="e2caedd887774c06bdfcf11cd64f6a041babf1c7659aa428580c7ff6762f0e9e" exitCode=0
Jul 15 19:27:11.492497 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:11.492346    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65ff68966d-fgkrq"
Jul 15 19:27:11.492497 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:11.492370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65ff68966d-fgkrq" event={"ID":"960053b6-b2f6-4bd4-be73-92c1e11caa03","Type":"ContainerDied","Data":"e2caedd887774c06bdfcf11cd64f6a041babf1c7659aa428580c7ff6762f0e9e"}
Jul 15 19:27:11.492497 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:11.492426    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65ff68966d-fgkrq" event={"ID":"960053b6-b2f6-4bd4-be73-92c1e11caa03","Type":"ContainerDied","Data":"b0e2da7a74b5c37eb6f74df6efd3e153fa48695f6c8632d6e61845cd0f79122c"}
Jul 15 19:27:11.492497 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:11.492449    2565 scope.go:117] "RemoveContainer" containerID="e2caedd887774c06bdfcf11cd64f6a041babf1c7659aa428580c7ff6762f0e9e"
Jul 15 19:27:11.501168 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:11.501153    2565 scope.go:117] "RemoveContainer" containerID="e2caedd887774c06bdfcf11cd64f6a041babf1c7659aa428580c7ff6762f0e9e"
Jul 15 19:27:11.501454 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:27:11.501430    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2caedd887774c06bdfcf11cd64f6a041babf1c7659aa428580c7ff6762f0e9e\": container with ID starting with e2caedd887774c06bdfcf11cd64f6a041babf1c7659aa428580c7ff6762f0e9e not found: ID does not exist" containerID="e2caedd887774c06bdfcf11cd64f6a041babf1c7659aa428580c7ff6762f0e9e"
Jul 15 19:27:11.501506 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:11.501465    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2caedd887774c06bdfcf11cd64f6a041babf1c7659aa428580c7ff6762f0e9e"} err="failed to get container status \"e2caedd887774c06bdfcf11cd64f6a041babf1c7659aa428580c7ff6762f0e9e\": rpc error: code = NotFound desc = could not find container \"e2caedd887774c06bdfcf11cd64f6a041babf1c7659aa428580c7ff6762f0e9e\": container with ID starting with e2caedd887774c06bdfcf11cd64f6a041babf1c7659aa428580c7ff6762f0e9e not found: ID does not exist"
Jul 15 19:27:11.515396 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:11.515373    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65ff68966d-fgkrq"]
Jul 15 19:27:11.521696 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:11.521676    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-65ff68966d-fgkrq"]
Jul 15 19:27:12.343143 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.343110    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65ff68966d-wgrmd"]
Jul 15 19:27:12.343744 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.343509    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="960053b6-b2f6-4bd4-be73-92c1e11caa03" containerName="manager"
Jul 15 19:27:12.343744 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.343521    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="960053b6-b2f6-4bd4-be73-92c1e11caa03" containerName="manager"
Jul 15 19:27:12.343744 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.343593    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="960053b6-b2f6-4bd4-be73-92c1e11caa03" containerName="manager"
Jul 15 19:27:12.346533 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.346516    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65ff68966d-wgrmd"
Jul 15 19:27:12.348974 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.348956    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 19:27:12.349090 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.349073    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 19:27:12.349773 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.349755    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xd42d\""
Jul 15 19:27:12.356828 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.356805    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65ff68966d-wgrmd"]
Jul 15 19:27:12.449806 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.449777    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxptm\" (UniqueName: \"kubernetes.io/projected/d0ceec2c-a8b5-4226-ba4a-2d9c8b7fef3c-kube-api-access-zxptm\") pod \"maas-controller-65ff68966d-wgrmd\" (UID: \"d0ceec2c-a8b5-4226-ba4a-2d9c8b7fef3c\") " pod="opendatahub/maas-controller-65ff68966d-wgrmd"
Jul 15 19:27:12.449963 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.449835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d0ceec2c-a8b5-4226-ba4a-2d9c8b7fef3c-webhook-cert\") pod \"maas-controller-65ff68966d-wgrmd\" (UID: \"d0ceec2c-a8b5-4226-ba4a-2d9c8b7fef3c\") " pod="opendatahub/maas-controller-65ff68966d-wgrmd"
Jul 15 19:27:12.551094 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.551063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d0ceec2c-a8b5-4226-ba4a-2d9c8b7fef3c-webhook-cert\") pod \"maas-controller-65ff68966d-wgrmd\" (UID: \"d0ceec2c-a8b5-4226-ba4a-2d9c8b7fef3c\") " pod="opendatahub/maas-controller-65ff68966d-wgrmd"
Jul 15 19:27:12.551267 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.551136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxptm\" (UniqueName: \"kubernetes.io/projected/d0ceec2c-a8b5-4226-ba4a-2d9c8b7fef3c-kube-api-access-zxptm\") pod \"maas-controller-65ff68966d-wgrmd\" (UID: \"d0ceec2c-a8b5-4226-ba4a-2d9c8b7fef3c\") " pod="opendatahub/maas-controller-65ff68966d-wgrmd"
Jul 15 19:27:12.553500 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.553478    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d0ceec2c-a8b5-4226-ba4a-2d9c8b7fef3c-webhook-cert\") pod \"maas-controller-65ff68966d-wgrmd\" (UID: \"d0ceec2c-a8b5-4226-ba4a-2d9c8b7fef3c\") " pod="opendatahub/maas-controller-65ff68966d-wgrmd"
Jul 15 19:27:12.562181 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.562156    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxptm\" (UniqueName: \"kubernetes.io/projected/d0ceec2c-a8b5-4226-ba4a-2d9c8b7fef3c-kube-api-access-zxptm\") pod \"maas-controller-65ff68966d-wgrmd\" (UID: \"d0ceec2c-a8b5-4226-ba4a-2d9c8b7fef3c\") " pod="opendatahub/maas-controller-65ff68966d-wgrmd"
Jul 15 19:27:12.657269 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.657247    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65ff68966d-wgrmd"
Jul 15 19:27:12.689818 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.689787    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="960053b6-b2f6-4bd4-be73-92c1e11caa03" path="/var/lib/kubelet/pods/960053b6-b2f6-4bd4-be73-92c1e11caa03/volumes"
Jul 15 19:27:12.788808 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.788784    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65ff68966d-wgrmd"]
Jul 15 19:27:12.791066 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:27:12.791041    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0ceec2c_a8b5_4226_ba4a_2d9c8b7fef3c.slice/crio-2babfe3648e4af3d538bf69e41071e756c9adcc7567062f8c5d5b9732e282c4e WatchSource:0}: Error finding container 2babfe3648e4af3d538bf69e41071e756c9adcc7567062f8c5d5b9732e282c4e: Status 404 returned error can't find the container with id 2babfe3648e4af3d538bf69e41071e756c9adcc7567062f8c5d5b9732e282c4e
Jul 15 19:27:12.792774 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:12.792744    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:27:13.505423 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:13.505383    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65ff68966d-wgrmd" event={"ID":"d0ceec2c-a8b5-4226-ba4a-2d9c8b7fef3c","Type":"ContainerStarted","Data":"2babfe3648e4af3d538bf69e41071e756c9adcc7567062f8c5d5b9732e282c4e"}
Jul 15 19:27:14.511483 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:14.511445    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65ff68966d-wgrmd" event={"ID":"d0ceec2c-a8b5-4226-ba4a-2d9c8b7fef3c","Type":"ContainerStarted","Data":"3c6541beac6a965d43563203d0311226e44831c6982369e94178cca920ed8d6a"}
Jul 15 19:27:14.511873 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:14.511501    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65ff68966d-wgrmd"
Jul 15 19:27:14.532392 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:14.532350    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65ff68966d-wgrmd" podStartSLOduration=1.283417742 podStartE2EDuration="2.532334898s" totalImagesPullingTime="1.248917156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:27:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:27:14.531777126 +0000 UTC m=+758.469815595" watchObservedRunningTime="2026-07-15 19:27:14.532334898 +0000 UTC m=+758.470373348"
Jul 15 19:27:25.519131 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:27:25.519101    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65ff68966d-wgrmd"
Jul 15 19:29:36.552152 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:29:36.552072    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:29:36.553714 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:29:36.553693    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:30:00.156796 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:30:00.156759    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735730-sds4k"]
Jul 15 19:30:00.159405 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:30:00.159390    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735730-sds4k"
Jul 15 19:30:00.162115 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:30:00.162071    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhrw8\""
Jul 15 19:30:00.168858 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:30:00.168840    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735730-sds4k"
Jul 15 19:30:00.211830 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:30:00.211797    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735730-sds4k"]
Jul 15 19:30:00.513162 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:30:00.513139    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735730-sds4k"]
Jul 15 19:30:00.515094 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:30:00.515068    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e13040_a0ac_4e5c_ab54_e4a4b12f75b4.slice/crio-d65ecff9a4f1f1cc24e7c1bca5f549644cfe0e39162da12c8aedb51a82aa2791 WatchSource:0}: Error finding container d65ecff9a4f1f1cc24e7c1bca5f549644cfe0e39162da12c8aedb51a82aa2791: Status 404 returned error can't find the container with id d65ecff9a4f1f1cc24e7c1bca5f549644cfe0e39162da12c8aedb51a82aa2791
Jul 15 19:30:01.329363 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:30:01.329331    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735730-sds4k" event={"ID":"54e13040-a0ac-4e5c-ab54-e4a4b12f75b4","Type":"ContainerStarted","Data":"d65ecff9a4f1f1cc24e7c1bca5f549644cfe0e39162da12c8aedb51a82aa2791"}
Jul 15 19:30:03.344384 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:30:03.344346    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735730-sds4k" event={"ID":"54e13040-a0ac-4e5c-ab54-e4a4b12f75b4","Type":"ContainerStarted","Data":"26ec4a3066fcf58aca90a8f072eb7bfef0d75510a3ba395cc8f177e03595eabf"}
Jul 15 19:30:03.362243 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:30:03.362176    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735730-sds4k" podStartSLOduration=1.130627871 podStartE2EDuration="3.362160458s" totalImagesPullingTime="2.231532587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:30:03.361970762 +0000 UTC m=+927.300009231" watchObservedRunningTime="2026-07-15 19:30:03.362160458 +0000 UTC m=+927.300198951"
Jul 15 19:30:04.351475 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:30:04.351444    2565 generic.go:356] "Generic (PLEG): container finished" podID="54e13040-a0ac-4e5c-ab54-e4a4b12f75b4" containerID="26ec4a3066fcf58aca90a8f072eb7bfef0d75510a3ba395cc8f177e03595eabf" exitCode=0
Jul 15 19:30:04.351838 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:30:04.351528    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735730-sds4k" event={"ID":"54e13040-a0ac-4e5c-ab54-e4a4b12f75b4","Type":"ContainerDied","Data":"26ec4a3066fcf58aca90a8f072eb7bfef0d75510a3ba395cc8f177e03595eabf"}
Jul 15 19:30:05.496752 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:30:05.496726    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735730-sds4k"
Jul 15 19:30:06.362292 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:30:06.362255    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735730-sds4k" event={"ID":"54e13040-a0ac-4e5c-ab54-e4a4b12f75b4","Type":"ContainerDied","Data":"d65ecff9a4f1f1cc24e7c1bca5f549644cfe0e39162da12c8aedb51a82aa2791"}
Jul 15 19:30:06.362292 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:30:06.362290    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735730-sds4k"
Jul 15 19:30:06.362504 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:30:06.362317    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d65ecff9a4f1f1cc24e7c1bca5f549644cfe0e39162da12c8aedb51a82aa2791"
Jul 15 19:34:36.585339 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:34:36.585309    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:34:36.586725 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:34:36.586701    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:39:33.919886 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:33.919850    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"]
Jul 15 19:39:33.920320 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:33.920306    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54e13040-a0ac-4e5c-ab54-e4a4b12f75b4" containerName="cleanup"
Jul 15 19:39:33.920320 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:33.920322    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="54e13040-a0ac-4e5c-ab54-e4a4b12f75b4" containerName="cleanup"
Jul 15 19:39:33.920415 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:33.920406    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="54e13040-a0ac-4e5c-ab54-e4a4b12f75b4" containerName="cleanup"
Jul 15 19:39:33.928721 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:33.928687    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"
Jul 15 19:39:33.931762 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:33.931734    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-805941a5-serving-cert\""
Jul 15 19:39:33.933769 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:33.933743    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"]
Jul 15 19:39:34.031639 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:34.031611    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7df821d-5a47-45c8-a963-13211ee5b363-maas-api-tls\") pod \"maas-api-e2e-ait-805941a5-577476c698-wt6p4\" (UID: \"a7df821d-5a47-45c8-a963-13211ee5b363\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"
Jul 15 19:39:34.031813 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:34.031693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7df821d-5a47-45c8-a963-13211ee5b363-openshift-service-ca\") pod \"maas-api-e2e-ait-805941a5-577476c698-wt6p4\" (UID: \"a7df821d-5a47-45c8-a963-13211ee5b363\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"
Jul 15 19:39:34.031813 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:34.031767    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlpn2\" (UniqueName: \"kubernetes.io/projected/a7df821d-5a47-45c8-a963-13211ee5b363-kube-api-access-wlpn2\") pod \"maas-api-e2e-ait-805941a5-577476c698-wt6p4\" (UID: \"a7df821d-5a47-45c8-a963-13211ee5b363\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"
Jul 15 19:39:34.132820 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:34.132788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlpn2\" (UniqueName: \"kubernetes.io/projected/a7df821d-5a47-45c8-a963-13211ee5b363-kube-api-access-wlpn2\") pod \"maas-api-e2e-ait-805941a5-577476c698-wt6p4\" (UID: \"a7df821d-5a47-45c8-a963-13211ee5b363\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"
Jul 15 19:39:34.133011 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:34.132839    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7df821d-5a47-45c8-a963-13211ee5b363-maas-api-tls\") pod \"maas-api-e2e-ait-805941a5-577476c698-wt6p4\" (UID: \"a7df821d-5a47-45c8-a963-13211ee5b363\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"
Jul 15 19:39:34.133011 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:34.132883    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7df821d-5a47-45c8-a963-13211ee5b363-openshift-service-ca\") pod \"maas-api-e2e-ait-805941a5-577476c698-wt6p4\" (UID: \"a7df821d-5a47-45c8-a963-13211ee5b363\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"
Jul 15 19:39:34.133570 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:34.133540    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7df821d-5a47-45c8-a963-13211ee5b363-openshift-service-ca\") pod \"maas-api-e2e-ait-805941a5-577476c698-wt6p4\" (UID: \"a7df821d-5a47-45c8-a963-13211ee5b363\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"
Jul 15 19:39:34.135278 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:34.135256    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7df821d-5a47-45c8-a963-13211ee5b363-maas-api-tls\") pod \"maas-api-e2e-ait-805941a5-577476c698-wt6p4\" (UID: \"a7df821d-5a47-45c8-a963-13211ee5b363\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"
Jul 15 19:39:34.148260 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:34.148238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlpn2\" (UniqueName: \"kubernetes.io/projected/a7df821d-5a47-45c8-a963-13211ee5b363-kube-api-access-wlpn2\") pod \"maas-api-e2e-ait-805941a5-577476c698-wt6p4\" (UID: \"a7df821d-5a47-45c8-a963-13211ee5b363\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"
Jul 15 19:39:34.242625 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:34.242545    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"
Jul 15 19:39:34.385788 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:34.385585    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"]
Jul 15 19:39:34.388067 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:39:34.388039    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7df821d_5a47_45c8_a963_13211ee5b363.slice/crio-1440e5c408a9828241f975a05960ed5aa61880c504aaa5b0f1506ea3b60967b2 WatchSource:0}: Error finding container 1440e5c408a9828241f975a05960ed5aa61880c504aaa5b0f1506ea3b60967b2: Status 404 returned error can't find the container with id 1440e5c408a9828241f975a05960ed5aa61880c504aaa5b0f1506ea3b60967b2
Jul 15 19:39:34.389402 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:34.389384    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:39:35.238502 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:35.238428    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4" event={"ID":"a7df821d-5a47-45c8-a963-13211ee5b363","Type":"ContainerStarted","Data":"0a6666cbc988308e61d8bfbbd61199f074ebb505fcb855716c23aa59f7e42492"}
Jul 15 19:39:35.238502 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:35.238475    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4" event={"ID":"a7df821d-5a47-45c8-a963-13211ee5b363","Type":"ContainerStarted","Data":"1440e5c408a9828241f975a05960ed5aa61880c504aaa5b0f1506ea3b60967b2"}
Jul 15 19:39:35.238868 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:35.238549    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"
Jul 15 19:39:35.258033 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:35.257976    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4" podStartSLOduration=1.7052555219999999 podStartE2EDuration="2.257957511s" totalImagesPullingTime="552.701989ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:35.257142121 +0000 UTC m=+1499.195180590" watchObservedRunningTime="2026-07-15 19:39:35.257957511 +0000 UTC m=+1499.195995978"
Jul 15 19:39:36.619842 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:36.619816    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:39:36.621995 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:36.621972    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:39:38.834610 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:38.834572    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5"]
Jul 15 19:39:38.838349 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:38.838325    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5"
Jul 15 19:39:38.841833 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:38.841815    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhrw8\""
Jul 15 19:39:38.848368 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:38.848347    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5"]
Jul 15 19:39:38.982945 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:38.982914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b431a41-69c3-483c-8539-09b0eeff232f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-805941a5-wpns5\" (UID: \"4b431a41-69c3-483c-8539-09b0eeff232f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5"
Jul 15 19:39:39.083770 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:39.083741    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b431a41-69c3-483c-8539-09b0eeff232f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-805941a5-wpns5\" (UID: \"4b431a41-69c3-483c-8539-09b0eeff232f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5"
Jul 15 19:39:39.084422 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:39.084401    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b431a41-69c3-483c-8539-09b0eeff232f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-805941a5-wpns5\" (UID: \"4b431a41-69c3-483c-8539-09b0eeff232f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5"
Jul 15 19:39:39.148676 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:39.148645    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5"
Jul 15 19:39:39.284146 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:39.284125    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5"]
Jul 15 19:39:39.286189 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:39:39.286156    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b431a41_69c3_483c_8539_09b0eeff232f.slice/crio-e287a46261c055505012196e817aa5ea218e1f7efe86359c51bb2781ec246390 WatchSource:0}: Error finding container e287a46261c055505012196e817aa5ea218e1f7efe86359c51bb2781ec246390: Status 404 returned error can't find the container with id e287a46261c055505012196e817aa5ea218e1f7efe86359c51bb2781ec246390
Jul 15 19:39:39.964352 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:39:39.964321    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b431a41_69c3_483c_8539_09b0eeff232f.slice/crio-conmon-c15defec02d4629fb26653e3ed4e5bda165500b1e7b5fcbb096d7a415c2fd22d.scope\": RecentStats: unable to find data in memory cache]"
Jul 15 19:39:40.267054 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:40.266958    2565 generic.go:356] "Generic (PLEG): container finished" podID="4b431a41-69c3-483c-8539-09b0eeff232f" containerID="c15defec02d4629fb26653e3ed4e5bda165500b1e7b5fcbb096d7a415c2fd22d" exitCode=7
Jul 15 19:39:40.267221 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:40.267044    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5" event={"ID":"4b431a41-69c3-483c-8539-09b0eeff232f","Type":"ContainerDied","Data":"c15defec02d4629fb26653e3ed4e5bda165500b1e7b5fcbb096d7a415c2fd22d"}
Jul 15 19:39:40.267221 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:40.267100    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5" event={"ID":"4b431a41-69c3-483c-8539-09b0eeff232f","Type":"ContainerStarted","Data":"e287a46261c055505012196e817aa5ea218e1f7efe86359c51bb2781ec246390"}
Jul 15 19:39:40.267221 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:40.267191    2565 scope.go:117] "RemoveContainer" containerID="c15defec02d4629fb26653e3ed4e5bda165500b1e7b5fcbb096d7a415c2fd22d"
Jul 15 19:39:41.249973 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:41.249901    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"
Jul 15 19:39:41.275164 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:41.275134    2565 generic.go:356] "Generic (PLEG): container finished" podID="4b431a41-69c3-483c-8539-09b0eeff232f" containerID="bd4eac99c8f366272594283b14b972015104cd4bed5b315d3fe6ff3d40db8514" exitCode=7
Jul 15 19:39:41.275330 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:41.275185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5" event={"ID":"4b431a41-69c3-483c-8539-09b0eeff232f","Type":"ContainerDied","Data":"bd4eac99c8f366272594283b14b972015104cd4bed5b315d3fe6ff3d40db8514"}
Jul 15 19:39:41.275330 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:41.275241    2565 scope.go:117] "RemoveContainer" containerID="c15defec02d4629fb26653e3ed4e5bda165500b1e7b5fcbb096d7a415c2fd22d"
Jul 15 19:39:41.275429 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:41.275369    2565 scope.go:117] "RemoveContainer" containerID="bd4eac99c8f366272594283b14b972015104cd4bed5b315d3fe6ff3d40db8514"
Jul 15 19:39:41.275637 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:39:41.275608    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-805941a5-wpns5_odh-ai-gateway-infra(4b431a41-69c3-483c-8539-09b0eeff232f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5" podUID="4b431a41-69c3-483c-8539-09b0eeff232f"
Jul 15 19:39:42.282224 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:42.282174    2565 scope.go:117] "RemoveContainer" containerID="bd4eac99c8f366272594283b14b972015104cd4bed5b315d3fe6ff3d40db8514"
Jul 15 19:39:42.282610 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:39:42.282398    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-805941a5-wpns5_odh-ai-gateway-infra(4b431a41-69c3-483c-8539-09b0eeff232f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5" podUID="4b431a41-69c3-483c-8539-09b0eeff232f"
Jul 15 19:39:55.683735 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:55.683699    2565 scope.go:117] "RemoveContainer" containerID="bd4eac99c8f366272594283b14b972015104cd4bed5b315d3fe6ff3d40db8514"
Jul 15 19:39:56.356258 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:56.356225    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5" event={"ID":"4b431a41-69c3-483c-8539-09b0eeff232f","Type":"ContainerStarted","Data":"aca1779cbc3909cfaf37e7ad198c187f6c005c89454fe1ba022192609cd6d558"}
Jul 15 19:39:56.375493 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:56.375441    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5" podStartSLOduration=18.375423301 podStartE2EDuration="18.375423301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:56.374599385 +0000 UTC m=+1520.312637854" watchObservedRunningTime="2026-07-15 19:39:56.375423301 +0000 UTC m=+1520.313461772"
Jul 15 19:39:57.362901 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:57.362867    2565 generic.go:356] "Generic (PLEG): container finished" podID="4b431a41-69c3-483c-8539-09b0eeff232f" containerID="aca1779cbc3909cfaf37e7ad198c187f6c005c89454fe1ba022192609cd6d558" exitCode=0
Jul 15 19:39:57.363316 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:57.362941    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5" event={"ID":"4b431a41-69c3-483c-8539-09b0eeff232f","Type":"ContainerDied","Data":"aca1779cbc3909cfaf37e7ad198c187f6c005c89454fe1ba022192609cd6d558"}
Jul 15 19:39:57.363316 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:57.363003    2565 scope.go:117] "RemoveContainer" containerID="bd4eac99c8f366272594283b14b972015104cd4bed5b315d3fe6ff3d40db8514"
Jul 15 19:39:57.387754 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:57.387728    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5"]
Jul 15 19:39:58.508533 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:58.508510    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5"
Jul 15 19:39:58.572842 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:58.572811    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b431a41-69c3-483c-8539-09b0eeff232f-maas-api-service-ca\") pod \"4b431a41-69c3-483c-8539-09b0eeff232f\" (UID: \"4b431a41-69c3-483c-8539-09b0eeff232f\") "
Jul 15 19:39:58.573193 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:58.573173    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b431a41-69c3-483c-8539-09b0eeff232f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4b431a41-69c3-483c-8539-09b0eeff232f" (UID: "4b431a41-69c3-483c-8539-09b0eeff232f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:39:58.673941 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:58.673880    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b431a41-69c3-483c-8539-09b0eeff232f-maas-api-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:39:59.375806 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:59.375772    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5"
Jul 15 19:39:59.375994 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:59.375814    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5" event={"ID":"4b431a41-69c3-483c-8539-09b0eeff232f","Type":"ContainerDied","Data":"e287a46261c055505012196e817aa5ea218e1f7efe86359c51bb2781ec246390"}
Jul 15 19:39:59.375994 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:59.375866    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e287a46261c055505012196e817aa5ea218e1f7efe86359c51bb2781ec246390"
Jul 15 19:39:59.413702 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:59.413672    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5"]
Jul 15 19:39:59.419496 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:39:59.419471    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-wpns5"]
Jul 15 19:40:00.688933 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:00.688897    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b431a41-69c3-483c-8539-09b0eeff232f" path="/var/lib/kubelet/pods/4b431a41-69c3-483c-8539-09b0eeff232f/volumes"
Jul 15 19:40:38.887012 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:38.886974    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-5vdt2"]
Jul 15 19:40:38.887490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:38.887393    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b431a41-69c3-483c-8539-09b0eeff232f" containerName="revoke-keys"
Jul 15 19:40:38.887490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:38.887405    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b431a41-69c3-483c-8539-09b0eeff232f" containerName="revoke-keys"
Jul 15 19:40:38.887490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:38.887431    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b431a41-69c3-483c-8539-09b0eeff232f" containerName="revoke-keys"
Jul 15 19:40:38.887490 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:38.887437    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b431a41-69c3-483c-8539-09b0eeff232f" containerName="revoke-keys"
Jul 15 19:40:38.887634 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:38.887498    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b431a41-69c3-483c-8539-09b0eeff232f" containerName="revoke-keys"
Jul 15 19:40:38.887634 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:38.887512    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b431a41-69c3-483c-8539-09b0eeff232f" containerName="revoke-keys"
Jul 15 19:40:38.890613 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:38.890596    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-5vdt2"
Jul 15 19:40:38.893496 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:38.893474    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhrw8\""
Jul 15 19:40:38.899961 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:38.899933    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-5vdt2"]
Jul 15 19:40:39.035038 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:39.035003    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c22c3a74-a76c-444f-9465-1ae08236ca1e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-805941a5-5vdt2\" (UID: \"c22c3a74-a76c-444f-9465-1ae08236ca1e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-5vdt2"
Jul 15 19:40:39.136412 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:39.136374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c22c3a74-a76c-444f-9465-1ae08236ca1e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-805941a5-5vdt2\" (UID: \"c22c3a74-a76c-444f-9465-1ae08236ca1e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-5vdt2"
Jul 15 19:40:39.137109 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:39.137063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c22c3a74-a76c-444f-9465-1ae08236ca1e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-805941a5-5vdt2\" (UID: \"c22c3a74-a76c-444f-9465-1ae08236ca1e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-5vdt2"
Jul 15 19:40:39.203245 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:39.203220    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-5vdt2"
Jul 15 19:40:39.335928 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:39.335904    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-5vdt2"]
Jul 15 19:40:39.338292 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:40:39.338260    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22c3a74_a76c_444f_9465_1ae08236ca1e.slice/crio-d9463c855db2bff2a33eb96c30a4158496c5c5c96ac775ca5ed19772346c8ac6 WatchSource:0}: Error finding container d9463c855db2bff2a33eb96c30a4158496c5c5c96ac775ca5ed19772346c8ac6: Status 404 returned error can't find the container with id d9463c855db2bff2a33eb96c30a4158496c5c5c96ac775ca5ed19772346c8ac6
Jul 15 19:40:39.587180 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:39.587150    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-5vdt2" event={"ID":"c22c3a74-a76c-444f-9465-1ae08236ca1e","Type":"ContainerStarted","Data":"d9463c855db2bff2a33eb96c30a4158496c5c5c96ac775ca5ed19772346c8ac6"}
Jul 15 19:40:40.593364 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:40.593331    2565 generic.go:356] "Generic (PLEG): container finished" podID="c22c3a74-a76c-444f-9465-1ae08236ca1e" containerID="9bd872c9ef5973bce396a16e463c86307b08400e0c8cc8b9a3a73bd31516437f" exitCode=0
Jul 15 19:40:40.593723 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:40.593394    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-5vdt2" event={"ID":"c22c3a74-a76c-444f-9465-1ae08236ca1e","Type":"ContainerDied","Data":"9bd872c9ef5973bce396a16e463c86307b08400e0c8cc8b9a3a73bd31516437f"}
Jul 15 19:40:41.725605 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:41.725583    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-5vdt2"
Jul 15 19:40:41.755757 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:41.755730    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c22c3a74-a76c-444f-9465-1ae08236ca1e-maas-api-service-ca\") pod \"c22c3a74-a76c-444f-9465-1ae08236ca1e\" (UID: \"c22c3a74-a76c-444f-9465-1ae08236ca1e\") "
Jul 15 19:40:41.756150 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:41.756120    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c22c3a74-a76c-444f-9465-1ae08236ca1e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c22c3a74-a76c-444f-9465-1ae08236ca1e" (UID: "c22c3a74-a76c-444f-9465-1ae08236ca1e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:40:41.856870 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:41.856805    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c22c3a74-a76c-444f-9465-1ae08236ca1e-maas-api-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:40:42.604352 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:42.604320    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-5vdt2" event={"ID":"c22c3a74-a76c-444f-9465-1ae08236ca1e","Type":"ContainerDied","Data":"d9463c855db2bff2a33eb96c30a4158496c5c5c96ac775ca5ed19772346c8ac6"}
Jul 15 19:40:42.604352 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:42.604343    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-805941a5-5vdt2"
Jul 15 19:40:42.604531 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:42.604367    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9463c855db2bff2a33eb96c30a4158496c5c5c96ac775ca5ed19772346c8ac6"
Jul 15 19:40:49.422991 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:49.422958    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"]
Jul 15 19:40:49.423471 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:49.423214    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4" podUID="a7df821d-5a47-45c8-a963-13211ee5b363" containerName="maas-api" containerID="cri-o://0a6666cbc988308e61d8bfbbd61199f074ebb505fcb855716c23aa59f7e42492" gracePeriod=30
Jul 15 19:40:49.641666 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:49.641633    2565 generic.go:356] "Generic (PLEG): container finished" podID="a7df821d-5a47-45c8-a963-13211ee5b363" containerID="0a6666cbc988308e61d8bfbbd61199f074ebb505fcb855716c23aa59f7e42492" exitCode=0
Jul 15 19:40:49.641811 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:49.641694    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4" event={"ID":"a7df821d-5a47-45c8-a963-13211ee5b363","Type":"ContainerDied","Data":"0a6666cbc988308e61d8bfbbd61199f074ebb505fcb855716c23aa59f7e42492"}
Jul 15 19:40:49.672563 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:49.672536    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"
Jul 15 19:40:49.720236 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:49.720156    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlpn2\" (UniqueName: \"kubernetes.io/projected/a7df821d-5a47-45c8-a963-13211ee5b363-kube-api-access-wlpn2\") pod \"a7df821d-5a47-45c8-a963-13211ee5b363\" (UID: \"a7df821d-5a47-45c8-a963-13211ee5b363\") "
Jul 15 19:40:49.720236 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:49.720231    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7df821d-5a47-45c8-a963-13211ee5b363-maas-api-tls\") pod \"a7df821d-5a47-45c8-a963-13211ee5b363\" (UID: \"a7df821d-5a47-45c8-a963-13211ee5b363\") "
Jul 15 19:40:49.720483 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:49.720292    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7df821d-5a47-45c8-a963-13211ee5b363-openshift-service-ca\") pod \"a7df821d-5a47-45c8-a963-13211ee5b363\" (UID: \"a7df821d-5a47-45c8-a963-13211ee5b363\") "
Jul 15 19:40:49.720696 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:49.720667    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7df821d-5a47-45c8-a963-13211ee5b363-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a7df821d-5a47-45c8-a963-13211ee5b363" (UID: "a7df821d-5a47-45c8-a963-13211ee5b363"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:40:49.722264 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:49.722240    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7df821d-5a47-45c8-a963-13211ee5b363-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a7df821d-5a47-45c8-a963-13211ee5b363" (UID: "a7df821d-5a47-45c8-a963-13211ee5b363"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:40:49.722348 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:49.722330    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7df821d-5a47-45c8-a963-13211ee5b363-kube-api-access-wlpn2" (OuterVolumeSpecName: "kube-api-access-wlpn2") pod "a7df821d-5a47-45c8-a963-13211ee5b363" (UID: "a7df821d-5a47-45c8-a963-13211ee5b363"). InnerVolumeSpecName "kube-api-access-wlpn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:40:49.821832 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:49.821802    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlpn2\" (UniqueName: \"kubernetes.io/projected/a7df821d-5a47-45c8-a963-13211ee5b363-kube-api-access-wlpn2\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:40:49.821832 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:49.821828    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7df821d-5a47-45c8-a963-13211ee5b363-maas-api-tls\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:40:49.822024 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:49.821852    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7df821d-5a47-45c8-a963-13211ee5b363-openshift-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:40:50.648542 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:50.648500    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4" event={"ID":"a7df821d-5a47-45c8-a963-13211ee5b363","Type":"ContainerDied","Data":"1440e5c408a9828241f975a05960ed5aa61880c504aaa5b0f1506ea3b60967b2"}
Jul 15 19:40:50.648542 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:50.648522    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"
Jul 15 19:40:50.648983 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:50.648573    2565 scope.go:117] "RemoveContainer" containerID="0a6666cbc988308e61d8bfbbd61199f074ebb505fcb855716c23aa59f7e42492"
Jul 15 19:40:50.689330 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:50.689306    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"]
Jul 15 19:40:50.690073 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:50.690054    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-805941a5-577476c698-wt6p4"]
Jul 15 19:40:52.689143 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:40:52.689112    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7df821d-5a47-45c8-a963-13211ee5b363" path="/var/lib/kubelet/pods/a7df821d-5a47-45c8-a963-13211ee5b363/volumes"
Jul 15 19:41:06.168137 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.168099    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"]
Jul 15 19:41:06.168750 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.168730    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b431a41-69c3-483c-8539-09b0eeff232f" containerName="revoke-keys"
Jul 15 19:41:06.168750 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.168751    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b431a41-69c3-483c-8539-09b0eeff232f" containerName="revoke-keys"
Jul 15 19:41:06.168900 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.168769    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7df821d-5a47-45c8-a963-13211ee5b363" containerName="maas-api"
Jul 15 19:41:06.168900 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.168777    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7df821d-5a47-45c8-a963-13211ee5b363" containerName="maas-api"
Jul 15 19:41:06.168900 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.168788    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c22c3a74-a76c-444f-9465-1ae08236ca1e" containerName="revoke-keys"
Jul 15 19:41:06.168900 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.168798    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c22c3a74-a76c-444f-9465-1ae08236ca1e" containerName="revoke-keys"
Jul 15 19:41:06.168900 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.168901    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b431a41-69c3-483c-8539-09b0eeff232f" containerName="revoke-keys"
Jul 15 19:41:06.169151 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.168913    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c22c3a74-a76c-444f-9465-1ae08236ca1e" containerName="revoke-keys"
Jul 15 19:41:06.169151 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.168924    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7df821d-5a47-45c8-a963-13211ee5b363" containerName="maas-api"
Jul 15 19:41:06.173637 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.173615    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"
Jul 15 19:41:06.176288 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.176267    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-c29a5b8d-serving-cert\""
Jul 15 19:41:06.184649 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.184626    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"]
Jul 15 19:41:06.272221 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.272167    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f-maas-api-tls\") pod \"maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9\" (UID: \"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"
Jul 15 19:41:06.272418 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.272228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f4gr\" (UniqueName: \"kubernetes.io/projected/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f-kube-api-access-2f4gr\") pod \"maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9\" (UID: \"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"
Jul 15 19:41:06.272418 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.272312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f-openshift-service-ca\") pod \"maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9\" (UID: \"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"
Jul 15 19:41:06.373550 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.373512    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f-openshift-service-ca\") pod \"maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9\" (UID: \"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"
Jul 15 19:41:06.373744 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.373625    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f-maas-api-tls\") pod \"maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9\" (UID: \"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"
Jul 15 19:41:06.373744 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.373651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f4gr\" (UniqueName: \"kubernetes.io/projected/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f-kube-api-access-2f4gr\") pod \"maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9\" (UID: \"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"
Jul 15 19:41:06.374160 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.374137    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f-openshift-service-ca\") pod \"maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9\" (UID: \"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"
Jul 15 19:41:06.375916 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.375898    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f-maas-api-tls\") pod \"maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9\" (UID: \"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"
Jul 15 19:41:06.387000 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.386977    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f4gr\" (UniqueName: \"kubernetes.io/projected/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f-kube-api-access-2f4gr\") pod \"maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9\" (UID: \"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"
Jul 15 19:41:06.485162 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.485088    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"
Jul 15 19:41:06.619552 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.619528    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"]
Jul 15 19:41:06.621475 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:41:06.621448    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15d5b8b_0d2f_42f6_bb6a_bf16898cd70f.slice/crio-53ce20518f77e17cc31854be7b252f2ecb5fc7e594a63749741b549fcef42f37 WatchSource:0}: Error finding container 53ce20518f77e17cc31854be7b252f2ecb5fc7e594a63749741b549fcef42f37: Status 404 returned error can't find the container with id 53ce20518f77e17cc31854be7b252f2ecb5fc7e594a63749741b549fcef42f37
Jul 15 19:41:06.730908 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:06.730875    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9" event={"ID":"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f","Type":"ContainerStarted","Data":"53ce20518f77e17cc31854be7b252f2ecb5fc7e594a63749741b549fcef42f37"}
Jul 15 19:41:07.736723 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:07.736688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9" event={"ID":"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f","Type":"ContainerStarted","Data":"5fcff57343004a88a0eed14a54a38f64a7f3dbfe7cfa2db36a04d071481b4f58"}
Jul 15 19:41:07.737114 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:07.736764    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"
Jul 15 19:41:07.758025 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:07.757976    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9" podStartSLOduration=1.2272725150000001 podStartE2EDuration="1.757958392s" totalImagesPullingTime="530.685877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:41:07.755382142 +0000 UTC m=+1591.693420611" watchObservedRunningTime="2026-07-15 19:41:07.757958392 +0000 UTC m=+1591.695996859"
Jul 15 19:41:10.602532 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:10.602494    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx"]
Jul 15 19:41:10.606254 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:10.606235    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx"
Jul 15 19:41:10.608922 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:10.608902    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhrw8\""
Jul 15 19:41:10.616766 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:10.616739    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx"]
Jul 15 19:41:10.711672 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:10.711644    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9cecfd5-2d6e-4178-bee8-3b12679142e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx\" (UID: \"f9cecfd5-2d6e-4178-bee8-3b12679142e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx"
Jul 15 19:41:10.813121 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:10.813092    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9cecfd5-2d6e-4178-bee8-3b12679142e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx\" (UID: \"f9cecfd5-2d6e-4178-bee8-3b12679142e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx"
Jul 15 19:41:10.813748 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:10.813723    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9cecfd5-2d6e-4178-bee8-3b12679142e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx\" (UID: \"f9cecfd5-2d6e-4178-bee8-3b12679142e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx"
Jul 15 19:41:10.918405 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:10.918327    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx"
Jul 15 19:41:11.051440 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:11.051406    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx"]
Jul 15 19:41:11.052635 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:41:11.052611    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9cecfd5_2d6e_4178_bee8_3b12679142e3.slice/crio-6cad4ebd5dd39320abdfe6f3feedd070b5a125586979874663cd46a1f6910907 WatchSource:0}: Error finding container 6cad4ebd5dd39320abdfe6f3feedd070b5a125586979874663cd46a1f6910907: Status 404 returned error can't find the container with id 6cad4ebd5dd39320abdfe6f3feedd070b5a125586979874663cd46a1f6910907
Jul 15 19:41:11.758559 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:11.758526    2565 generic.go:356] "Generic (PLEG): container finished" podID="f9cecfd5-2d6e-4178-bee8-3b12679142e3" containerID="ac650f0015fc0e4395f5f17348e2bff02d0d2df09eb6cdc07e21d62038691d0e" exitCode=7
Jul 15 19:41:11.758923 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:11.758602    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx" event={"ID":"f9cecfd5-2d6e-4178-bee8-3b12679142e3","Type":"ContainerDied","Data":"ac650f0015fc0e4395f5f17348e2bff02d0d2df09eb6cdc07e21d62038691d0e"}
Jul 15 19:41:11.758923 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:11.758640    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx" event={"ID":"f9cecfd5-2d6e-4178-bee8-3b12679142e3","Type":"ContainerStarted","Data":"6cad4ebd5dd39320abdfe6f3feedd070b5a125586979874663cd46a1f6910907"}
Jul 15 19:41:11.758923 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:11.758761    2565 scope.go:117] "RemoveContainer" containerID="ac650f0015fc0e4395f5f17348e2bff02d0d2df09eb6cdc07e21d62038691d0e"
Jul 15 19:41:12.764977 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:12.764898    2565 generic.go:356] "Generic (PLEG): container finished" podID="f9cecfd5-2d6e-4178-bee8-3b12679142e3" containerID="2bc88ba2a6db6ff62842677b83dc04b2730ee9158f42c1a0d7610d2e420f02ae" exitCode=7
Jul 15 19:41:12.764977 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:12.764970    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx" event={"ID":"f9cecfd5-2d6e-4178-bee8-3b12679142e3","Type":"ContainerDied","Data":"2bc88ba2a6db6ff62842677b83dc04b2730ee9158f42c1a0d7610d2e420f02ae"}
Jul 15 19:41:12.765421 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:12.765013    2565 scope.go:117] "RemoveContainer" containerID="ac650f0015fc0e4395f5f17348e2bff02d0d2df09eb6cdc07e21d62038691d0e"
Jul 15 19:41:12.765421 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:12.765187    2565 scope.go:117] "RemoveContainer" containerID="2bc88ba2a6db6ff62842677b83dc04b2730ee9158f42c1a0d7610d2e420f02ae"
Jul 15 19:41:12.765421 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:41:12.765407    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx_odh-ai-gateway-infra(f9cecfd5-2d6e-4178-bee8-3b12679142e3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx" podUID="f9cecfd5-2d6e-4178-bee8-3b12679142e3"
Jul 15 19:41:13.748545 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:13.748516    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"
Jul 15 19:41:13.777719 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:13.777695    2565 scope.go:117] "RemoveContainer" containerID="2bc88ba2a6db6ff62842677b83dc04b2730ee9158f42c1a0d7610d2e420f02ae"
Jul 15 19:41:13.778060 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:41:13.777856    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx_odh-ai-gateway-infra(f9cecfd5-2d6e-4178-bee8-3b12679142e3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx" podUID="f9cecfd5-2d6e-4178-bee8-3b12679142e3"
Jul 15 19:41:26.685236 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:26.685171    2565 scope.go:117] "RemoveContainer" containerID="2bc88ba2a6db6ff62842677b83dc04b2730ee9158f42c1a0d7610d2e420f02ae"
Jul 15 19:41:27.849084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:27.849052    2565 generic.go:356] "Generic (PLEG): container finished" podID="f9cecfd5-2d6e-4178-bee8-3b12679142e3" containerID="4be716f502299bc220412482a1b13376a81690b4696ba93f0789ebccd6984d25" exitCode=0
Jul 15 19:41:27.849084 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:27.849088    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx" event={"ID":"f9cecfd5-2d6e-4178-bee8-3b12679142e3","Type":"ContainerDied","Data":"4be716f502299bc220412482a1b13376a81690b4696ba93f0789ebccd6984d25"}
Jul 15 19:41:27.849526 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:27.849141    2565 scope.go:117] "RemoveContainer" containerID="2bc88ba2a6db6ff62842677b83dc04b2730ee9158f42c1a0d7610d2e420f02ae"
Jul 15 19:41:28.882862 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:28.882830    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx"]
Jul 15 19:41:28.997553 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:28.997533    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx"
Jul 15 19:41:29.185997 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:29.185922    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9cecfd5-2d6e-4178-bee8-3b12679142e3-maas-api-service-ca\") pod \"f9cecfd5-2d6e-4178-bee8-3b12679142e3\" (UID: \"f9cecfd5-2d6e-4178-bee8-3b12679142e3\") "
Jul 15 19:41:29.186274 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:29.186250    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9cecfd5-2d6e-4178-bee8-3b12679142e3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f9cecfd5-2d6e-4178-bee8-3b12679142e3" (UID: "f9cecfd5-2d6e-4178-bee8-3b12679142e3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:41:29.287500 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:29.287471    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9cecfd5-2d6e-4178-bee8-3b12679142e3-maas-api-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:41:29.862364 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:29.862330    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx" event={"ID":"f9cecfd5-2d6e-4178-bee8-3b12679142e3","Type":"ContainerDied","Data":"6cad4ebd5dd39320abdfe6f3feedd070b5a125586979874663cd46a1f6910907"}
Jul 15 19:41:29.862546 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:29.862383    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6cad4ebd5dd39320abdfe6f3feedd070b5a125586979874663cd46a1f6910907"
Jul 15 19:41:29.862546 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:29.862338    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx"
Jul 15 19:41:29.899297 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:29.899273    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx"]
Jul 15 19:41:29.902026 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:29.902005    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-2sctx"]
Jul 15 19:41:30.689413 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:41:30.689378    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9cecfd5-2d6e-4178-bee8-3b12679142e3" path="/var/lib/kubelet/pods/f9cecfd5-2d6e-4178-bee8-3b12679142e3/volumes"
Jul 15 19:42:00.653354 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:00.653314    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-qkz8r"]
Jul 15 19:42:00.653945 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:00.653926    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9cecfd5-2d6e-4178-bee8-3b12679142e3" containerName="revoke-keys"
Jul 15 19:42:00.654030 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:00.653948    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9cecfd5-2d6e-4178-bee8-3b12679142e3" containerName="revoke-keys"
Jul 15 19:42:00.654030 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:00.653964    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9cecfd5-2d6e-4178-bee8-3b12679142e3" containerName="revoke-keys"
Jul 15 19:42:00.654030 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:00.653971    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9cecfd5-2d6e-4178-bee8-3b12679142e3" containerName="revoke-keys"
Jul 15 19:42:00.654030 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:00.654000    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9cecfd5-2d6e-4178-bee8-3b12679142e3" containerName="revoke-keys"
Jul 15 19:42:00.654030 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:00.654010    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9cecfd5-2d6e-4178-bee8-3b12679142e3" containerName="revoke-keys"
Jul 15 19:42:00.654298 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:00.654123    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9cecfd5-2d6e-4178-bee8-3b12679142e3" containerName="revoke-keys"
Jul 15 19:42:00.654298 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:00.654142    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9cecfd5-2d6e-4178-bee8-3b12679142e3" containerName="revoke-keys"
Jul 15 19:42:00.657374 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:00.657353    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-qkz8r"
Jul 15 19:42:00.659970 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:00.659951    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhrw8\""
Jul 15 19:42:00.665513 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:00.665488    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-qkz8r"]
Jul 15 19:42:00.783915 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:00.783878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55534029-a1a2-4cdb-91b5-c83fba90a1a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c29a5b8d-qkz8r\" (UID: \"55534029-a1a2-4cdb-91b5-c83fba90a1a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-qkz8r"
Jul 15 19:42:00.885258 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:00.885222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55534029-a1a2-4cdb-91b5-c83fba90a1a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c29a5b8d-qkz8r\" (UID: \"55534029-a1a2-4cdb-91b5-c83fba90a1a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-qkz8r"
Jul 15 19:42:00.885796 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:00.885775    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55534029-a1a2-4cdb-91b5-c83fba90a1a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c29a5b8d-qkz8r\" (UID: \"55534029-a1a2-4cdb-91b5-c83fba90a1a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-qkz8r"
Jul 15 19:42:00.969366 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:00.969282    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-qkz8r"
Jul 15 19:42:01.104033 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:01.103889    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-qkz8r"]
Jul 15 19:42:01.106852 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:42:01.106822    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55534029_a1a2_4cdb_91b5_c83fba90a1a0.slice/crio-2c8a7860693a8d1d64cd9ccdf1bc597353dbdb4a931b276f63ca4d77268f0499 WatchSource:0}: Error finding container 2c8a7860693a8d1d64cd9ccdf1bc597353dbdb4a931b276f63ca4d77268f0499: Status 404 returned error can't find the container with id 2c8a7860693a8d1d64cd9ccdf1bc597353dbdb4a931b276f63ca4d77268f0499
Jul 15 19:42:02.027267 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:02.027159    2565 generic.go:356] "Generic (PLEG): container finished" podID="55534029-a1a2-4cdb-91b5-c83fba90a1a0" containerID="1dd4deaa177a95a5e280bdfe395ec5b46103027df8b21b49028249e3e187ac35" exitCode=0
Jul 15 19:42:02.027267 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:02.027243    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-qkz8r" event={"ID":"55534029-a1a2-4cdb-91b5-c83fba90a1a0","Type":"ContainerDied","Data":"1dd4deaa177a95a5e280bdfe395ec5b46103027df8b21b49028249e3e187ac35"}
Jul 15 19:42:02.027631 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:02.027302    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-qkz8r" event={"ID":"55534029-a1a2-4cdb-91b5-c83fba90a1a0","Type":"ContainerStarted","Data":"2c8a7860693a8d1d64cd9ccdf1bc597353dbdb4a931b276f63ca4d77268f0499"}
Jul 15 19:42:03.163777 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:03.163753    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-qkz8r"
Jul 15 19:42:03.307934 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:03.307860    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55534029-a1a2-4cdb-91b5-c83fba90a1a0-maas-api-service-ca\") pod \"55534029-a1a2-4cdb-91b5-c83fba90a1a0\" (UID: \"55534029-a1a2-4cdb-91b5-c83fba90a1a0\") "
Jul 15 19:42:03.308181 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:03.308161    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55534029-a1a2-4cdb-91b5-c83fba90a1a0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "55534029-a1a2-4cdb-91b5-c83fba90a1a0" (UID: "55534029-a1a2-4cdb-91b5-c83fba90a1a0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:42:03.409423 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:03.409398    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55534029-a1a2-4cdb-91b5-c83fba90a1a0-maas-api-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:42:04.037735 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:04.037711    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-qkz8r"
Jul 15 19:42:04.037888 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:04.037755    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c29a5b8d-qkz8r" event={"ID":"55534029-a1a2-4cdb-91b5-c83fba90a1a0","Type":"ContainerDied","Data":"2c8a7860693a8d1d64cd9ccdf1bc597353dbdb4a931b276f63ca4d77268f0499"}
Jul 15 19:42:04.037888 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:04.037798    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c8a7860693a8d1d64cd9ccdf1bc597353dbdb4a931b276f63ca4d77268f0499"
Jul 15 19:42:11.310414 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:11.310382    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"]
Jul 15 19:42:11.310867 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:11.310588    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9" podUID="b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f" containerName="maas-api" containerID="cri-o://5fcff57343004a88a0eed14a54a38f64a7f3dbfe7cfa2db36a04d071481b4f58" gracePeriod=30
Jul 15 19:42:11.561577 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:11.561522    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"
Jul 15 19:42:11.586161 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:11.586139    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2f4gr\" (UniqueName: \"kubernetes.io/projected/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f-kube-api-access-2f4gr\") pod \"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f\" (UID: \"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f\") "
Jul 15 19:42:11.586320 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:11.586224    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f-openshift-service-ca\") pod \"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f\" (UID: \"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f\") "
Jul 15 19:42:11.586320 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:11.586277    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f-maas-api-tls\") pod \"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f\" (UID: \"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f\") "
Jul 15 19:42:11.586523 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:11.586479    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f" (UID: "b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:42:11.586674 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:11.586644    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f-openshift-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:42:11.588278 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:11.588249    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f-kube-api-access-2f4gr" (OuterVolumeSpecName: "kube-api-access-2f4gr") pod "b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f" (UID: "b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f"). InnerVolumeSpecName "kube-api-access-2f4gr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:42:11.588441 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:11.588422    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f" (UID: "b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:42:11.687095 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:11.687058    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f4gr\" (UniqueName: \"kubernetes.io/projected/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f-kube-api-access-2f4gr\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:42:11.687095 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:11.687093    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f-maas-api-tls\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:42:12.082780 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:12.082747    2565 generic.go:356] "Generic (PLEG): container finished" podID="b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f" containerID="5fcff57343004a88a0eed14a54a38f64a7f3dbfe7cfa2db36a04d071481b4f58" exitCode=0
Jul 15 19:42:12.082780 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:12.082783    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"
Jul 15 19:42:12.082991 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:12.082814    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9" event={"ID":"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f","Type":"ContainerDied","Data":"5fcff57343004a88a0eed14a54a38f64a7f3dbfe7cfa2db36a04d071481b4f58"}
Jul 15 19:42:12.082991 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:12.082860    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9" event={"ID":"b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f","Type":"ContainerDied","Data":"53ce20518f77e17cc31854be7b252f2ecb5fc7e594a63749741b549fcef42f37"}
Jul 15 19:42:12.082991 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:12.082884    2565 scope.go:117] "RemoveContainer" containerID="5fcff57343004a88a0eed14a54a38f64a7f3dbfe7cfa2db36a04d071481b4f58"
Jul 15 19:42:12.092070 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:12.092036    2565 scope.go:117] "RemoveContainer" containerID="5fcff57343004a88a0eed14a54a38f64a7f3dbfe7cfa2db36a04d071481b4f58"
Jul 15 19:42:12.092318 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:42:12.092284    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fcff57343004a88a0eed14a54a38f64a7f3dbfe7cfa2db36a04d071481b4f58\": container with ID starting with 5fcff57343004a88a0eed14a54a38f64a7f3dbfe7cfa2db36a04d071481b4f58 not found: ID does not exist" containerID="5fcff57343004a88a0eed14a54a38f64a7f3dbfe7cfa2db36a04d071481b4f58"
Jul 15 19:42:12.092397 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:12.092320    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fcff57343004a88a0eed14a54a38f64a7f3dbfe7cfa2db36a04d071481b4f58"} err="failed to get container status \"5fcff57343004a88a0eed14a54a38f64a7f3dbfe7cfa2db36a04d071481b4f58\": rpc error: code = NotFound desc = could not find container \"5fcff57343004a88a0eed14a54a38f64a7f3dbfe7cfa2db36a04d071481b4f58\": container with ID starting with 5fcff57343004a88a0eed14a54a38f64a7f3dbfe7cfa2db36a04d071481b4f58 not found: ID does not exist"
Jul 15 19:42:12.118191 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:12.114016    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"]
Jul 15 19:42:12.124908 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:12.124883    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c29a5b8d-6f4df6f5dd-jn6k9"]
Jul 15 19:42:12.689260 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:12.689231    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f" path="/var/lib/kubelet/pods/b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f/volumes"
Jul 15 19:42:19.117863 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.117824    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"]
Jul 15 19:42:19.118456 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.118430    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f" containerName="maas-api"
Jul 15 19:42:19.118456 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.118455    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f" containerName="maas-api"
Jul 15 19:42:19.118657 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.118499    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55534029-a1a2-4cdb-91b5-c83fba90a1a0" containerName="revoke-keys"
Jul 15 19:42:19.118657 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.118507    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="55534029-a1a2-4cdb-91b5-c83fba90a1a0" containerName="revoke-keys"
Jul 15 19:42:19.118657 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.118607    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b15d5b8b-0d2f-42f6-bb6a-bf16898cd70f" containerName="maas-api"
Jul 15 19:42:19.118657 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.118622    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9cecfd5-2d6e-4178-bee8-3b12679142e3" containerName="revoke-keys"
Jul 15 19:42:19.118657 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.118634    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="55534029-a1a2-4cdb-91b5-c83fba90a1a0" containerName="revoke-keys"
Jul 15 19:42:19.123315 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.123293    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"
Jul 15 19:42:19.125660 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.125640    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e3a43be3-serving-cert\""
Jul 15 19:42:19.138785 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.138763    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"]
Jul 15 19:42:19.148128 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.148103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e506650-d997-48b3-80f1-20bcb097d077-openshift-service-ca\") pod \"maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7\" (UID: \"1e506650-d997-48b3-80f1-20bcb097d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"
Jul 15 19:42:19.148232 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.148143    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6fd6\" (UniqueName: \"kubernetes.io/projected/1e506650-d997-48b3-80f1-20bcb097d077-kube-api-access-g6fd6\") pod \"maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7\" (UID: \"1e506650-d997-48b3-80f1-20bcb097d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"
Jul 15 19:42:19.148312 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.148290    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e506650-d997-48b3-80f1-20bcb097d077-maas-api-tls\") pod \"maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7\" (UID: \"1e506650-d997-48b3-80f1-20bcb097d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"
Jul 15 19:42:19.249352 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.249322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e506650-d997-48b3-80f1-20bcb097d077-maas-api-tls\") pod \"maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7\" (UID: \"1e506650-d997-48b3-80f1-20bcb097d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"
Jul 15 19:42:19.249519 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.249390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e506650-d997-48b3-80f1-20bcb097d077-openshift-service-ca\") pod \"maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7\" (UID: \"1e506650-d997-48b3-80f1-20bcb097d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"
Jul 15 19:42:19.249519 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.249414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6fd6\" (UniqueName: \"kubernetes.io/projected/1e506650-d997-48b3-80f1-20bcb097d077-kube-api-access-g6fd6\") pod \"maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7\" (UID: \"1e506650-d997-48b3-80f1-20bcb097d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"
Jul 15 19:42:19.249519 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:42:19.249483    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-serving-cert: secret "maas-api-e2e-ait-e3a43be3-serving-cert" not found
Jul 15 19:42:19.249626 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:42:19.249559    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e506650-d997-48b3-80f1-20bcb097d077-maas-api-tls podName:1e506650-d997-48b3-80f1-20bcb097d077 nodeName:}" failed. No retries permitted until 2026-07-15 19:42:19.749541098 +0000 UTC m=+1663.687579553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1e506650-d997-48b3-80f1-20bcb097d077-maas-api-tls") pod "maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7" (UID: "1e506650-d997-48b3-80f1-20bcb097d077") : secret "maas-api-e2e-ait-e3a43be3-serving-cert" not found
Jul 15 19:42:19.250111 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.250092    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e506650-d997-48b3-80f1-20bcb097d077-openshift-service-ca\") pod \"maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7\" (UID: \"1e506650-d997-48b3-80f1-20bcb097d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"
Jul 15 19:42:19.287520 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.287490    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6fd6\" (UniqueName: \"kubernetes.io/projected/1e506650-d997-48b3-80f1-20bcb097d077-kube-api-access-g6fd6\") pod \"maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7\" (UID: \"1e506650-d997-48b3-80f1-20bcb097d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"
Jul 15 19:42:19.756158 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.756120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e506650-d997-48b3-80f1-20bcb097d077-maas-api-tls\") pod \"maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7\" (UID: \"1e506650-d997-48b3-80f1-20bcb097d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"
Jul 15 19:42:19.758615 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:19.758589    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e506650-d997-48b3-80f1-20bcb097d077-maas-api-tls\") pod \"maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7\" (UID: \"1e506650-d997-48b3-80f1-20bcb097d077\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"
Jul 15 19:42:20.033293 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:20.033194    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"
Jul 15 19:42:20.380104 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:20.380080    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"]
Jul 15 19:42:20.382279 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:42:20.382245    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e506650_d997_48b3_80f1_20bcb097d077.slice/crio-d82f94fc45e1385a60b1729e3b6ae4570625b4574706df0e63dd1c82312633da WatchSource:0}: Error finding container d82f94fc45e1385a60b1729e3b6ae4570625b4574706df0e63dd1c82312633da: Status 404 returned error can't find the container with id d82f94fc45e1385a60b1729e3b6ae4570625b4574706df0e63dd1c82312633da
Jul 15 19:42:21.132530 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:21.132440    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7" event={"ID":"1e506650-d997-48b3-80f1-20bcb097d077","Type":"ContainerStarted","Data":"bd2a086f13c327cbcb3b5c1b350003373de5cb226b5aca19da5f3fc5c16f0d3e"}
Jul 15 19:42:21.132530 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:21.132492    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7" event={"ID":"1e506650-d997-48b3-80f1-20bcb097d077","Type":"ContainerStarted","Data":"d82f94fc45e1385a60b1729e3b6ae4570625b4574706df0e63dd1c82312633da"}
Jul 15 19:42:21.132710 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:21.132529    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"
Jul 15 19:42:21.153373 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:21.153329    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7" podStartSLOduration=1.681272823 podStartE2EDuration="2.15331369s" totalImagesPullingTime="472.040867ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:42:21.151746333 +0000 UTC m=+1665.089784802" watchObservedRunningTime="2026-07-15 19:42:21.15331369 +0000 UTC m=+1665.091352156"
Jul 15 19:42:24.108327 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:24.108288    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l"]
Jul 15 19:42:24.112091 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:24.112067    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l"
Jul 15 19:42:24.115029 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:24.115012    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhrw8\""
Jul 15 19:42:24.121745 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:24.121722    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l"]
Jul 15 19:42:24.201577 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:24.201543    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c673c2f7-efbd-4b8f-bfa6-660757a56276-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l\" (UID: \"c673c2f7-efbd-4b8f-bfa6-660757a56276\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l"
Jul 15 19:42:24.302372 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:24.302335    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c673c2f7-efbd-4b8f-bfa6-660757a56276-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l\" (UID: \"c673c2f7-efbd-4b8f-bfa6-660757a56276\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l"
Jul 15 19:42:24.302987 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:24.302957    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c673c2f7-efbd-4b8f-bfa6-660757a56276-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l\" (UID: \"c673c2f7-efbd-4b8f-bfa6-660757a56276\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l"
Jul 15 19:42:24.423335 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:24.423253    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l"
Jul 15 19:42:24.561134 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:24.561110    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l"]
Jul 15 19:42:24.562943 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:42:24.562916    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc673c2f7_efbd_4b8f_bfa6_660757a56276.slice/crio-83d1d9ead31131870ada1c93e9087077b1b741fdd79743cd7ad513a15fe78baa WatchSource:0}: Error finding container 83d1d9ead31131870ada1c93e9087077b1b741fdd79743cd7ad513a15fe78baa: Status 404 returned error can't find the container with id 83d1d9ead31131870ada1c93e9087077b1b741fdd79743cd7ad513a15fe78baa
Jul 15 19:42:25.159339 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:25.159297    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l" event={"ID":"c673c2f7-efbd-4b8f-bfa6-660757a56276","Type":"ContainerStarted","Data":"9203eab4834b70ddde25d1368274a7c5245c4a25dab01981c935f4eb628827cd"}
Jul 15 19:42:25.159673 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:25.159397    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l" event={"ID":"c673c2f7-efbd-4b8f-bfa6-660757a56276","Type":"ContainerStarted","Data":"83d1d9ead31131870ada1c93e9087077b1b741fdd79743cd7ad513a15fe78baa"}
Jul 15 19:42:25.180565 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:25.180515    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l" podStartSLOduration=1.180495037 podStartE2EDuration="1.180495037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:42:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:42:25.178588683 +0000 UTC m=+1669.116627150" watchObservedRunningTime="2026-07-15 19:42:25.180495037 +0000 UTC m=+1669.118533505"
Jul 15 19:42:26.166005 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:26.165969    2565 generic.go:356] "Generic (PLEG): container finished" podID="c673c2f7-efbd-4b8f-bfa6-660757a56276" containerID="9203eab4834b70ddde25d1368274a7c5245c4a25dab01981c935f4eb628827cd" exitCode=7
Jul 15 19:42:26.166465 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:26.166045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l" event={"ID":"c673c2f7-efbd-4b8f-bfa6-660757a56276","Type":"ContainerDied","Data":"9203eab4834b70ddde25d1368274a7c5245c4a25dab01981c935f4eb628827cd"}
Jul 15 19:42:26.166465 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:26.166286    2565 scope.go:117] "RemoveContainer" containerID="9203eab4834b70ddde25d1368274a7c5245c4a25dab01981c935f4eb628827cd"
Jul 15 19:42:27.142627 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:27.142601    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"
Jul 15 19:42:27.173444 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:27.173412    2565 generic.go:356] "Generic (PLEG): container finished" podID="c673c2f7-efbd-4b8f-bfa6-660757a56276" containerID="6777a2003fe5bf82c719517c7e653a97ac7d8f548a474c8bf30fd5a9de21ed63" exitCode=7
Jul 15 19:42:27.173853 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:27.173469    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l" event={"ID":"c673c2f7-efbd-4b8f-bfa6-660757a56276","Type":"ContainerDied","Data":"6777a2003fe5bf82c719517c7e653a97ac7d8f548a474c8bf30fd5a9de21ed63"}
Jul 15 19:42:27.173853 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:27.173515    2565 scope.go:117] "RemoveContainer" containerID="9203eab4834b70ddde25d1368274a7c5245c4a25dab01981c935f4eb628827cd"
Jul 15 19:42:27.173853 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:27.173682    2565 scope.go:117] "RemoveContainer" containerID="6777a2003fe5bf82c719517c7e653a97ac7d8f548a474c8bf30fd5a9de21ed63"
Jul 15 19:42:27.173993 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:42:27.173913    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l_odh-ai-gateway-infra(c673c2f7-efbd-4b8f-bfa6-660757a56276)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l" podUID="c673c2f7-efbd-4b8f-bfa6-660757a56276"
Jul 15 19:42:28.180680 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:28.180652    2565 scope.go:117] "RemoveContainer" containerID="6777a2003fe5bf82c719517c7e653a97ac7d8f548a474c8bf30fd5a9de21ed63"
Jul 15 19:42:28.181042 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:42:28.180857    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l_odh-ai-gateway-infra(c673c2f7-efbd-4b8f-bfa6-660757a56276)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l" podUID="c673c2f7-efbd-4b8f-bfa6-660757a56276"
Jul 15 19:42:38.683352 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:38.683321    2565 scope.go:117] "RemoveContainer" containerID="6777a2003fe5bf82c719517c7e653a97ac7d8f548a474c8bf30fd5a9de21ed63"
Jul 15 19:42:39.238241 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:39.238213    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l" event={"ID":"c673c2f7-efbd-4b8f-bfa6-660757a56276","Type":"ContainerStarted","Data":"44fd8a516b4a378b6b31276483f0200fab1d60026b319eeba96c1608234fda8d"}
Jul 15 19:42:40.245192 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:40.245154    2565 generic.go:356] "Generic (PLEG): container finished" podID="c673c2f7-efbd-4b8f-bfa6-660757a56276" containerID="44fd8a516b4a378b6b31276483f0200fab1d60026b319eeba96c1608234fda8d" exitCode=0
Jul 15 19:42:40.245628 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:40.245216    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l" event={"ID":"c673c2f7-efbd-4b8f-bfa6-660757a56276","Type":"ContainerDied","Data":"44fd8a516b4a378b6b31276483f0200fab1d60026b319eeba96c1608234fda8d"}
Jul 15 19:42:40.245628 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:40.245273    2565 scope.go:117] "RemoveContainer" containerID="6777a2003fe5bf82c719517c7e653a97ac7d8f548a474c8bf30fd5a9de21ed63"
Jul 15 19:42:40.276819 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:40.276788    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l"]
Jul 15 19:42:41.388852 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:41.388823    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l"
Jul 15 19:42:41.477811 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:41.477781    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c673c2f7-efbd-4b8f-bfa6-660757a56276-maas-api-service-ca\") pod \"c673c2f7-efbd-4b8f-bfa6-660757a56276\" (UID: \"c673c2f7-efbd-4b8f-bfa6-660757a56276\") "
Jul 15 19:42:41.478111 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:41.478090    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c673c2f7-efbd-4b8f-bfa6-660757a56276-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c673c2f7-efbd-4b8f-bfa6-660757a56276" (UID: "c673c2f7-efbd-4b8f-bfa6-660757a56276"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:42:41.578949 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:41.578874    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c673c2f7-efbd-4b8f-bfa6-660757a56276-maas-api-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:42:42.258596 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:42.258559    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l" event={"ID":"c673c2f7-efbd-4b8f-bfa6-660757a56276","Type":"ContainerDied","Data":"83d1d9ead31131870ada1c93e9087077b1b741fdd79743cd7ad513a15fe78baa"}
Jul 15 19:42:42.258757 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:42.258612    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83d1d9ead31131870ada1c93e9087077b1b741fdd79743cd7ad513a15fe78baa"
Jul 15 19:42:42.258757 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:42.258577    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l"
Jul 15 19:42:42.297397 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:42.297370    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l"]
Jul 15 19:42:42.299465 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:42.299443    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-lnz2l"]
Jul 15 19:42:42.688663 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:42:42.688627    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c673c2f7-efbd-4b8f-bfa6-660757a56276" path="/var/lib/kubelet/pods/c673c2f7-efbd-4b8f-bfa6-660757a56276/volumes"
Jul 15 19:43:14.172964 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:14.172885    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-thnx2"]
Jul 15 19:43:14.173404 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:14.173303    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c673c2f7-efbd-4b8f-bfa6-660757a56276" containerName="revoke-keys"
Jul 15 19:43:14.173404 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:14.173315    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c673c2f7-efbd-4b8f-bfa6-660757a56276" containerName="revoke-keys"
Jul 15 19:43:14.173404 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:14.173325    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c673c2f7-efbd-4b8f-bfa6-660757a56276" containerName="revoke-keys"
Jul 15 19:43:14.173404 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:14.173330    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c673c2f7-efbd-4b8f-bfa6-660757a56276" containerName="revoke-keys"
Jul 15 19:43:14.173530 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:14.173407    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c673c2f7-efbd-4b8f-bfa6-660757a56276" containerName="revoke-keys"
Jul 15 19:43:14.173530 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:14.173415    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c673c2f7-efbd-4b8f-bfa6-660757a56276" containerName="revoke-keys"
Jul 15 19:43:14.176450 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:14.176434    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-thnx2"
Jul 15 19:43:14.179437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:14.179411    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhrw8\""
Jul 15 19:43:14.187415 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:14.187392    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-thnx2"]
Jul 15 19:43:14.286643 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:14.286619    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5db1edfb-b666-4f3a-ac64-120ea5bd7870-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e3a43be3-thnx2\" (UID: \"5db1edfb-b666-4f3a-ac64-120ea5bd7870\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-thnx2"
Jul 15 19:43:14.387579 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:14.387552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5db1edfb-b666-4f3a-ac64-120ea5bd7870-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e3a43be3-thnx2\" (UID: \"5db1edfb-b666-4f3a-ac64-120ea5bd7870\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-thnx2"
Jul 15 19:43:14.388155 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:14.388138    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5db1edfb-b666-4f3a-ac64-120ea5bd7870-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e3a43be3-thnx2\" (UID: \"5db1edfb-b666-4f3a-ac64-120ea5bd7870\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-thnx2"
Jul 15 19:43:14.487864 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:14.487793    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-thnx2"
Jul 15 19:43:14.637805 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:14.637782    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-thnx2"]
Jul 15 19:43:14.640349 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:43:14.640314    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5db1edfb_b666_4f3a_ac64_120ea5bd7870.slice/crio-9da16057a36ccae21bef94b360e71e21ae130e4f9e3795d976dfea27b69b4734 WatchSource:0}: Error finding container 9da16057a36ccae21bef94b360e71e21ae130e4f9e3795d976dfea27b69b4734: Status 404 returned error can't find the container with id 9da16057a36ccae21bef94b360e71e21ae130e4f9e3795d976dfea27b69b4734
Jul 15 19:43:15.429519 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:15.429486    2565 generic.go:356] "Generic (PLEG): container finished" podID="5db1edfb-b666-4f3a-ac64-120ea5bd7870" containerID="3422400148f630861abfb344b3e421c2a9a5d1e65e29e511e5905a4f9c7e9494" exitCode=0
Jul 15 19:43:15.429888 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:15.429532    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-thnx2" event={"ID":"5db1edfb-b666-4f3a-ac64-120ea5bd7870","Type":"ContainerDied","Data":"3422400148f630861abfb344b3e421c2a9a5d1e65e29e511e5905a4f9c7e9494"}
Jul 15 19:43:15.429888 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:15.429600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-thnx2" event={"ID":"5db1edfb-b666-4f3a-ac64-120ea5bd7870","Type":"ContainerStarted","Data":"9da16057a36ccae21bef94b360e71e21ae130e4f9e3795d976dfea27b69b4734"}
Jul 15 19:43:16.570386 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:16.570362    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-thnx2"
Jul 15 19:43:16.710321 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:16.710254    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5db1edfb-b666-4f3a-ac64-120ea5bd7870-maas-api-service-ca\") pod \"5db1edfb-b666-4f3a-ac64-120ea5bd7870\" (UID: \"5db1edfb-b666-4f3a-ac64-120ea5bd7870\") "
Jul 15 19:43:16.710633 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:16.710611    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5db1edfb-b666-4f3a-ac64-120ea5bd7870-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5db1edfb-b666-4f3a-ac64-120ea5bd7870" (UID: "5db1edfb-b666-4f3a-ac64-120ea5bd7870"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:43:16.811257 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:16.811225    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5db1edfb-b666-4f3a-ac64-120ea5bd7870-maas-api-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:43:17.440609 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:17.440583    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-thnx2"
Jul 15 19:43:17.440609 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:17.440591    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e3a43be3-thnx2" event={"ID":"5db1edfb-b666-4f3a-ac64-120ea5bd7870","Type":"ContainerDied","Data":"9da16057a36ccae21bef94b360e71e21ae130e4f9e3795d976dfea27b69b4734"}
Jul 15 19:43:17.440819 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:17.440632    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9da16057a36ccae21bef94b360e71e21ae130e4f9e3795d976dfea27b69b4734"
Jul 15 19:43:24.700614 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:24.700583    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"]
Jul 15 19:43:24.701083 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:24.700774    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7" podUID="1e506650-d997-48b3-80f1-20bcb097d077" containerName="maas-api" containerID="cri-o://bd2a086f13c327cbcb3b5c1b350003373de5cb226b5aca19da5f3fc5c16f0d3e" gracePeriod=30
Jul 15 19:43:24.955239 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:24.955176    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"
Jul 15 19:43:24.984626 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:24.984600    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6fd6\" (UniqueName: \"kubernetes.io/projected/1e506650-d997-48b3-80f1-20bcb097d077-kube-api-access-g6fd6\") pod \"1e506650-d997-48b3-80f1-20bcb097d077\" (UID: \"1e506650-d997-48b3-80f1-20bcb097d077\") "
Jul 15 19:43:24.984757 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:24.984649    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e506650-d997-48b3-80f1-20bcb097d077-openshift-service-ca\") pod \"1e506650-d997-48b3-80f1-20bcb097d077\" (UID: \"1e506650-d997-48b3-80f1-20bcb097d077\") "
Jul 15 19:43:24.984757 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:24.984719    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e506650-d997-48b3-80f1-20bcb097d077-maas-api-tls\") pod \"1e506650-d997-48b3-80f1-20bcb097d077\" (UID: \"1e506650-d997-48b3-80f1-20bcb097d077\") "
Jul 15 19:43:24.985008 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:24.984981    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e506650-d997-48b3-80f1-20bcb097d077-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1e506650-d997-48b3-80f1-20bcb097d077" (UID: "1e506650-d997-48b3-80f1-20bcb097d077"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:43:24.986627 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:24.986595    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e506650-d997-48b3-80f1-20bcb097d077-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1e506650-d997-48b3-80f1-20bcb097d077" (UID: "1e506650-d997-48b3-80f1-20bcb097d077"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:43:24.986714 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:24.986636    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e506650-d997-48b3-80f1-20bcb097d077-kube-api-access-g6fd6" (OuterVolumeSpecName: "kube-api-access-g6fd6") pod "1e506650-d997-48b3-80f1-20bcb097d077" (UID: "1e506650-d997-48b3-80f1-20bcb097d077"). InnerVolumeSpecName "kube-api-access-g6fd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:43:25.085871 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:25.085840    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e506650-d997-48b3-80f1-20bcb097d077-maas-api-tls\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:43:25.085871 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:25.085866    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6fd6\" (UniqueName: \"kubernetes.io/projected/1e506650-d997-48b3-80f1-20bcb097d077-kube-api-access-g6fd6\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:43:25.086051 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:25.085879    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e506650-d997-48b3-80f1-20bcb097d077-openshift-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:43:25.481172 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:25.481138    2565 generic.go:356] "Generic (PLEG): container finished" podID="1e506650-d997-48b3-80f1-20bcb097d077" containerID="bd2a086f13c327cbcb3b5c1b350003373de5cb226b5aca19da5f3fc5c16f0d3e" exitCode=0
Jul 15 19:43:25.481395 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:25.481185    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"
Jul 15 19:43:25.481395 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:25.481233    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7" event={"ID":"1e506650-d997-48b3-80f1-20bcb097d077","Type":"ContainerDied","Data":"bd2a086f13c327cbcb3b5c1b350003373de5cb226b5aca19da5f3fc5c16f0d3e"}
Jul 15 19:43:25.481395 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:25.481297    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7" event={"ID":"1e506650-d997-48b3-80f1-20bcb097d077","Type":"ContainerDied","Data":"d82f94fc45e1385a60b1729e3b6ae4570625b4574706df0e63dd1c82312633da"}
Jul 15 19:43:25.481395 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:25.481326    2565 scope.go:117] "RemoveContainer" containerID="bd2a086f13c327cbcb3b5c1b350003373de5cb226b5aca19da5f3fc5c16f0d3e"
Jul 15 19:43:25.497379 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:25.497361    2565 scope.go:117] "RemoveContainer" containerID="bd2a086f13c327cbcb3b5c1b350003373de5cb226b5aca19da5f3fc5c16f0d3e"
Jul 15 19:43:25.497651 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:43:25.497630    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd2a086f13c327cbcb3b5c1b350003373de5cb226b5aca19da5f3fc5c16f0d3e\": container with ID starting with bd2a086f13c327cbcb3b5c1b350003373de5cb226b5aca19da5f3fc5c16f0d3e not found: ID does not exist" containerID="bd2a086f13c327cbcb3b5c1b350003373de5cb226b5aca19da5f3fc5c16f0d3e"
Jul 15 19:43:25.497741 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:25.497657    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd2a086f13c327cbcb3b5c1b350003373de5cb226b5aca19da5f3fc5c16f0d3e"} err="failed to get container status \"bd2a086f13c327cbcb3b5c1b350003373de5cb226b5aca19da5f3fc5c16f0d3e\": rpc error: code = NotFound desc = could not find container \"bd2a086f13c327cbcb3b5c1b350003373de5cb226b5aca19da5f3fc5c16f0d3e\": container with ID starting with bd2a086f13c327cbcb3b5c1b350003373de5cb226b5aca19da5f3fc5c16f0d3e not found: ID does not exist"
Jul 15 19:43:25.510753 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:25.510726    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"]
Jul 15 19:43:25.515921 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:25.515899    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e3a43be3-69466676bf-cqnz7"]
Jul 15 19:43:26.689886 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:26.689854    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e506650-d997-48b3-80f1-20bcb097d077" path="/var/lib/kubelet/pods/1e506650-d997-48b3-80f1-20bcb097d077/volumes"
Jul 15 19:43:41.926550 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:41.926519    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"]
Jul 15 19:43:41.926920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:41.926907    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c673c2f7-efbd-4b8f-bfa6-660757a56276" containerName="revoke-keys"
Jul 15 19:43:41.926962 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:41.926921    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c673c2f7-efbd-4b8f-bfa6-660757a56276" containerName="revoke-keys"
Jul 15 19:43:41.926962 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:41.926937    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e506650-d997-48b3-80f1-20bcb097d077" containerName="maas-api"
Jul 15 19:43:41.926962 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:41.926942    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e506650-d997-48b3-80f1-20bcb097d077" containerName="maas-api"
Jul 15 19:43:41.926962 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:41.926954    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5db1edfb-b666-4f3a-ac64-120ea5bd7870" containerName="revoke-keys"
Jul 15 19:43:41.926962 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:41.926959    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5db1edfb-b666-4f3a-ac64-120ea5bd7870" containerName="revoke-keys"
Jul 15 19:43:41.927109 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:41.927038    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e506650-d997-48b3-80f1-20bcb097d077" containerName="maas-api"
Jul 15 19:43:41.927109 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:41.927048    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c673c2f7-efbd-4b8f-bfa6-660757a56276" containerName="revoke-keys"
Jul 15 19:43:41.927109 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:41.927058    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5db1edfb-b666-4f3a-ac64-120ea5bd7870" containerName="revoke-keys"
Jul 15 19:43:41.930063 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:41.930042    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"
Jul 15 19:43:41.933154 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:41.933133    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-65a7a336-serving-cert\""
Jul 15 19:43:41.948994 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:41.948961    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"]
Jul 15 19:43:42.034562 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:42.034527    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/210a8de3-230d-4827-a638-a7ec526c1689-openshift-service-ca\") pod \"maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm\" (UID: \"210a8de3-230d-4827-a638-a7ec526c1689\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"
Jul 15 19:43:42.034725 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:42.034573    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/210a8de3-230d-4827-a638-a7ec526c1689-maas-api-tls\") pod \"maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm\" (UID: \"210a8de3-230d-4827-a638-a7ec526c1689\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"
Jul 15 19:43:42.034725 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:42.034651    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrc6b\" (UniqueName: \"kubernetes.io/projected/210a8de3-230d-4827-a638-a7ec526c1689-kube-api-access-zrc6b\") pod \"maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm\" (UID: \"210a8de3-230d-4827-a638-a7ec526c1689\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"
Jul 15 19:43:42.135866 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:42.135830    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/210a8de3-230d-4827-a638-a7ec526c1689-openshift-service-ca\") pod \"maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm\" (UID: \"210a8de3-230d-4827-a638-a7ec526c1689\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"
Jul 15 19:43:42.136042 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:42.135877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/210a8de3-230d-4827-a638-a7ec526c1689-maas-api-tls\") pod \"maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm\" (UID: \"210a8de3-230d-4827-a638-a7ec526c1689\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"
Jul 15 19:43:42.136042 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:42.135920    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrc6b\" (UniqueName: \"kubernetes.io/projected/210a8de3-230d-4827-a638-a7ec526c1689-kube-api-access-zrc6b\") pod \"maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm\" (UID: \"210a8de3-230d-4827-a638-a7ec526c1689\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"
Jul 15 19:43:42.136115 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:43:42.136036    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-serving-cert: secret "maas-api-e2e-derive-65a7a336-serving-cert" not found
Jul 15 19:43:42.136148 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:43:42.136114    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/210a8de3-230d-4827-a638-a7ec526c1689-maas-api-tls podName:210a8de3-230d-4827-a638-a7ec526c1689 nodeName:}" failed. No retries permitted until 2026-07-15 19:43:42.636092726 +0000 UTC m=+1746.574131190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/210a8de3-230d-4827-a638-a7ec526c1689-maas-api-tls") pod "maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm" (UID: "210a8de3-230d-4827-a638-a7ec526c1689") : secret "maas-api-e2e-derive-65a7a336-serving-cert" not found
Jul 15 19:43:42.136515 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:42.136496    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/210a8de3-230d-4827-a638-a7ec526c1689-openshift-service-ca\") pod \"maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm\" (UID: \"210a8de3-230d-4827-a638-a7ec526c1689\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"
Jul 15 19:43:42.145914 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:42.145890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrc6b\" (UniqueName: \"kubernetes.io/projected/210a8de3-230d-4827-a638-a7ec526c1689-kube-api-access-zrc6b\") pod \"maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm\" (UID: \"210a8de3-230d-4827-a638-a7ec526c1689\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"
Jul 15 19:43:42.640584 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:42.640551    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/210a8de3-230d-4827-a638-a7ec526c1689-maas-api-tls\") pod \"maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm\" (UID: \"210a8de3-230d-4827-a638-a7ec526c1689\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"
Jul 15 19:43:42.642867 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:42.642837    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/210a8de3-230d-4827-a638-a7ec526c1689-maas-api-tls\") pod \"maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm\" (UID: \"210a8de3-230d-4827-a638-a7ec526c1689\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"
Jul 15 19:43:42.840791 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:42.840698    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"
Jul 15 19:43:42.984228 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:42.983094    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"]
Jul 15 19:43:42.992134 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:43:42.992102    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod210a8de3_230d_4827_a638_a7ec526c1689.slice/crio-5a11c1e7a6b8bedd9ae206dbfc7d1b613de6f8c3f230726a39fa3668ebbf923c WatchSource:0}: Error finding container 5a11c1e7a6b8bedd9ae206dbfc7d1b613de6f8c3f230726a39fa3668ebbf923c: Status 404 returned error can't find the container with id 5a11c1e7a6b8bedd9ae206dbfc7d1b613de6f8c3f230726a39fa3668ebbf923c
Jul 15 19:43:43.577606 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:43.577575    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm" event={"ID":"210a8de3-230d-4827-a638-a7ec526c1689","Type":"ContainerStarted","Data":"5a11c1e7a6b8bedd9ae206dbfc7d1b613de6f8c3f230726a39fa3668ebbf923c"}
Jul 15 19:43:44.585381 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:44.585344    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm" event={"ID":"210a8de3-230d-4827-a638-a7ec526c1689","Type":"ContainerStarted","Data":"6e0ac105c773026f3a309bfb0f55e9c6b631d8d690f9534d0c0b644b0b89e59c"}
Jul 15 19:43:44.585747 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:44.585433    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"
Jul 15 19:43:44.608429 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:44.608383    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm" podStartSLOduration=3.084112235 podStartE2EDuration="3.608366774s" totalImagesPullingTime="524.254539ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:43:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:43:44.606092206 +0000 UTC m=+1748.544130674" watchObservedRunningTime="2026-07-15 19:43:44.608366774 +0000 UTC m=+1748.546405248"
Jul 15 19:43:46.213654 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:46.213619    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs"]
Jul 15 19:43:46.217424 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:46.217404    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs"
Jul 15 19:43:46.219891 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:46.219870    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhrw8\""
Jul 15 19:43:46.226552 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:46.226531    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs"]
Jul 15 19:43:46.277089 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:46.277059    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9925481-d822-42fa-be9e-1a3df781ed7a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs\" (UID: \"c9925481-d822-42fa-be9e-1a3df781ed7a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs"
Jul 15 19:43:46.378222 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:46.378168    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9925481-d822-42fa-be9e-1a3df781ed7a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs\" (UID: \"c9925481-d822-42fa-be9e-1a3df781ed7a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs"
Jul 15 19:43:46.378804 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:46.378779    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9925481-d822-42fa-be9e-1a3df781ed7a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs\" (UID: \"c9925481-d822-42fa-be9e-1a3df781ed7a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs"
Jul 15 19:43:46.528104 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:46.528024    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs"
Jul 15 19:43:46.688564 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:43:46.688518    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9925481_d822_42fa_be9e_1a3df781ed7a.slice/crio-f83286c99aaa8c93480e2612d1c6238f703b500d4d56254c598c421713d9b6de WatchSource:0}: Error finding container f83286c99aaa8c93480e2612d1c6238f703b500d4d56254c598c421713d9b6de: Status 404 returned error can't find the container with id f83286c99aaa8c93480e2612d1c6238f703b500d4d56254c598c421713d9b6de
Jul 15 19:43:46.692002 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:46.691978    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs"]
Jul 15 19:43:47.618558 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:47.618526    2565 generic.go:356] "Generic (PLEG): container finished" podID="c9925481-d822-42fa-be9e-1a3df781ed7a" containerID="bd70896e6c342facfc8667c5741f345e49fbdedfbab3dfefb610ee13a6e90c49" exitCode=7
Jul 15 19:43:47.618945 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:47.618620    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs" event={"ID":"c9925481-d822-42fa-be9e-1a3df781ed7a","Type":"ContainerDied","Data":"bd70896e6c342facfc8667c5741f345e49fbdedfbab3dfefb610ee13a6e90c49"}
Jul 15 19:43:47.618945 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:47.618655    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs" event={"ID":"c9925481-d822-42fa-be9e-1a3df781ed7a","Type":"ContainerStarted","Data":"f83286c99aaa8c93480e2612d1c6238f703b500d4d56254c598c421713d9b6de"}
Jul 15 19:43:47.618945 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:47.618815    2565 scope.go:117] "RemoveContainer" containerID="bd70896e6c342facfc8667c5741f345e49fbdedfbab3dfefb610ee13a6e90c49"
Jul 15 19:43:48.625920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:48.625886    2565 generic.go:356] "Generic (PLEG): container finished" podID="c9925481-d822-42fa-be9e-1a3df781ed7a" containerID="6bed582c1d820ca9730eb3a983541d6d58b26573d7112f89a00f24e538e52164" exitCode=7
Jul 15 19:43:48.626353 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:48.625968    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs" event={"ID":"c9925481-d822-42fa-be9e-1a3df781ed7a","Type":"ContainerDied","Data":"6bed582c1d820ca9730eb3a983541d6d58b26573d7112f89a00f24e538e52164"}
Jul 15 19:43:48.626353 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:48.626017    2565 scope.go:117] "RemoveContainer" containerID="bd70896e6c342facfc8667c5741f345e49fbdedfbab3dfefb610ee13a6e90c49"
Jul 15 19:43:48.626353 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:48.626249    2565 scope.go:117] "RemoveContainer" containerID="6bed582c1d820ca9730eb3a983541d6d58b26573d7112f89a00f24e538e52164"
Jul 15 19:43:48.626520 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:43:48.626466    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs_odh-ai-gateway-infra(c9925481-d822-42fa-be9e-1a3df781ed7a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs" podUID="c9925481-d822-42fa-be9e-1a3df781ed7a"
Jul 15 19:43:49.633266 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:49.633240    2565 scope.go:117] "RemoveContainer" containerID="6bed582c1d820ca9730eb3a983541d6d58b26573d7112f89a00f24e538e52164"
Jul 15 19:43:49.633660 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:43:49.633445    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs_odh-ai-gateway-infra(c9925481-d822-42fa-be9e-1a3df781ed7a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs" podUID="c9925481-d822-42fa-be9e-1a3df781ed7a"
Jul 15 19:43:50.595690 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:43:50.595664    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"
Jul 15 19:44:00.691283 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:00.691249    2565 scope.go:117] "RemoveContainer" containerID="6bed582c1d820ca9730eb3a983541d6d58b26573d7112f89a00f24e538e52164"
Jul 15 19:44:01.704806 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:01.704772    2565 generic.go:356] "Generic (PLEG): container finished" podID="c9925481-d822-42fa-be9e-1a3df781ed7a" containerID="d7b54d8ca173cbb414695b7d31f8e0756833ddd733cb71c5616719e64acc6fdf" exitCode=0
Jul 15 19:44:01.705279 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:01.704842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs" event={"ID":"c9925481-d822-42fa-be9e-1a3df781ed7a","Type":"ContainerDied","Data":"d7b54d8ca173cbb414695b7d31f8e0756833ddd733cb71c5616719e64acc6fdf"}
Jul 15 19:44:01.705279 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:01.704901    2565 scope.go:117] "RemoveContainer" containerID="6bed582c1d820ca9730eb3a983541d6d58b26573d7112f89a00f24e538e52164"
Jul 15 19:44:02.736969 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:02.736931    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs"]
Jul 15 19:44:02.854633 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:02.854600    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs"
Jul 15 19:44:03.029664 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:03.029579    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9925481-d822-42fa-be9e-1a3df781ed7a-maas-api-service-ca\") pod \"c9925481-d822-42fa-be9e-1a3df781ed7a\" (UID: \"c9925481-d822-42fa-be9e-1a3df781ed7a\") "
Jul 15 19:44:03.029937 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:03.029917    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9925481-d822-42fa-be9e-1a3df781ed7a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c9925481-d822-42fa-be9e-1a3df781ed7a" (UID: "c9925481-d822-42fa-be9e-1a3df781ed7a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:44:03.130394 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:03.130365    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9925481-d822-42fa-be9e-1a3df781ed7a-maas-api-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:44:03.717210 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:03.717181    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs"
Jul 15 19:44:03.717380 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:03.717223    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs" event={"ID":"c9925481-d822-42fa-be9e-1a3df781ed7a","Type":"ContainerDied","Data":"f83286c99aaa8c93480e2612d1c6238f703b500d4d56254c598c421713d9b6de"}
Jul 15 19:44:03.717380 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:03.717268    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f83286c99aaa8c93480e2612d1c6238f703b500d4d56254c598c421713d9b6de"
Jul 15 19:44:03.750428 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:03.750404    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs"]
Jul 15 19:44:03.754848 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:03.754822    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-sbbbs"]
Jul 15 19:44:04.690058 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:04.690016    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9925481-d822-42fa-be9e-1a3df781ed7a" path="/var/lib/kubelet/pods/c9925481-d822-42fa-be9e-1a3df781ed7a/volumes"
Jul 15 19:44:36.267087 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.267053    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-mz2lj"]
Jul 15 19:44:36.267678 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.267657    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9925481-d822-42fa-be9e-1a3df781ed7a" containerName="revoke-keys"
Jul 15 19:44:36.267765 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.267681    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9925481-d822-42fa-be9e-1a3df781ed7a" containerName="revoke-keys"
Jul 15 19:44:36.267765 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.267716    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9925481-d822-42fa-be9e-1a3df781ed7a" containerName="revoke-keys"
Jul 15 19:44:36.267765 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.267725    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9925481-d822-42fa-be9e-1a3df781ed7a" containerName="revoke-keys"
Jul 15 19:44:36.267765 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.267740    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9925481-d822-42fa-be9e-1a3df781ed7a" containerName="revoke-keys"
Jul 15 19:44:36.267765 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.267749    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9925481-d822-42fa-be9e-1a3df781ed7a" containerName="revoke-keys"
Jul 15 19:44:36.268004 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.267852    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9925481-d822-42fa-be9e-1a3df781ed7a" containerName="revoke-keys"
Jul 15 19:44:36.268004 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.267866    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9925481-d822-42fa-be9e-1a3df781ed7a" containerName="revoke-keys"
Jul 15 19:44:36.268004 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.267874    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9925481-d822-42fa-be9e-1a3df781ed7a" containerName="revoke-keys"
Jul 15 19:44:36.271269 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.271248    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-mz2lj"
Jul 15 19:44:36.273653 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.273635    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhrw8\""
Jul 15 19:44:36.278754 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.278624    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-mz2lj"]
Jul 15 19:44:36.333791 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.333767    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b46f086-5ca9-41e7-87d0-1842ba1c2689-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-65a7a336-mz2lj\" (UID: \"0b46f086-5ca9-41e7-87d0-1842ba1c2689\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-mz2lj"
Jul 15 19:44:36.434796 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.434755    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b46f086-5ca9-41e7-87d0-1842ba1c2689-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-65a7a336-mz2lj\" (UID: \"0b46f086-5ca9-41e7-87d0-1842ba1c2689\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-mz2lj"
Jul 15 19:44:36.435574 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.435545    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b46f086-5ca9-41e7-87d0-1842ba1c2689-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-65a7a336-mz2lj\" (UID: \"0b46f086-5ca9-41e7-87d0-1842ba1c2689\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-mz2lj"
Jul 15 19:44:36.585402 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.585318    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhrw8\""
Jul 15 19:44:36.593403 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.593382    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-mz2lj"
Jul 15 19:44:36.667541 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.667513    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:44:36.670184 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.670161    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:44:36.736044 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.735911    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-mz2lj"]
Jul 15 19:44:36.738382 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:44:36.738352    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b46f086_5ca9_41e7_87d0_1842ba1c2689.slice/crio-ce8d02e640226d8ae461a69ab466d13293525a22138ab4f82531918901d63d64 WatchSource:0}: Error finding container ce8d02e640226d8ae461a69ab466d13293525a22138ab4f82531918901d63d64: Status 404 returned error can't find the container with id ce8d02e640226d8ae461a69ab466d13293525a22138ab4f82531918901d63d64
Jul 15 19:44:36.885693 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:36.885661    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-mz2lj" event={"ID":"0b46f086-5ca9-41e7-87d0-1842ba1c2689","Type":"ContainerStarted","Data":"ce8d02e640226d8ae461a69ab466d13293525a22138ab4f82531918901d63d64"}
Jul 15 19:44:37.892123 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:37.892084    2565 generic.go:356] "Generic (PLEG): container finished" podID="0b46f086-5ca9-41e7-87d0-1842ba1c2689" containerID="1e1d04a78464c3c651d07ae1bb65fcd796bd20a8a8d803abff40d7f941459fec" exitCode=0
Jul 15 19:44:37.892507 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:37.892167    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-mz2lj" event={"ID":"0b46f086-5ca9-41e7-87d0-1842ba1c2689","Type":"ContainerDied","Data":"1e1d04a78464c3c651d07ae1bb65fcd796bd20a8a8d803abff40d7f941459fec"}
Jul 15 19:44:39.026235 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:39.026196    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-mz2lj"
Jul 15 19:44:39.160856 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:39.160764    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b46f086-5ca9-41e7-87d0-1842ba1c2689-maas-api-service-ca\") pod \"0b46f086-5ca9-41e7-87d0-1842ba1c2689\" (UID: \"0b46f086-5ca9-41e7-87d0-1842ba1c2689\") "
Jul 15 19:44:39.161175 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:39.161145    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b46f086-5ca9-41e7-87d0-1842ba1c2689-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0b46f086-5ca9-41e7-87d0-1842ba1c2689" (UID: "0b46f086-5ca9-41e7-87d0-1842ba1c2689"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:44:39.261511 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:39.261478    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b46f086-5ca9-41e7-87d0-1842ba1c2689-maas-api-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:44:39.903888 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:39.903857    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-mz2lj" event={"ID":"0b46f086-5ca9-41e7-87d0-1842ba1c2689","Type":"ContainerDied","Data":"ce8d02e640226d8ae461a69ab466d13293525a22138ab4f82531918901d63d64"}
Jul 15 19:44:39.903888 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:39.903874    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65a7a336-mz2lj"
Jul 15 19:44:39.904080 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:39.903903    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce8d02e640226d8ae461a69ab466d13293525a22138ab4f82531918901d63d64"
Jul 15 19:44:46.832189 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:46.832154    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"]
Jul 15 19:44:46.832617 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:46.832428    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm" podUID="210a8de3-230d-4827-a638-a7ec526c1689" containerName="maas-api" containerID="cri-o://6e0ac105c773026f3a309bfb0f55e9c6b631d8d690f9534d0c0b644b0b89e59c" gracePeriod=30
Jul 15 19:44:47.084628 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.084573    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"
Jul 15 19:44:47.238263 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.238230    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/210a8de3-230d-4827-a638-a7ec526c1689-maas-api-tls\") pod \"210a8de3-230d-4827-a638-a7ec526c1689\" (UID: \"210a8de3-230d-4827-a638-a7ec526c1689\") "
Jul 15 19:44:47.238263 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.238270    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/210a8de3-230d-4827-a638-a7ec526c1689-openshift-service-ca\") pod \"210a8de3-230d-4827-a638-a7ec526c1689\" (UID: \"210a8de3-230d-4827-a638-a7ec526c1689\") "
Jul 15 19:44:47.238512 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.238307    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrc6b\" (UniqueName: \"kubernetes.io/projected/210a8de3-230d-4827-a638-a7ec526c1689-kube-api-access-zrc6b\") pod \"210a8de3-230d-4827-a638-a7ec526c1689\" (UID: \"210a8de3-230d-4827-a638-a7ec526c1689\") "
Jul 15 19:44:47.238571 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.238550    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/210a8de3-230d-4827-a638-a7ec526c1689-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "210a8de3-230d-4827-a638-a7ec526c1689" (UID: "210a8de3-230d-4827-a638-a7ec526c1689"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:44:47.238740 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.238718    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/210a8de3-230d-4827-a638-a7ec526c1689-openshift-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:44:47.240405 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.240373    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/210a8de3-230d-4827-a638-a7ec526c1689-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "210a8de3-230d-4827-a638-a7ec526c1689" (UID: "210a8de3-230d-4827-a638-a7ec526c1689"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:44:47.240513 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.240490    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/210a8de3-230d-4827-a638-a7ec526c1689-kube-api-access-zrc6b" (OuterVolumeSpecName: "kube-api-access-zrc6b") pod "210a8de3-230d-4827-a638-a7ec526c1689" (UID: "210a8de3-230d-4827-a638-a7ec526c1689"). InnerVolumeSpecName "kube-api-access-zrc6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:44:47.339924 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.339846    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/210a8de3-230d-4827-a638-a7ec526c1689-maas-api-tls\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:44:47.339924 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.339874    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrc6b\" (UniqueName: \"kubernetes.io/projected/210a8de3-230d-4827-a638-a7ec526c1689-kube-api-access-zrc6b\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:44:47.949413 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.949382    2565 generic.go:356] "Generic (PLEG): container finished" podID="210a8de3-230d-4827-a638-a7ec526c1689" containerID="6e0ac105c773026f3a309bfb0f55e9c6b631d8d690f9534d0c0b644b0b89e59c" exitCode=0
Jul 15 19:44:47.949845 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.949426    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"
Jul 15 19:44:47.949845 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.949463    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm" event={"ID":"210a8de3-230d-4827-a638-a7ec526c1689","Type":"ContainerDied","Data":"6e0ac105c773026f3a309bfb0f55e9c6b631d8d690f9534d0c0b644b0b89e59c"}
Jul 15 19:44:47.949845 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.949524    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm" event={"ID":"210a8de3-230d-4827-a638-a7ec526c1689","Type":"ContainerDied","Data":"5a11c1e7a6b8bedd9ae206dbfc7d1b613de6f8c3f230726a39fa3668ebbf923c"}
Jul 15 19:44:47.949845 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.949558    2565 scope.go:117] "RemoveContainer" containerID="6e0ac105c773026f3a309bfb0f55e9c6b631d8d690f9534d0c0b644b0b89e59c"
Jul 15 19:44:47.958754 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.958741    2565 scope.go:117] "RemoveContainer" containerID="6e0ac105c773026f3a309bfb0f55e9c6b631d8d690f9534d0c0b644b0b89e59c"
Jul 15 19:44:47.959003 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:44:47.958986    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e0ac105c773026f3a309bfb0f55e9c6b631d8d690f9534d0c0b644b0b89e59c\": container with ID starting with 6e0ac105c773026f3a309bfb0f55e9c6b631d8d690f9534d0c0b644b0b89e59c not found: ID does not exist" containerID="6e0ac105c773026f3a309bfb0f55e9c6b631d8d690f9534d0c0b644b0b89e59c"
Jul 15 19:44:47.959049 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.959011    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e0ac105c773026f3a309bfb0f55e9c6b631d8d690f9534d0c0b644b0b89e59c"} err="failed to get container status \"6e0ac105c773026f3a309bfb0f55e9c6b631d8d690f9534d0c0b644b0b89e59c\": rpc error: code = NotFound desc = could not find container \"6e0ac105c773026f3a309bfb0f55e9c6b631d8d690f9534d0c0b644b0b89e59c\": container with ID starting with 6e0ac105c773026f3a309bfb0f55e9c6b631d8d690f9534d0c0b644b0b89e59c not found: ID does not exist"
Jul 15 19:44:47.972503 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.972483    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"]
Jul 15 19:44:47.977448 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:47.977428    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-65a7a336-b4dff7d86-q4pcm"]
Jul 15 19:44:48.690700 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:44:48.690657    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="210a8de3-230d-4827-a638-a7ec526c1689" path="/var/lib/kubelet/pods/210a8de3-230d-4827-a638-a7ec526c1689/volumes"
Jul 15 19:45:00.156437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:00.156403    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735745-m9sv2"]
Jul 15 19:45:00.156860 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:00.156846    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="210a8de3-230d-4827-a638-a7ec526c1689" containerName="maas-api"
Jul 15 19:45:00.156914 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:00.156862    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="210a8de3-230d-4827-a638-a7ec526c1689" containerName="maas-api"
Jul 15 19:45:00.156914 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:00.156872    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b46f086-5ca9-41e7-87d0-1842ba1c2689" containerName="revoke-keys"
Jul 15 19:45:00.156914 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:00.156878    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b46f086-5ca9-41e7-87d0-1842ba1c2689" containerName="revoke-keys"
Jul 15 19:45:00.157010 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:00.156948    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="210a8de3-230d-4827-a638-a7ec526c1689" containerName="maas-api"
Jul 15 19:45:00.157010 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:00.156958    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b46f086-5ca9-41e7-87d0-1842ba1c2689" containerName="revoke-keys"
Jul 15 19:45:00.161481 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:00.161462    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735745-m9sv2"
Jul 15 19:45:00.164716 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:00.164696    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhrw8\""
Jul 15 19:45:00.171805 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:00.171784    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735745-m9sv2"
Jul 15 19:45:00.172283 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:00.172261    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735745-m9sv2"]
Jul 15 19:45:00.314362 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:00.314336    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735745-m9sv2"]
Jul 15 19:45:00.316119 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:45:00.316092    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8bd8eba_6649_44b2_8811_78f2c91916e2.slice/crio-7c9ad2b16e9f94ad89d5cc6952ef0b91611d330c16d1eeb2fd77fe97b3753b8e WatchSource:0}: Error finding container 7c9ad2b16e9f94ad89d5cc6952ef0b91611d330c16d1eeb2fd77fe97b3753b8e: Status 404 returned error can't find the container with id 7c9ad2b16e9f94ad89d5cc6952ef0b91611d330c16d1eeb2fd77fe97b3753b8e
Jul 15 19:45:01.020140 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:01.020106    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735745-m9sv2" event={"ID":"d8bd8eba-6649-44b2-8811-78f2c91916e2","Type":"ContainerStarted","Data":"9c7df3af37d19bf0507e4328706d3e41eba64efd28ba73d5f844b13abd1f7412"}
Jul 15 19:45:01.020374 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:01.020166    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735745-m9sv2" event={"ID":"d8bd8eba-6649-44b2-8811-78f2c91916e2","Type":"ContainerStarted","Data":"7c9ad2b16e9f94ad89d5cc6952ef0b91611d330c16d1eeb2fd77fe97b3753b8e"}
Jul 15 19:45:01.038144 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:01.038023    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735745-m9sv2" podStartSLOduration=1.038005825 podStartE2EDuration="1.038005825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:45:01.037684228 +0000 UTC m=+1824.975722696" watchObservedRunningTime="2026-07-15 19:45:01.038005825 +0000 UTC m=+1824.976044295"
Jul 15 19:45:02.026829 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:02.026797    2565 generic.go:356] "Generic (PLEG): container finished" podID="d8bd8eba-6649-44b2-8811-78f2c91916e2" containerID="9c7df3af37d19bf0507e4328706d3e41eba64efd28ba73d5f844b13abd1f7412" exitCode=0
Jul 15 19:45:02.027222 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:02.026882    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735745-m9sv2" event={"ID":"d8bd8eba-6649-44b2-8811-78f2c91916e2","Type":"ContainerDied","Data":"9c7df3af37d19bf0507e4328706d3e41eba64efd28ba73d5f844b13abd1f7412"}
Jul 15 19:45:03.163738 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:03.163714    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735745-m9sv2"
Jul 15 19:45:04.037860 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:04.037836    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735745-m9sv2"
Jul 15 19:45:04.038167 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:04.037872    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735745-m9sv2" event={"ID":"d8bd8eba-6649-44b2-8811-78f2c91916e2","Type":"ContainerDied","Data":"7c9ad2b16e9f94ad89d5cc6952ef0b91611d330c16d1eeb2fd77fe97b3753b8e"}
Jul 15 19:45:04.038167 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:45:04.037917    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c9ad2b16e9f94ad89d5cc6952ef0b91611d330c16d1eeb2fd77fe97b3753b8e"
Jul 15 19:46:36.715449 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:36.715421    2565 scope.go:117] "RemoveContainer" containerID="aca1779cbc3909cfaf37e7ad198c187f6c005c89454fe1ba022192609cd6d558"
Jul 15 19:46:45.054409 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.054373    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"]
Jul 15 19:46:45.054963 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.054942    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8bd8eba-6649-44b2-8811-78f2c91916e2" containerName="cleanup"
Jul 15 19:46:45.055045 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.054966    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8bd8eba-6649-44b2-8811-78f2c91916e2" containerName="cleanup"
Jul 15 19:46:45.055119 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.055107    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8bd8eba-6649-44b2-8811-78f2c91916e2" containerName="cleanup"
Jul 15 19:46:45.058312 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.058288    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"
Jul 15 19:46:45.061447 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.061427    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3b5f1eb0-serving-cert\""
Jul 15 19:46:45.071950 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.071926    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"]
Jul 15 19:46:45.151472 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.151441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d514179-8871-4a2a-8ec0-15b3cb7a9794-openshift-service-ca\") pod \"maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m\" (UID: \"1d514179-8871-4a2a-8ec0-15b3cb7a9794\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"
Jul 15 19:46:45.151635 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.151478    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2knpn\" (UniqueName: \"kubernetes.io/projected/1d514179-8871-4a2a-8ec0-15b3cb7a9794-kube-api-access-2knpn\") pod \"maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m\" (UID: \"1d514179-8871-4a2a-8ec0-15b3cb7a9794\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"
Jul 15 19:46:45.151635 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.151506    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d514179-8871-4a2a-8ec0-15b3cb7a9794-maas-api-tls\") pod \"maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m\" (UID: \"1d514179-8871-4a2a-8ec0-15b3cb7a9794\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"
Jul 15 19:46:45.252604 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.252570    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d514179-8871-4a2a-8ec0-15b3cb7a9794-openshift-service-ca\") pod \"maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m\" (UID: \"1d514179-8871-4a2a-8ec0-15b3cb7a9794\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"
Jul 15 19:46:45.252604 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.252607    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2knpn\" (UniqueName: \"kubernetes.io/projected/1d514179-8871-4a2a-8ec0-15b3cb7a9794-kube-api-access-2knpn\") pod \"maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m\" (UID: \"1d514179-8871-4a2a-8ec0-15b3cb7a9794\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"
Jul 15 19:46:45.252820 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.252630    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d514179-8871-4a2a-8ec0-15b3cb7a9794-maas-api-tls\") pod \"maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m\" (UID: \"1d514179-8871-4a2a-8ec0-15b3cb7a9794\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"
Jul 15 19:46:45.253326 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.253296    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d514179-8871-4a2a-8ec0-15b3cb7a9794-openshift-service-ca\") pod \"maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m\" (UID: \"1d514179-8871-4a2a-8ec0-15b3cb7a9794\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"
Jul 15 19:46:45.254927 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.254905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d514179-8871-4a2a-8ec0-15b3cb7a9794-maas-api-tls\") pod \"maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m\" (UID: \"1d514179-8871-4a2a-8ec0-15b3cb7a9794\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"
Jul 15 19:46:45.270135 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.270112    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2knpn\" (UniqueName: \"kubernetes.io/projected/1d514179-8871-4a2a-8ec0-15b3cb7a9794-kube-api-access-2knpn\") pod \"maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m\" (UID: \"1d514179-8871-4a2a-8ec0-15b3cb7a9794\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"
Jul 15 19:46:45.368375 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.368346    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"
Jul 15 19:46:45.510042 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.510013    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"]
Jul 15 19:46:45.511946 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:46:45.511919    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d514179_8871_4a2a_8ec0_15b3cb7a9794.slice/crio-92a88f2dff9e4b74100a2f2c3582325d55b1a7c0d2cc753331a67ac93c87fa65 WatchSource:0}: Error finding container 92a88f2dff9e4b74100a2f2c3582325d55b1a7c0d2cc753331a67ac93c87fa65: Status 404 returned error can't find the container with id 92a88f2dff9e4b74100a2f2c3582325d55b1a7c0d2cc753331a67ac93c87fa65
Jul 15 19:46:45.513259 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.513242    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:46:45.593452 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:45.593411    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m" event={"ID":"1d514179-8871-4a2a-8ec0-15b3cb7a9794","Type":"ContainerStarted","Data":"92a88f2dff9e4b74100a2f2c3582325d55b1a7c0d2cc753331a67ac93c87fa65"}
Jul 15 19:46:46.600270 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:46.600222    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m" event={"ID":"1d514179-8871-4a2a-8ec0-15b3cb7a9794","Type":"ContainerStarted","Data":"c270b7c364bd9de23b1eea0d0929a92cbbd244b6e8e6c0ed9fa836103a3ac453"}
Jul 15 19:46:46.600645 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:46.600471    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"
Jul 15 19:46:46.621615 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:46.621557    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m" podStartSLOduration=1.069921896 podStartE2EDuration="1.621536768s" totalImagesPullingTime="551.614872ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:46:46.619100694 +0000 UTC m=+1930.557139162" watchObservedRunningTime="2026-07-15 19:46:46.621536768 +0000 UTC m=+1930.559575237"
Jul 15 19:46:52.612731 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:52.612698    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"
Jul 15 19:46:57.472714 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:57.472678    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b5f1eb0-5qbdh"]
Jul 15 19:46:57.476592 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:57.476572    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b5f1eb0-5qbdh"
Jul 15 19:46:57.478879 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:57.478855    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhrw8\""
Jul 15 19:46:57.485007 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:57.484683    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b5f1eb0-5qbdh"]
Jul 15 19:46:57.562277 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:57.562238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a70b3d17-b778-46b1-b6cd-12e9e341c6de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3b5f1eb0-5qbdh\" (UID: \"a70b3d17-b778-46b1-b6cd-12e9e341c6de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b5f1eb0-5qbdh"
Jul 15 19:46:57.663722 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:57.663682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a70b3d17-b778-46b1-b6cd-12e9e341c6de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3b5f1eb0-5qbdh\" (UID: \"a70b3d17-b778-46b1-b6cd-12e9e341c6de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b5f1eb0-5qbdh"
Jul 15 19:46:57.664349 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:57.664331    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a70b3d17-b778-46b1-b6cd-12e9e341c6de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3b5f1eb0-5qbdh\" (UID: \"a70b3d17-b778-46b1-b6cd-12e9e341c6de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b5f1eb0-5qbdh"
Jul 15 19:46:57.789321 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:57.789238    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b5f1eb0-5qbdh"
Jul 15 19:46:57.925884 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:57.925858    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b5f1eb0-5qbdh"]
Jul 15 19:46:57.928739 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:46:57.928708    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda70b3d17_b778_46b1_b6cd_12e9e341c6de.slice/crio-4ef0d2478da5c658c146750de95940290ec89e04abdf4cf473fc79be8197d7f6 WatchSource:0}: Error finding container 4ef0d2478da5c658c146750de95940290ec89e04abdf4cf473fc79be8197d7f6: Status 404 returned error can't find the container with id 4ef0d2478da5c658c146750de95940290ec89e04abdf4cf473fc79be8197d7f6
Jul 15 19:46:58.663133 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:58.663102    2565 generic.go:356] "Generic (PLEG): container finished" podID="a70b3d17-b778-46b1-b6cd-12e9e341c6de" containerID="8e5ebf091a4db30f883fc6ae55c7130487b451cb6defb9b253851ec19fa2d2c6" exitCode=0
Jul 15 19:46:58.663467 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:58.663157    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b5f1eb0-5qbdh" event={"ID":"a70b3d17-b778-46b1-b6cd-12e9e341c6de","Type":"ContainerDied","Data":"8e5ebf091a4db30f883fc6ae55c7130487b451cb6defb9b253851ec19fa2d2c6"}
Jul 15 19:46:58.663467 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:58.663247    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b5f1eb0-5qbdh" event={"ID":"a70b3d17-b778-46b1-b6cd-12e9e341c6de","Type":"ContainerStarted","Data":"4ef0d2478da5c658c146750de95940290ec89e04abdf4cf473fc79be8197d7f6"}
Jul 15 19:46:59.801068 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:59.801046    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b5f1eb0-5qbdh"
Jul 15 19:46:59.884222 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:59.884183    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a70b3d17-b778-46b1-b6cd-12e9e341c6de-maas-api-service-ca\") pod \"a70b3d17-b778-46b1-b6cd-12e9e341c6de\" (UID: \"a70b3d17-b778-46b1-b6cd-12e9e341c6de\") "
Jul 15 19:46:59.884523 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:59.884503    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a70b3d17-b778-46b1-b6cd-12e9e341c6de-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a70b3d17-b778-46b1-b6cd-12e9e341c6de" (UID: "a70b3d17-b778-46b1-b6cd-12e9e341c6de"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:46:59.985411 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:46:59.985338    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a70b3d17-b778-46b1-b6cd-12e9e341c6de-maas-api-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:47:00.674561 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:00.674525    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b5f1eb0-5qbdh" event={"ID":"a70b3d17-b778-46b1-b6cd-12e9e341c6de","Type":"ContainerDied","Data":"4ef0d2478da5c658c146750de95940290ec89e04abdf4cf473fc79be8197d7f6"}
Jul 15 19:47:00.674561 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:00.674555    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3b5f1eb0-5qbdh"
Jul 15 19:47:00.674768 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:00.674596    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ef0d2478da5c658c146750de95940290ec89e04abdf4cf473fc79be8197d7f6"
Jul 15 19:47:08.108618 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.108587    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"]
Jul 15 19:47:08.109079 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.108781    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m" podUID="1d514179-8871-4a2a-8ec0-15b3cb7a9794" containerName="maas-api" containerID="cri-o://c270b7c364bd9de23b1eea0d0929a92cbbd244b6e8e6c0ed9fa836103a3ac453" gracePeriod=30
Jul 15 19:47:08.356489 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.356464    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"
Jul 15 19:47:08.465379 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.465299    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2knpn\" (UniqueName: \"kubernetes.io/projected/1d514179-8871-4a2a-8ec0-15b3cb7a9794-kube-api-access-2knpn\") pod \"1d514179-8871-4a2a-8ec0-15b3cb7a9794\" (UID: \"1d514179-8871-4a2a-8ec0-15b3cb7a9794\") "
Jul 15 19:47:08.465379 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.465339    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d514179-8871-4a2a-8ec0-15b3cb7a9794-maas-api-tls\") pod \"1d514179-8871-4a2a-8ec0-15b3cb7a9794\" (UID: \"1d514179-8871-4a2a-8ec0-15b3cb7a9794\") "
Jul 15 19:47:08.465599 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.465465    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d514179-8871-4a2a-8ec0-15b3cb7a9794-openshift-service-ca\") pod \"1d514179-8871-4a2a-8ec0-15b3cb7a9794\" (UID: \"1d514179-8871-4a2a-8ec0-15b3cb7a9794\") "
Jul 15 19:47:08.465800 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.465770    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d514179-8871-4a2a-8ec0-15b3cb7a9794-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1d514179-8871-4a2a-8ec0-15b3cb7a9794" (UID: "1d514179-8871-4a2a-8ec0-15b3cb7a9794"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:47:08.467483 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.467458    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d514179-8871-4a2a-8ec0-15b3cb7a9794-kube-api-access-2knpn" (OuterVolumeSpecName: "kube-api-access-2knpn") pod "1d514179-8871-4a2a-8ec0-15b3cb7a9794" (UID: "1d514179-8871-4a2a-8ec0-15b3cb7a9794"). InnerVolumeSpecName "kube-api-access-2knpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:47:08.467563 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.467479    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d514179-8871-4a2a-8ec0-15b3cb7a9794-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1d514179-8871-4a2a-8ec0-15b3cb7a9794" (UID: "1d514179-8871-4a2a-8ec0-15b3cb7a9794"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:47:08.566113 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.566084    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d514179-8871-4a2a-8ec0-15b3cb7a9794-openshift-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:47:08.566113 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.566109    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2knpn\" (UniqueName: \"kubernetes.io/projected/1d514179-8871-4a2a-8ec0-15b3cb7a9794-kube-api-access-2knpn\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:47:08.566311 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.566120    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d514179-8871-4a2a-8ec0-15b3cb7a9794-maas-api-tls\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:47:08.718469 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.718393    2565 generic.go:356] "Generic (PLEG): container finished" podID="1d514179-8871-4a2a-8ec0-15b3cb7a9794" containerID="c270b7c364bd9de23b1eea0d0929a92cbbd244b6e8e6c0ed9fa836103a3ac453" exitCode=0
Jul 15 19:47:08.718469 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.718439    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"
Jul 15 19:47:08.718469 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.718452    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m" event={"ID":"1d514179-8871-4a2a-8ec0-15b3cb7a9794","Type":"ContainerDied","Data":"c270b7c364bd9de23b1eea0d0929a92cbbd244b6e8e6c0ed9fa836103a3ac453"}
Jul 15 19:47:08.718685 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.718503    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m" event={"ID":"1d514179-8871-4a2a-8ec0-15b3cb7a9794","Type":"ContainerDied","Data":"92a88f2dff9e4b74100a2f2c3582325d55b1a7c0d2cc753331a67ac93c87fa65"}
Jul 15 19:47:08.718685 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.718531    2565 scope.go:117] "RemoveContainer" containerID="c270b7c364bd9de23b1eea0d0929a92cbbd244b6e8e6c0ed9fa836103a3ac453"
Jul 15 19:47:08.729533 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.729517    2565 scope.go:117] "RemoveContainer" containerID="c270b7c364bd9de23b1eea0d0929a92cbbd244b6e8e6c0ed9fa836103a3ac453"
Jul 15 19:47:08.729797 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:47:08.729775    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c270b7c364bd9de23b1eea0d0929a92cbbd244b6e8e6c0ed9fa836103a3ac453\": container with ID starting with c270b7c364bd9de23b1eea0d0929a92cbbd244b6e8e6c0ed9fa836103a3ac453 not found: ID does not exist" containerID="c270b7c364bd9de23b1eea0d0929a92cbbd244b6e8e6c0ed9fa836103a3ac453"
Jul 15 19:47:08.729851 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.729806    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c270b7c364bd9de23b1eea0d0929a92cbbd244b6e8e6c0ed9fa836103a3ac453"} err="failed to get container status \"c270b7c364bd9de23b1eea0d0929a92cbbd244b6e8e6c0ed9fa836103a3ac453\": rpc error: code = NotFound desc = could not find container \"c270b7c364bd9de23b1eea0d0929a92cbbd244b6e8e6c0ed9fa836103a3ac453\": container with ID starting with c270b7c364bd9de23b1eea0d0929a92cbbd244b6e8e6c0ed9fa836103a3ac453 not found: ID does not exist"
Jul 15 19:47:08.741068 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.741042    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"]
Jul 15 19:47:08.743764 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:08.743744    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3b5f1eb0-7d89dd49d6-m2j8m"]
Jul 15 19:47:10.688327 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:10.688289    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d514179-8871-4a2a-8ec0-15b3cb7a9794" path="/var/lib/kubelet/pods/1d514179-8871-4a2a-8ec0-15b3cb7a9794/volumes"
Jul 15 19:47:36.735507 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:36.735432    2565 scope.go:117] "RemoveContainer" containerID="4be716f502299bc220412482a1b13376a81690b4696ba93f0789ebccd6984d25"
Jul 15 19:47:48.433910 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:48.433880    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"]
Jul 15 19:47:48.434407 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:48.434365    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d514179-8871-4a2a-8ec0-15b3cb7a9794" containerName="maas-api"
Jul 15 19:47:48.434407 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:48.434385    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d514179-8871-4a2a-8ec0-15b3cb7a9794" containerName="maas-api"
Jul 15 19:47:48.434407 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:48.434400    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70b3d17-b778-46b1-b6cd-12e9e341c6de" containerName="revoke-keys"
Jul 15 19:47:48.434407 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:48.434408    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70b3d17-b778-46b1-b6cd-12e9e341c6de" containerName="revoke-keys"
Jul 15 19:47:48.434558 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:48.434516    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d514179-8871-4a2a-8ec0-15b3cb7a9794" containerName="maas-api"
Jul 15 19:47:48.434558 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:48.434528    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a70b3d17-b778-46b1-b6cd-12e9e341c6de" containerName="revoke-keys"
Jul 15 19:47:48.437673 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:48.437657    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"
Jul 15 19:47:48.440100 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:48.440078    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-73d57350-serving-cert\""
Jul 15 19:47:48.459729 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:48.459706    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"]
Jul 15 19:47:48.548921 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:48.548888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d808cd71-6dad-4420-a796-e996d5fb9858-maas-api-tls\") pod \"maas-api-e2e-mt-73d57350-bdc487c54-8fvsn\" (UID: \"d808cd71-6dad-4420-a796-e996d5fb9858\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"
Jul 15 19:47:48.549090 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:48.548996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2cgl\" (UniqueName: \"kubernetes.io/projected/d808cd71-6dad-4420-a796-e996d5fb9858-kube-api-access-c2cgl\") pod \"maas-api-e2e-mt-73d57350-bdc487c54-8fvsn\" (UID: \"d808cd71-6dad-4420-a796-e996d5fb9858\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"
Jul 15 19:47:48.549090 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:48.549022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d808cd71-6dad-4420-a796-e996d5fb9858-openshift-service-ca\") pod \"maas-api-e2e-mt-73d57350-bdc487c54-8fvsn\" (UID: \"d808cd71-6dad-4420-a796-e996d5fb9858\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"
Jul 15 19:47:48.649542 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:48.649505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2cgl\" (UniqueName: \"kubernetes.io/projected/d808cd71-6dad-4420-a796-e996d5fb9858-kube-api-access-c2cgl\") pod \"maas-api-e2e-mt-73d57350-bdc487c54-8fvsn\" (UID: \"d808cd71-6dad-4420-a796-e996d5fb9858\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"
Jul 15 19:47:48.649542 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:48.649544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d808cd71-6dad-4420-a796-e996d5fb9858-openshift-service-ca\") pod \"maas-api-e2e-mt-73d57350-bdc487c54-8fvsn\" (UID: \"d808cd71-6dad-4420-a796-e996d5fb9858\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"
Jul 15 19:47:48.649767 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:48.649570    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d808cd71-6dad-4420-a796-e996d5fb9858-maas-api-tls\") pod \"maas-api-e2e-mt-73d57350-bdc487c54-8fvsn\" (UID: \"d808cd71-6dad-4420-a796-e996d5fb9858\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"
Jul 15 19:47:48.649767 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:47:48.649699    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-serving-cert: secret "maas-api-e2e-mt-73d57350-serving-cert" not found
Jul 15 19:47:48.649767 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:47:48.649758    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d808cd71-6dad-4420-a796-e996d5fb9858-maas-api-tls podName:d808cd71-6dad-4420-a796-e996d5fb9858 nodeName:}" failed. No retries permitted until 2026-07-15 19:47:49.14974325 +0000 UTC m=+1993.087781697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d808cd71-6dad-4420-a796-e996d5fb9858-maas-api-tls") pod "maas-api-e2e-mt-73d57350-bdc487c54-8fvsn" (UID: "d808cd71-6dad-4420-a796-e996d5fb9858") : secret "maas-api-e2e-mt-73d57350-serving-cert" not found
Jul 15 19:47:48.650273 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:48.650252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d808cd71-6dad-4420-a796-e996d5fb9858-openshift-service-ca\") pod \"maas-api-e2e-mt-73d57350-bdc487c54-8fvsn\" (UID: \"d808cd71-6dad-4420-a796-e996d5fb9858\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"
Jul 15 19:47:48.661413 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:48.661385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2cgl\" (UniqueName: \"kubernetes.io/projected/d808cd71-6dad-4420-a796-e996d5fb9858-kube-api-access-c2cgl\") pod \"maas-api-e2e-mt-73d57350-bdc487c54-8fvsn\" (UID: \"d808cd71-6dad-4420-a796-e996d5fb9858\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"
Jul 15 19:47:49.155425 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:49.155381    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d808cd71-6dad-4420-a796-e996d5fb9858-maas-api-tls\") pod \"maas-api-e2e-mt-73d57350-bdc487c54-8fvsn\" (UID: \"d808cd71-6dad-4420-a796-e996d5fb9858\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"
Jul 15 19:47:49.155645 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:47:49.155541    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-serving-cert: secret "maas-api-e2e-mt-73d57350-serving-cert" not found
Jul 15 19:47:49.155645 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:47:49.155630    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d808cd71-6dad-4420-a796-e996d5fb9858-maas-api-tls podName:d808cd71-6dad-4420-a796-e996d5fb9858 nodeName:}" failed. No retries permitted until 2026-07-15 19:47:50.155614593 +0000 UTC m=+1994.093653044 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d808cd71-6dad-4420-a796-e996d5fb9858-maas-api-tls") pod "maas-api-e2e-mt-73d57350-bdc487c54-8fvsn" (UID: "d808cd71-6dad-4420-a796-e996d5fb9858") : secret "maas-api-e2e-mt-73d57350-serving-cert" not found
Jul 15 19:47:50.164601 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:50.164569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d808cd71-6dad-4420-a796-e996d5fb9858-maas-api-tls\") pod \"maas-api-e2e-mt-73d57350-bdc487c54-8fvsn\" (UID: \"d808cd71-6dad-4420-a796-e996d5fb9858\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"
Jul 15 19:47:50.166914 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:50.166894    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d808cd71-6dad-4420-a796-e996d5fb9858-maas-api-tls\") pod \"maas-api-e2e-mt-73d57350-bdc487c54-8fvsn\" (UID: \"d808cd71-6dad-4420-a796-e996d5fb9858\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"
Jul 15 19:47:50.249603 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:50.249575    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"
Jul 15 19:47:50.390317 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:50.390294    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"]
Jul 15 19:47:50.393033 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:47:50.393007    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd808cd71_6dad_4420_a796_e996d5fb9858.slice/crio-1129f8091c89e6f0129dc1054bef15a5186f7b53608c285985de1b9d7ff31f30 WatchSource:0}: Error finding container 1129f8091c89e6f0129dc1054bef15a5186f7b53608c285985de1b9d7ff31f30: Status 404 returned error can't find the container with id 1129f8091c89e6f0129dc1054bef15a5186f7b53608c285985de1b9d7ff31f30
Jul 15 19:47:50.939078 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:50.939055    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn" event={"ID":"d808cd71-6dad-4420-a796-e996d5fb9858","Type":"ContainerStarted","Data":"9fbb5b7ddcb0c82c91a9c4e676666a1abec1cd5b787070b4d4776347b7bafc07"}
Jul 15 19:47:50.939180 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:50.939098    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn" event={"ID":"d808cd71-6dad-4420-a796-e996d5fb9858","Type":"ContainerStarted","Data":"1129f8091c89e6f0129dc1054bef15a5186f7b53608c285985de1b9d7ff31f30"}
Jul 15 19:47:50.939180 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:50.939128    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"
Jul 15 19:47:50.957798 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:50.957750    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn" podStartSLOduration=2.486814406 podStartE2EDuration="2.957732286s" totalImagesPullingTime="470.91788ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:47:50.957478926 +0000 UTC m=+1994.895517396" watchObservedRunningTime="2026-07-15 19:47:50.957732286 +0000 UTC m=+1994.895770754"
Jul 15 19:47:56.949302 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:47:56.949274    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"
Jul 15 19:48:46.910570 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:46.910537    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73d57350-vrnpz"]
Jul 15 19:48:46.914230 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:46.914192    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73d57350-vrnpz"
Jul 15 19:48:46.919903 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:46.919880    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhrw8\""
Jul 15 19:48:46.933838 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:46.933813    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73d57350-vrnpz"]
Jul 15 19:48:47.004042 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:47.004013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36698776-7eac-4c31-b67c-15912ef52a67-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-73d57350-vrnpz\" (UID: \"36698776-7eac-4c31-b67c-15912ef52a67\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73d57350-vrnpz"
Jul 15 19:48:47.105550 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:47.105521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36698776-7eac-4c31-b67c-15912ef52a67-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-73d57350-vrnpz\" (UID: \"36698776-7eac-4c31-b67c-15912ef52a67\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73d57350-vrnpz"
Jul 15 19:48:47.106166 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:47.106148    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36698776-7eac-4c31-b67c-15912ef52a67-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-73d57350-vrnpz\" (UID: \"36698776-7eac-4c31-b67c-15912ef52a67\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73d57350-vrnpz"
Jul 15 19:48:47.225183 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:47.225094    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73d57350-vrnpz"
Jul 15 19:48:47.400158 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:47.400132    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73d57350-vrnpz"]
Jul 15 19:48:47.402913 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:48:47.402884    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36698776_7eac_4c31_b67c_15912ef52a67.slice/crio-969f0a790519bb3d499740f8e51bbbd325e50abd6a267e60fb2aee9e0cfc84e3 WatchSource:0}: Error finding container 969f0a790519bb3d499740f8e51bbbd325e50abd6a267e60fb2aee9e0cfc84e3: Status 404 returned error can't find the container with id 969f0a790519bb3d499740f8e51bbbd325e50abd6a267e60fb2aee9e0cfc84e3
Jul 15 19:48:48.239250 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:48.239223    2565 generic.go:356] "Generic (PLEG): container finished" podID="36698776-7eac-4c31-b67c-15912ef52a67" containerID="e2df63c192f85e6fe08ee82dfa98961e0895d14b8d1d5dd133c643d86abbf086" exitCode=0
Jul 15 19:48:48.239611 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:48.239312    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73d57350-vrnpz" event={"ID":"36698776-7eac-4c31-b67c-15912ef52a67","Type":"ContainerDied","Data":"e2df63c192f85e6fe08ee82dfa98961e0895d14b8d1d5dd133c643d86abbf086"}
Jul 15 19:48:48.239611 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:48.239361    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73d57350-vrnpz" event={"ID":"36698776-7eac-4c31-b67c-15912ef52a67","Type":"ContainerStarted","Data":"969f0a790519bb3d499740f8e51bbbd325e50abd6a267e60fb2aee9e0cfc84e3"}
Jul 15 19:48:49.379309 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:49.379285    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73d57350-vrnpz"
Jul 15 19:48:49.429920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:49.429885    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36698776-7eac-4c31-b67c-15912ef52a67-maas-api-service-ca\") pod \"36698776-7eac-4c31-b67c-15912ef52a67\" (UID: \"36698776-7eac-4c31-b67c-15912ef52a67\") "
Jul 15 19:48:49.430243 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:49.430220    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36698776-7eac-4c31-b67c-15912ef52a67-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "36698776-7eac-4c31-b67c-15912ef52a67" (UID: "36698776-7eac-4c31-b67c-15912ef52a67"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:48:49.531608 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:49.531529    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36698776-7eac-4c31-b67c-15912ef52a67-maas-api-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:48:50.250782 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:50.250751    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73d57350-vrnpz"
Jul 15 19:48:50.250972 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:50.250788    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-73d57350-vrnpz" event={"ID":"36698776-7eac-4c31-b67c-15912ef52a67","Type":"ContainerDied","Data":"969f0a790519bb3d499740f8e51bbbd325e50abd6a267e60fb2aee9e0cfc84e3"}
Jul 15 19:48:50.250972 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:50.250844    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="969f0a790519bb3d499740f8e51bbbd325e50abd6a267e60fb2aee9e0cfc84e3"
Jul 15 19:48:58.036272 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.036239    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"]
Jul 15 19:48:58.036739 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.036444    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn" podUID="d808cd71-6dad-4420-a796-e996d5fb9858" containerName="maas-api" containerID="cri-o://9fbb5b7ddcb0c82c91a9c4e676666a1abec1cd5b787070b4d4776347b7bafc07" gracePeriod=30
Jul 15 19:48:58.282900 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.282874    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"
Jul 15 19:48:58.296006 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.295938    2565 generic.go:356] "Generic (PLEG): container finished" podID="d808cd71-6dad-4420-a796-e996d5fb9858" containerID="9fbb5b7ddcb0c82c91a9c4e676666a1abec1cd5b787070b4d4776347b7bafc07" exitCode=0
Jul 15 19:48:58.296006 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.295983    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"
Jul 15 19:48:58.296170 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.296017    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn" event={"ID":"d808cd71-6dad-4420-a796-e996d5fb9858","Type":"ContainerDied","Data":"9fbb5b7ddcb0c82c91a9c4e676666a1abec1cd5b787070b4d4776347b7bafc07"}
Jul 15 19:48:58.296170 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.296071    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn" event={"ID":"d808cd71-6dad-4420-a796-e996d5fb9858","Type":"ContainerDied","Data":"1129f8091c89e6f0129dc1054bef15a5186f7b53608c285985de1b9d7ff31f30"}
Jul 15 19:48:58.296170 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.296096    2565 scope.go:117] "RemoveContainer" containerID="9fbb5b7ddcb0c82c91a9c4e676666a1abec1cd5b787070b4d4776347b7bafc07"
Jul 15 19:48:58.304451 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.304430    2565 scope.go:117] "RemoveContainer" containerID="9fbb5b7ddcb0c82c91a9c4e676666a1abec1cd5b787070b4d4776347b7bafc07"
Jul 15 19:48:58.304718 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:48:58.304699    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fbb5b7ddcb0c82c91a9c4e676666a1abec1cd5b787070b4d4776347b7bafc07\": container with ID starting with 9fbb5b7ddcb0c82c91a9c4e676666a1abec1cd5b787070b4d4776347b7bafc07 not found: ID does not exist" containerID="9fbb5b7ddcb0c82c91a9c4e676666a1abec1cd5b787070b4d4776347b7bafc07"
Jul 15 19:48:58.304777 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.304730    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fbb5b7ddcb0c82c91a9c4e676666a1abec1cd5b787070b4d4776347b7bafc07"} err="failed to get container status \"9fbb5b7ddcb0c82c91a9c4e676666a1abec1cd5b787070b4d4776347b7bafc07\": rpc error: code = NotFound desc = could not find container \"9fbb5b7ddcb0c82c91a9c4e676666a1abec1cd5b787070b4d4776347b7bafc07\": container with ID starting with 9fbb5b7ddcb0c82c91a9c4e676666a1abec1cd5b787070b4d4776347b7bafc07 not found: ID does not exist"
Jul 15 19:48:58.428705 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.428671    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2cgl\" (UniqueName: \"kubernetes.io/projected/d808cd71-6dad-4420-a796-e996d5fb9858-kube-api-access-c2cgl\") pod \"d808cd71-6dad-4420-a796-e996d5fb9858\" (UID: \"d808cd71-6dad-4420-a796-e996d5fb9858\") "
Jul 15 19:48:58.428875 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.428714    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d808cd71-6dad-4420-a796-e996d5fb9858-maas-api-tls\") pod \"d808cd71-6dad-4420-a796-e996d5fb9858\" (UID: \"d808cd71-6dad-4420-a796-e996d5fb9858\") "
Jul 15 19:48:58.428875 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.428767    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d808cd71-6dad-4420-a796-e996d5fb9858-openshift-service-ca\") pod \"d808cd71-6dad-4420-a796-e996d5fb9858\" (UID: \"d808cd71-6dad-4420-a796-e996d5fb9858\") "
Jul 15 19:48:58.429171 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.429147    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d808cd71-6dad-4420-a796-e996d5fb9858-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d808cd71-6dad-4420-a796-e996d5fb9858" (UID: "d808cd71-6dad-4420-a796-e996d5fb9858"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:48:58.430730 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.430704    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d808cd71-6dad-4420-a796-e996d5fb9858-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d808cd71-6dad-4420-a796-e996d5fb9858" (UID: "d808cd71-6dad-4420-a796-e996d5fb9858"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:48:58.430830 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.430810    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d808cd71-6dad-4420-a796-e996d5fb9858-kube-api-access-c2cgl" (OuterVolumeSpecName: "kube-api-access-c2cgl") pod "d808cd71-6dad-4420-a796-e996d5fb9858" (UID: "d808cd71-6dad-4420-a796-e996d5fb9858"). InnerVolumeSpecName "kube-api-access-c2cgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:48:58.530046 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.529998    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2cgl\" (UniqueName: \"kubernetes.io/projected/d808cd71-6dad-4420-a796-e996d5fb9858-kube-api-access-c2cgl\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:48:58.530046 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.530039    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d808cd71-6dad-4420-a796-e996d5fb9858-maas-api-tls\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:48:58.530046 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.530049    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d808cd71-6dad-4420-a796-e996d5fb9858-openshift-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:48:58.627711 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.627681    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"]
Jul 15 19:48:58.636240 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.636194    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-73d57350-bdc487c54-8fvsn"]
Jul 15 19:48:58.689506 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:48:58.689476    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d808cd71-6dad-4420-a796-e996d5fb9858" path="/var/lib/kubelet/pods/d808cd71-6dad-4420-a796-e996d5fb9858/volumes"
Jul 15 19:49:36.701953 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:49:36.701927    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:49:36.707158 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:49:36.707137    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:49:36.768449 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:49:36.768423    2565 scope.go:117] "RemoveContainer" containerID="44fd8a516b4a378b6b31276483f0200fab1d60026b319eeba96c1608234fda8d"
Jul 15 19:50:36.791628 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:50:36.791556    2565 scope.go:117] "RemoveContainer" containerID="d7b54d8ca173cbb414695b7d31f8e0756833ddd733cb71c5616719e64acc6fdf"
Jul 15 19:51:20.654168 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:20.654132    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"]
Jul 15 19:51:20.654634 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:20.654577    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36698776-7eac-4c31-b67c-15912ef52a67" containerName="revoke-keys"
Jul 15 19:51:20.654634 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:20.654590    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="36698776-7eac-4c31-b67c-15912ef52a67" containerName="revoke-keys"
Jul 15 19:51:20.654634 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:20.654600    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d808cd71-6dad-4420-a796-e996d5fb9858" containerName="maas-api"
Jul 15 19:51:20.654634 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:20.654605    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d808cd71-6dad-4420-a796-e996d5fb9858" containerName="maas-api"
Jul 15 19:51:20.654814 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:20.654671    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="36698776-7eac-4c31-b67c-15912ef52a67" containerName="revoke-keys"
Jul 15 19:51:20.654814 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:20.654684    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d808cd71-6dad-4420-a796-e996d5fb9858" containerName="maas-api"
Jul 15 19:51:20.657938 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:20.657920    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"
Jul 15 19:51:20.660773 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:20.660752    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-9130b1-serving-cert\""
Jul 15 19:51:20.681741 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:20.681712    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"]
Jul 15 19:51:20.747327 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:20.747301    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b05f751c-9c87-4f93-a81e-5460b7a1a258-maas-api-tls\") pod \"maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52\" (UID: \"b05f751c-9c87-4f93-a81e-5460b7a1a258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"
Jul 15 19:51:20.747477 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:20.747367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbrqj\" (UniqueName: \"kubernetes.io/projected/b05f751c-9c87-4f93-a81e-5460b7a1a258-kube-api-access-wbrqj\") pod \"maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52\" (UID: \"b05f751c-9c87-4f93-a81e-5460b7a1a258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"
Jul 15 19:51:20.747477 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:20.747394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b05f751c-9c87-4f93-a81e-5460b7a1a258-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52\" (UID: \"b05f751c-9c87-4f93-a81e-5460b7a1a258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"
Jul 15 19:51:20.848571 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:20.848532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbrqj\" (UniqueName: \"kubernetes.io/projected/b05f751c-9c87-4f93-a81e-5460b7a1a258-kube-api-access-wbrqj\") pod \"maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52\" (UID: \"b05f751c-9c87-4f93-a81e-5460b7a1a258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"
Jul 15 19:51:20.848759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:20.848578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b05f751c-9c87-4f93-a81e-5460b7a1a258-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52\" (UID: \"b05f751c-9c87-4f93-a81e-5460b7a1a258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"
Jul 15 19:51:20.848759 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:20.848707    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b05f751c-9c87-4f93-a81e-5460b7a1a258-maas-api-tls\") pod \"maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52\" (UID: \"b05f751c-9c87-4f93-a81e-5460b7a1a258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"
Jul 15 19:51:20.848868 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:51:20.848806    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-serving-cert: secret "maas-api-e2e-inf-a-9130b1-serving-cert" not found
Jul 15 19:51:20.848920 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:51:20.848877    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b05f751c-9c87-4f93-a81e-5460b7a1a258-maas-api-tls podName:b05f751c-9c87-4f93-a81e-5460b7a1a258 nodeName:}" failed. No retries permitted until 2026-07-15 19:51:21.348857292 +0000 UTC m=+2205.286895748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b05f751c-9c87-4f93-a81e-5460b7a1a258-maas-api-tls") pod "maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52" (UID: "b05f751c-9c87-4f93-a81e-5460b7a1a258") : secret "maas-api-e2e-inf-a-9130b1-serving-cert" not found
Jul 15 19:51:20.849299 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:20.849278    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b05f751c-9c87-4f93-a81e-5460b7a1a258-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52\" (UID: \"b05f751c-9c87-4f93-a81e-5460b7a1a258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"
Jul 15 19:51:20.864037 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:20.864007    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbrqj\" (UniqueName: \"kubernetes.io/projected/b05f751c-9c87-4f93-a81e-5460b7a1a258-kube-api-access-wbrqj\") pod \"maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52\" (UID: \"b05f751c-9c87-4f93-a81e-5460b7a1a258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"
Jul 15 19:51:21.354221 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:21.354166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b05f751c-9c87-4f93-a81e-5460b7a1a258-maas-api-tls\") pod \"maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52\" (UID: \"b05f751c-9c87-4f93-a81e-5460b7a1a258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"
Jul 15 19:51:21.356496 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:21.356471    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b05f751c-9c87-4f93-a81e-5460b7a1a258-maas-api-tls\") pod \"maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52\" (UID: \"b05f751c-9c87-4f93-a81e-5460b7a1a258\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"
Jul 15 19:51:21.567331 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:21.567286    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"
Jul 15 19:51:21.707665 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:21.707640    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"]
Jul 15 19:51:21.709626 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:51:21.709600    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb05f751c_9c87_4f93_a81e_5460b7a1a258.slice/crio-e3dbe05fab3ece6c9af71d88cd88c2e24587c709200655747c0d6b922b0a70d9 WatchSource:0}: Error finding container e3dbe05fab3ece6c9af71d88cd88c2e24587c709200655747c0d6b922b0a70d9: Status 404 returned error can't find the container with id e3dbe05fab3ece6c9af71d88cd88c2e24587c709200655747c0d6b922b0a70d9
Jul 15 19:51:22.047741 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:22.047663    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52" event={"ID":"b05f751c-9c87-4f93-a81e-5460b7a1a258","Type":"ContainerStarted","Data":"e3dbe05fab3ece6c9af71d88cd88c2e24587c709200655747c0d6b922b0a70d9"}
Jul 15 19:51:23.061541 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:23.061503    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52" event={"ID":"b05f751c-9c87-4f93-a81e-5460b7a1a258","Type":"ContainerStarted","Data":"cc70480d89e8085a8051b6da84bfd182913e00c1e4c311f54054c986ccfdfc1c"}
Jul 15 19:51:23.062027 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:23.061626    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"
Jul 15 19:51:23.085088 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:23.085041    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52" podStartSLOduration=2.648178115 podStartE2EDuration="3.085027268s" totalImagesPullingTime="436.849153ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:51:23.082655553 +0000 UTC m=+2207.020694020" watchObservedRunningTime="2026-07-15 19:51:23.085027268 +0000 UTC m=+2207.023065736"
Jul 15 19:51:28.540572 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:28.540544    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"]
Jul 15 19:51:28.544422 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:28.544397    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"
Jul 15 19:51:28.548072 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:28.548049    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-2908a6-serving-cert\""
Jul 15 19:51:28.557279 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:28.557252    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"]
Jul 15 19:51:28.625145 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:28.625117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljlww\" (UniqueName: \"kubernetes.io/projected/718fd40b-ad0a-40f6-9106-6e20701c8452-kube-api-access-ljlww\") pod \"maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm\" (UID: \"718fd40b-ad0a-40f6-9106-6e20701c8452\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"
Jul 15 19:51:28.625320 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:28.625154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/718fd40b-ad0a-40f6-9106-6e20701c8452-maas-api-tls\") pod \"maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm\" (UID: \"718fd40b-ad0a-40f6-9106-6e20701c8452\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"
Jul 15 19:51:28.625320 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:28.625182    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/718fd40b-ad0a-40f6-9106-6e20701c8452-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm\" (UID: \"718fd40b-ad0a-40f6-9106-6e20701c8452\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"
Jul 15 19:51:28.726375 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:28.726341    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljlww\" (UniqueName: \"kubernetes.io/projected/718fd40b-ad0a-40f6-9106-6e20701c8452-kube-api-access-ljlww\") pod \"maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm\" (UID: \"718fd40b-ad0a-40f6-9106-6e20701c8452\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"
Jul 15 19:51:28.726375 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:28.726378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/718fd40b-ad0a-40f6-9106-6e20701c8452-maas-api-tls\") pod \"maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm\" (UID: \"718fd40b-ad0a-40f6-9106-6e20701c8452\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"
Jul 15 19:51:28.726628 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:28.726400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/718fd40b-ad0a-40f6-9106-6e20701c8452-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm\" (UID: \"718fd40b-ad0a-40f6-9106-6e20701c8452\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"
Jul 15 19:51:28.726628 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:51:28.726503    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-serving-cert: secret "maas-api-e2e-inf-b-2908a6-serving-cert" not found
Jul 15 19:51:28.726628 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:51:28.726570    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/718fd40b-ad0a-40f6-9106-6e20701c8452-maas-api-tls podName:718fd40b-ad0a-40f6-9106-6e20701c8452 nodeName:}" failed. No retries permitted until 2026-07-15 19:51:29.226554784 +0000 UTC m=+2213.164593230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/718fd40b-ad0a-40f6-9106-6e20701c8452-maas-api-tls") pod "maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm" (UID: "718fd40b-ad0a-40f6-9106-6e20701c8452") : secret "maas-api-e2e-inf-b-2908a6-serving-cert" not found
Jul 15 19:51:28.727035 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:28.727017    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/718fd40b-ad0a-40f6-9106-6e20701c8452-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm\" (UID: \"718fd40b-ad0a-40f6-9106-6e20701c8452\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"
Jul 15 19:51:28.737571 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:28.737542    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljlww\" (UniqueName: \"kubernetes.io/projected/718fd40b-ad0a-40f6-9106-6e20701c8452-kube-api-access-ljlww\") pod \"maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm\" (UID: \"718fd40b-ad0a-40f6-9106-6e20701c8452\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"
Jul 15 19:51:29.071695 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:29.071667    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"
Jul 15 19:51:29.232414 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:29.232374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/718fd40b-ad0a-40f6-9106-6e20701c8452-maas-api-tls\") pod \"maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm\" (UID: \"718fd40b-ad0a-40f6-9106-6e20701c8452\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"
Jul 15 19:51:29.234786 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:29.234764    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/718fd40b-ad0a-40f6-9106-6e20701c8452-maas-api-tls\") pod \"maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm\" (UID: \"718fd40b-ad0a-40f6-9106-6e20701c8452\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"
Jul 15 19:51:29.454971 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:29.454932    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"
Jul 15 19:51:29.602140 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:29.601914    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"]
Jul 15 19:51:29.604066 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:51:29.604029    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod718fd40b_ad0a_40f6_9106_6e20701c8452.slice/crio-80fcf2460fbd69de949c8c2e2b6bf67fdd77d88db4c335ebf25641af926ce5b0 WatchSource:0}: Error finding container 80fcf2460fbd69de949c8c2e2b6bf67fdd77d88db4c335ebf25641af926ce5b0: Status 404 returned error can't find the container with id 80fcf2460fbd69de949c8c2e2b6bf67fdd77d88db4c335ebf25641af926ce5b0
Jul 15 19:51:30.100119 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:30.100080    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm" event={"ID":"718fd40b-ad0a-40f6-9106-6e20701c8452","Type":"ContainerStarted","Data":"80fcf2460fbd69de949c8c2e2b6bf67fdd77d88db4c335ebf25641af926ce5b0"}
Jul 15 19:51:31.106925 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:31.106891    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm" event={"ID":"718fd40b-ad0a-40f6-9106-6e20701c8452","Type":"ContainerStarted","Data":"a48df8dfce0e1ce538616e37fca2c57b7798a6d7b7db54d682bdce9e01c0c4bb"}
Jul 15 19:51:31.107411 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:31.107024    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"
Jul 15 19:51:31.131002 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:31.130957    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm" podStartSLOduration=2.346384917 podStartE2EDuration="3.130941638s" totalImagesPullingTime="784.556721ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:51:31.128848413 +0000 UTC m=+2215.066886879" watchObservedRunningTime="2026-07-15 19:51:31.130941638 +0000 UTC m=+2215.068980105"
Jul 15 19:51:37.118048 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:51:37.118018    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"
Jul 15 19:53:03.980278 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:03.980243    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9130b1-wdzjb"]
Jul 15 19:53:03.985509 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:03.985482    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9130b1-wdzjb"
Jul 15 19:53:03.989120 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:03.989098    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhrw8\""
Jul 15 19:53:03.993801 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:03.993778    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9130b1-wdzjb"]
Jul 15 19:53:04.003609 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:04.003583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9130b1-wdzjb\" (UID: \"aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9130b1-wdzjb"
Jul 15 19:53:04.104538 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:04.104510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9130b1-wdzjb\" (UID: \"aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9130b1-wdzjb"
Jul 15 19:53:04.105125 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:04.105107    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9130b1-wdzjb\" (UID: \"aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9130b1-wdzjb"
Jul 15 19:53:04.298532 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:04.298448    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9130b1-wdzjb"
Jul 15 19:53:04.449594 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:04.449567    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9130b1-wdzjb"]
Jul 15 19:53:04.451752 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:53:04.451723    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa0a1330_a7a8_4e91_8fb9_d0dd937d66c3.slice/crio-754751e813022bfeb0e11a054abf60f34eb0a7874f641a548a96cf39eee71fad WatchSource:0}: Error finding container 754751e813022bfeb0e11a054abf60f34eb0a7874f641a548a96cf39eee71fad: Status 404 returned error can't find the container with id 754751e813022bfeb0e11a054abf60f34eb0a7874f641a548a96cf39eee71fad
Jul 15 19:53:04.597026 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:04.596998    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9130b1-wdzjb" event={"ID":"aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3","Type":"ContainerStarted","Data":"754751e813022bfeb0e11a054abf60f34eb0a7874f641a548a96cf39eee71fad"}
Jul 15 19:53:05.604244 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:05.604192    2565 generic.go:356] "Generic (PLEG): container finished" podID="aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3" containerID="478bbc128aac1a8ebe7b4f65f95935dee78f47337d6da231a34b879bee11b34e" exitCode=0
Jul 15 19:53:05.604244 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:05.604234    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9130b1-wdzjb" event={"ID":"aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3","Type":"ContainerDied","Data":"478bbc128aac1a8ebe7b4f65f95935dee78f47337d6da231a34b879bee11b34e"}
Jul 15 19:53:06.744680 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:06.744657    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9130b1-wdzjb"
Jul 15 19:53:06.832644 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:06.832617    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3-maas-api-service-ca\") pod \"aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3\" (UID: \"aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3\") "
Jul 15 19:53:06.832960 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:06.832939    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3" (UID: "aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:53:06.933484 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:06.933402    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3-maas-api-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:53:07.617553 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:07.617523    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9130b1-wdzjb"
Jul 15 19:53:07.617553 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:07.617537    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9130b1-wdzjb" event={"ID":"aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3","Type":"ContainerDied","Data":"754751e813022bfeb0e11a054abf60f34eb0a7874f641a548a96cf39eee71fad"}
Jul 15 19:53:07.617799 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:07.617606    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="754751e813022bfeb0e11a054abf60f34eb0a7874f641a548a96cf39eee71fad"
Jul 15 19:53:14.972099 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:14.972057    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"]
Jul 15 19:53:14.972581 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:14.972315    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52" podUID="b05f751c-9c87-4f93-a81e-5460b7a1a258" containerName="maas-api" containerID="cri-o://cc70480d89e8085a8051b6da84bfd182913e00c1e4c311f54054c986ccfdfc1c" gracePeriod=30
Jul 15 19:53:15.221315 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.221291    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"
Jul 15 19:53:15.309864 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.309791    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbrqj\" (UniqueName: \"kubernetes.io/projected/b05f751c-9c87-4f93-a81e-5460b7a1a258-kube-api-access-wbrqj\") pod \"b05f751c-9c87-4f93-a81e-5460b7a1a258\" (UID: \"b05f751c-9c87-4f93-a81e-5460b7a1a258\") "
Jul 15 19:53:15.310006 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.309911    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b05f751c-9c87-4f93-a81e-5460b7a1a258-openshift-service-ca\") pod \"b05f751c-9c87-4f93-a81e-5460b7a1a258\" (UID: \"b05f751c-9c87-4f93-a81e-5460b7a1a258\") "
Jul 15 19:53:15.310006 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.309940    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b05f751c-9c87-4f93-a81e-5460b7a1a258-maas-api-tls\") pod \"b05f751c-9c87-4f93-a81e-5460b7a1a258\" (UID: \"b05f751c-9c87-4f93-a81e-5460b7a1a258\") "
Jul 15 19:53:15.310274 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.310235    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b05f751c-9c87-4f93-a81e-5460b7a1a258-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b05f751c-9c87-4f93-a81e-5460b7a1a258" (UID: "b05f751c-9c87-4f93-a81e-5460b7a1a258"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:53:15.311926 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.311901    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b05f751c-9c87-4f93-a81e-5460b7a1a258-kube-api-access-wbrqj" (OuterVolumeSpecName: "kube-api-access-wbrqj") pod "b05f751c-9c87-4f93-a81e-5460b7a1a258" (UID: "b05f751c-9c87-4f93-a81e-5460b7a1a258"). InnerVolumeSpecName "kube-api-access-wbrqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:53:15.311990 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.311947    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b05f751c-9c87-4f93-a81e-5460b7a1a258-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b05f751c-9c87-4f93-a81e-5460b7a1a258" (UID: "b05f751c-9c87-4f93-a81e-5460b7a1a258"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:53:15.411156 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.411125    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b05f751c-9c87-4f93-a81e-5460b7a1a258-openshift-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:53:15.411156 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.411151    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b05f751c-9c87-4f93-a81e-5460b7a1a258-maas-api-tls\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:53:15.411156 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.411160    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbrqj\" (UniqueName: \"kubernetes.io/projected/b05f751c-9c87-4f93-a81e-5460b7a1a258-kube-api-access-wbrqj\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:53:15.659355 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.659323    2565 generic.go:356] "Generic (PLEG): container finished" podID="b05f751c-9c87-4f93-a81e-5460b7a1a258" containerID="cc70480d89e8085a8051b6da84bfd182913e00c1e4c311f54054c986ccfdfc1c" exitCode=0
Jul 15 19:53:15.659514 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.659362    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"
Jul 15 19:53:15.659514 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.659406    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52" event={"ID":"b05f751c-9c87-4f93-a81e-5460b7a1a258","Type":"ContainerDied","Data":"cc70480d89e8085a8051b6da84bfd182913e00c1e4c311f54054c986ccfdfc1c"}
Jul 15 19:53:15.659514 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.659460    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52" event={"ID":"b05f751c-9c87-4f93-a81e-5460b7a1a258","Type":"ContainerDied","Data":"e3dbe05fab3ece6c9af71d88cd88c2e24587c709200655747c0d6b922b0a70d9"}
Jul 15 19:53:15.659514 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.659482    2565 scope.go:117] "RemoveContainer" containerID="cc70480d89e8085a8051b6da84bfd182913e00c1e4c311f54054c986ccfdfc1c"
Jul 15 19:53:15.668929 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.668915    2565 scope.go:117] "RemoveContainer" containerID="cc70480d89e8085a8051b6da84bfd182913e00c1e4c311f54054c986ccfdfc1c"
Jul 15 19:53:15.669158 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:53:15.669141    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc70480d89e8085a8051b6da84bfd182913e00c1e4c311f54054c986ccfdfc1c\": container with ID starting with cc70480d89e8085a8051b6da84bfd182913e00c1e4c311f54054c986ccfdfc1c not found: ID does not exist" containerID="cc70480d89e8085a8051b6da84bfd182913e00c1e4c311f54054c986ccfdfc1c"
Jul 15 19:53:15.669252 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.669173    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc70480d89e8085a8051b6da84bfd182913e00c1e4c311f54054c986ccfdfc1c"} err="failed to get container status \"cc70480d89e8085a8051b6da84bfd182913e00c1e4c311f54054c986ccfdfc1c\": rpc error: code = NotFound desc = could not find container \"cc70480d89e8085a8051b6da84bfd182913e00c1e4c311f54054c986ccfdfc1c\": container with ID starting with cc70480d89e8085a8051b6da84bfd182913e00c1e4c311f54054c986ccfdfc1c not found: ID does not exist"
Jul 15 19:53:15.693888 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.693864    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"]
Jul 15 19:53:15.702118 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:15.702098    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9130b1-5d8889b5c6-6kp52"]
Jul 15 19:53:16.688389 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:16.688350    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b05f751c-9c87-4f93-a81e-5460b7a1a258" path="/var/lib/kubelet/pods/b05f751c-9c87-4f93-a81e-5460b7a1a258/volumes"
Jul 15 19:53:30.298956 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:30.298870    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2908a6-b5dzb"]
Jul 15 19:53:30.299448 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:30.299355    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3" containerName="revoke-keys"
Jul 15 19:53:30.299448 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:30.299369    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3" containerName="revoke-keys"
Jul 15 19:53:30.299448 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:30.299385    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b05f751c-9c87-4f93-a81e-5460b7a1a258" containerName="maas-api"
Jul 15 19:53:30.299448 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:30.299391    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b05f751c-9c87-4f93-a81e-5460b7a1a258" containerName="maas-api"
Jul 15 19:53:30.299578 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:30.299457    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b05f751c-9c87-4f93-a81e-5460b7a1a258" containerName="maas-api"
Jul 15 19:53:30.299578 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:30.299466    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3" containerName="revoke-keys"
Jul 15 19:53:30.304212 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:30.304183    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2908a6-b5dzb"
Jul 15 19:53:30.306739 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:30.306722    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhrw8\""
Jul 15 19:53:30.312608 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:30.312586    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2908a6-b5dzb"]
Jul 15 19:53:30.460915 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:30.460871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98a72b21-131b-469a-baae-675a6da8f65e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2908a6-b5dzb\" (UID: \"98a72b21-131b-469a-baae-675a6da8f65e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2908a6-b5dzb"
Jul 15 19:53:30.562012 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:30.561924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98a72b21-131b-469a-baae-675a6da8f65e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2908a6-b5dzb\" (UID: \"98a72b21-131b-469a-baae-675a6da8f65e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2908a6-b5dzb"
Jul 15 19:53:30.562612 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:30.562586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98a72b21-131b-469a-baae-675a6da8f65e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2908a6-b5dzb\" (UID: \"98a72b21-131b-469a-baae-675a6da8f65e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2908a6-b5dzb"
Jul 15 19:53:30.614982 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:30.614934    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2908a6-b5dzb"
Jul 15 19:53:30.756364 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:30.756333    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2908a6-b5dzb"]
Jul 15 19:53:30.758000 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:53:30.757968    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a72b21_131b_469a_baae_675a6da8f65e.slice/crio-71acce741f9646f6b75dc39563172dd09f9547d746916da96a20ab04176470a0 WatchSource:0}: Error finding container 71acce741f9646f6b75dc39563172dd09f9547d746916da96a20ab04176470a0: Status 404 returned error can't find the container with id 71acce741f9646f6b75dc39563172dd09f9547d746916da96a20ab04176470a0
Jul 15 19:53:31.742718 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:31.742628    2565 generic.go:356] "Generic (PLEG): container finished" podID="98a72b21-131b-469a-baae-675a6da8f65e" containerID="23fb06f07b34d8ae10e03ee8e3cfdeb0e8db0966d9d3d51c353477cd8b8e8f26" exitCode=0
Jul 15 19:53:31.742718 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:31.742705    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2908a6-b5dzb" event={"ID":"98a72b21-131b-469a-baae-675a6da8f65e","Type":"ContainerDied","Data":"23fb06f07b34d8ae10e03ee8e3cfdeb0e8db0966d9d3d51c353477cd8b8e8f26"}
Jul 15 19:53:31.743090 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:31.742748    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2908a6-b5dzb" event={"ID":"98a72b21-131b-469a-baae-675a6da8f65e","Type":"ContainerStarted","Data":"71acce741f9646f6b75dc39563172dd09f9547d746916da96a20ab04176470a0"}
Jul 15 19:53:32.876077 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:32.876047    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2908a6-b5dzb"
Jul 15 19:53:32.983920 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:32.983873    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98a72b21-131b-469a-baae-675a6da8f65e-maas-api-service-ca\") pod \"98a72b21-131b-469a-baae-675a6da8f65e\" (UID: \"98a72b21-131b-469a-baae-675a6da8f65e\") "
Jul 15 19:53:32.984249 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:32.984225    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98a72b21-131b-469a-baae-675a6da8f65e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "98a72b21-131b-469a-baae-675a6da8f65e" (UID: "98a72b21-131b-469a-baae-675a6da8f65e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:53:33.085462 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:33.085372    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98a72b21-131b-469a-baae-675a6da8f65e-maas-api-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:53:33.761433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:33.754929    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2908a6-b5dzb" event={"ID":"98a72b21-131b-469a-baae-675a6da8f65e","Type":"ContainerDied","Data":"71acce741f9646f6b75dc39563172dd09f9547d746916da96a20ab04176470a0"}
Jul 15 19:53:33.761433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:33.755049    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71acce741f9646f6b75dc39563172dd09f9547d746916da96a20ab04176470a0"
Jul 15 19:53:33.761433 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:33.755129    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2908a6-b5dzb"
Jul 15 19:53:41.083797 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.083756    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"]
Jul 15 19:53:41.084217 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.083971    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm" podUID="718fd40b-ad0a-40f6-9106-6e20701c8452" containerName="maas-api" containerID="cri-o://a48df8dfce0e1ce538616e37fca2c57b7798a6d7b7db54d682bdce9e01c0c4bb" gracePeriod=30
Jul 15 19:53:41.334138 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.334080    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"
Jul 15 19:53:41.357041 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.357009    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljlww\" (UniqueName: \"kubernetes.io/projected/718fd40b-ad0a-40f6-9106-6e20701c8452-kube-api-access-ljlww\") pod \"718fd40b-ad0a-40f6-9106-6e20701c8452\" (UID: \"718fd40b-ad0a-40f6-9106-6e20701c8452\") "
Jul 15 19:53:41.357190 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.357125    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/718fd40b-ad0a-40f6-9106-6e20701c8452-openshift-service-ca\") pod \"718fd40b-ad0a-40f6-9106-6e20701c8452\" (UID: \"718fd40b-ad0a-40f6-9106-6e20701c8452\") "
Jul 15 19:53:41.357190 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.357170    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/718fd40b-ad0a-40f6-9106-6e20701c8452-maas-api-tls\") pod \"718fd40b-ad0a-40f6-9106-6e20701c8452\" (UID: \"718fd40b-ad0a-40f6-9106-6e20701c8452\") "
Jul 15 19:53:41.357494 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.357470    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/718fd40b-ad0a-40f6-9106-6e20701c8452-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "718fd40b-ad0a-40f6-9106-6e20701c8452" (UID: "718fd40b-ad0a-40f6-9106-6e20701c8452"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:53:41.359249 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.359224    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/718fd40b-ad0a-40f6-9106-6e20701c8452-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "718fd40b-ad0a-40f6-9106-6e20701c8452" (UID: "718fd40b-ad0a-40f6-9106-6e20701c8452"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:53:41.359249 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.359235    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/718fd40b-ad0a-40f6-9106-6e20701c8452-kube-api-access-ljlww" (OuterVolumeSpecName: "kube-api-access-ljlww") pod "718fd40b-ad0a-40f6-9106-6e20701c8452" (UID: "718fd40b-ad0a-40f6-9106-6e20701c8452"). InnerVolumeSpecName "kube-api-access-ljlww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:53:41.457913 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.457876    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/718fd40b-ad0a-40f6-9106-6e20701c8452-openshift-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:53:41.457913 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.457906    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/718fd40b-ad0a-40f6-9106-6e20701c8452-maas-api-tls\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:53:41.457913 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.457916    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljlww\" (UniqueName: \"kubernetes.io/projected/718fd40b-ad0a-40f6-9106-6e20701c8452-kube-api-access-ljlww\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:53:41.794069 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.794034    2565 generic.go:356] "Generic (PLEG): container finished" podID="718fd40b-ad0a-40f6-9106-6e20701c8452" containerID="a48df8dfce0e1ce538616e37fca2c57b7798a6d7b7db54d682bdce9e01c0c4bb" exitCode=0
Jul 15 19:53:41.794265 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.794083    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"
Jul 15 19:53:41.794265 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.794126    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm" event={"ID":"718fd40b-ad0a-40f6-9106-6e20701c8452","Type":"ContainerDied","Data":"a48df8dfce0e1ce538616e37fca2c57b7798a6d7b7db54d682bdce9e01c0c4bb"}
Jul 15 19:53:41.794265 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.794180    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm" event={"ID":"718fd40b-ad0a-40f6-9106-6e20701c8452","Type":"ContainerDied","Data":"80fcf2460fbd69de949c8c2e2b6bf67fdd77d88db4c335ebf25641af926ce5b0"}
Jul 15 19:53:41.794265 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.794227    2565 scope.go:117] "RemoveContainer" containerID="a48df8dfce0e1ce538616e37fca2c57b7798a6d7b7db54d682bdce9e01c0c4bb"
Jul 15 19:53:41.803618 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.803608    2565 scope.go:117] "RemoveContainer" containerID="a48df8dfce0e1ce538616e37fca2c57b7798a6d7b7db54d682bdce9e01c0c4bb"
Jul 15 19:53:41.803859 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:53:41.803841    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a48df8dfce0e1ce538616e37fca2c57b7798a6d7b7db54d682bdce9e01c0c4bb\": container with ID starting with a48df8dfce0e1ce538616e37fca2c57b7798a6d7b7db54d682bdce9e01c0c4bb not found: ID does not exist" containerID="a48df8dfce0e1ce538616e37fca2c57b7798a6d7b7db54d682bdce9e01c0c4bb"
Jul 15 19:53:41.803905 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.803867    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a48df8dfce0e1ce538616e37fca2c57b7798a6d7b7db54d682bdce9e01c0c4bb"} err="failed to get container status \"a48df8dfce0e1ce538616e37fca2c57b7798a6d7b7db54d682bdce9e01c0c4bb\": rpc error: code = NotFound desc = could not find container \"a48df8dfce0e1ce538616e37fca2c57b7798a6d7b7db54d682bdce9e01c0c4bb\": container with ID starting with a48df8dfce0e1ce538616e37fca2c57b7798a6d7b7db54d682bdce9e01c0c4bb not found: ID does not exist"
Jul 15 19:53:41.833316 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.833292    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"]
Jul 15 19:53:41.841111 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:41.841092    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2908a6-6bb479b469-rhrwm"]
Jul 15 19:53:42.689119 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:53:42.689079    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="718fd40b-ad0a-40f6-9106-6e20701c8452" path="/var/lib/kubelet/pods/718fd40b-ad0a-40f6-9106-6e20701c8452/volumes"
Jul 15 19:54:01.510113 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:01.510081    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"]
Jul 15 19:54:01.510718 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:01.510697    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98a72b21-131b-469a-baae-675a6da8f65e" containerName="revoke-keys"
Jul 15 19:54:01.510799 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:01.510720    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="98a72b21-131b-469a-baae-675a6da8f65e" containerName="revoke-keys"
Jul 15 19:54:01.510799 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:01.510740    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="718fd40b-ad0a-40f6-9106-6e20701c8452" containerName="maas-api"
Jul 15 19:54:01.510799 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:01.510749    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="718fd40b-ad0a-40f6-9106-6e20701c8452" containerName="maas-api"
Jul 15 19:54:01.510946 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:01.510851    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="718fd40b-ad0a-40f6-9106-6e20701c8452" containerName="maas-api"
Jul 15 19:54:01.510946 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:01.510864    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="98a72b21-131b-469a-baae-675a6da8f65e" containerName="revoke-keys"
Jul 15 19:54:01.514380 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:01.514360    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"
Jul 15 19:54:01.519769 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:01.519741    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-ee1301-serving-cert\""
Jul 15 19:54:01.527961 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:01.527939    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"]
Jul 15 19:54:01.647530 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:01.647501    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6696e7b8-a5a4-484c-b233-28856462f207-openshift-service-ca\") pod \"maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5\" (UID: \"6696e7b8-a5a4-484c-b233-28856462f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"
Jul 15 19:54:01.647702 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:01.647546    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kxf7\" (UniqueName: \"kubernetes.io/projected/6696e7b8-a5a4-484c-b233-28856462f207-kube-api-access-5kxf7\") pod \"maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5\" (UID: \"6696e7b8-a5a4-484c-b233-28856462f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"
Jul 15 19:54:01.647702 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:01.647575    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6696e7b8-a5a4-484c-b233-28856462f207-maas-api-tls\") pod \"maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5\" (UID: \"6696e7b8-a5a4-484c-b233-28856462f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"
Jul 15 19:54:01.748352 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:01.748317    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6696e7b8-a5a4-484c-b233-28856462f207-openshift-service-ca\") pod \"maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5\" (UID: \"6696e7b8-a5a4-484c-b233-28856462f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"
Jul 15 19:54:01.748520 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:01.748366    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kxf7\" (UniqueName: \"kubernetes.io/projected/6696e7b8-a5a4-484c-b233-28856462f207-kube-api-access-5kxf7\") pod \"maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5\" (UID: \"6696e7b8-a5a4-484c-b233-28856462f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"
Jul 15 19:54:01.748520 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:01.748493    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6696e7b8-a5a4-484c-b233-28856462f207-maas-api-tls\") pod \"maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5\" (UID: \"6696e7b8-a5a4-484c-b233-28856462f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"
Jul 15 19:54:01.748636 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:54:01.748616    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-serving-cert: secret "maas-api-e2e-api-a-ee1301-serving-cert" not found
Jul 15 19:54:01.748697 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:54:01.748687    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6696e7b8-a5a4-484c-b233-28856462f207-maas-api-tls podName:6696e7b8-a5a4-484c-b233-28856462f207 nodeName:}" failed. No retries permitted until 2026-07-15 19:54:02.248671379 +0000 UTC m=+2366.186709826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6696e7b8-a5a4-484c-b233-28856462f207-maas-api-tls") pod "maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5" (UID: "6696e7b8-a5a4-484c-b233-28856462f207") : secret "maas-api-e2e-api-a-ee1301-serving-cert" not found
Jul 15 19:54:01.748986 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:01.748967    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6696e7b8-a5a4-484c-b233-28856462f207-openshift-service-ca\") pod \"maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5\" (UID: \"6696e7b8-a5a4-484c-b233-28856462f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"
Jul 15 19:54:01.760847 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:01.760782    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kxf7\" (UniqueName: \"kubernetes.io/projected/6696e7b8-a5a4-484c-b233-28856462f207-kube-api-access-5kxf7\") pod \"maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5\" (UID: \"6696e7b8-a5a4-484c-b233-28856462f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"
Jul 15 19:54:02.253638 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:02.253599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6696e7b8-a5a4-484c-b233-28856462f207-maas-api-tls\") pod \"maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5\" (UID: \"6696e7b8-a5a4-484c-b233-28856462f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"
Jul 15 19:54:02.253929 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:54:02.253782    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-serving-cert: secret "maas-api-e2e-api-a-ee1301-serving-cert" not found
Jul 15 19:54:02.253929 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:54:02.253862    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6696e7b8-a5a4-484c-b233-28856462f207-maas-api-tls podName:6696e7b8-a5a4-484c-b233-28856462f207 nodeName:}" failed. No retries permitted until 2026-07-15 19:54:03.253839514 +0000 UTC m=+2367.191877964 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6696e7b8-a5a4-484c-b233-28856462f207-maas-api-tls") pod "maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5" (UID: "6696e7b8-a5a4-484c-b233-28856462f207") : secret "maas-api-e2e-api-a-ee1301-serving-cert" not found
Jul 15 19:54:03.262437 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:03.262404    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6696e7b8-a5a4-484c-b233-28856462f207-maas-api-tls\") pod \"maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5\" (UID: \"6696e7b8-a5a4-484c-b233-28856462f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"
Jul 15 19:54:03.264929 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:03.264904    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6696e7b8-a5a4-484c-b233-28856462f207-maas-api-tls\") pod \"maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5\" (UID: \"6696e7b8-a5a4-484c-b233-28856462f207\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"
Jul 15 19:54:03.323899 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:03.323870    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"
Jul 15 19:54:03.467917 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:03.467890    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"]
Jul 15 19:54:03.470027 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:54:03.470001    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6696e7b8_a5a4_484c_b233_28856462f207.slice/crio-ea90e2074dbfc9de77ef8a8fb6a49b31188de9891ecc4d4af7f41d9f3cd1d640 WatchSource:0}: Error finding container ea90e2074dbfc9de77ef8a8fb6a49b31188de9891ecc4d4af7f41d9f3cd1d640: Status 404 returned error can't find the container with id ea90e2074dbfc9de77ef8a8fb6a49b31188de9891ecc4d4af7f41d9f3cd1d640
Jul 15 19:54:03.471426 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:03.471410    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:54:03.913127 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:03.913092    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5" event={"ID":"6696e7b8-a5a4-484c-b233-28856462f207","Type":"ContainerStarted","Data":"ea90e2074dbfc9de77ef8a8fb6a49b31188de9891ecc4d4af7f41d9f3cd1d640"}
Jul 15 19:54:04.927110 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:04.927074    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5" event={"ID":"6696e7b8-a5a4-484c-b233-28856462f207","Type":"ContainerStarted","Data":"00b00f5e4d46d0f1941079560abe4a2fe7a7538e821994ff02e28ea76c3d0b7c"}
Jul 15 19:54:04.927542 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:04.927167    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"
Jul 15 19:54:04.956077 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:04.956030    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5" podStartSLOduration=3.340566162 podStartE2EDuration="3.956016044s" totalImagesPullingTime="615.449882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:54:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:54:04.954627245 +0000 UTC m=+2368.892665713" watchObservedRunningTime="2026-07-15 19:54:04.956016044 +0000 UTC m=+2368.894054554"
Jul 15 19:54:09.626020 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:09.625985    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"]
Jul 15 19:54:09.629901 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:09.629879    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"
Jul 15 19:54:09.640268 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:09.640249    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-58f4c5-serving-cert\""
Jul 15 19:54:09.646956 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:09.646928    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"]
Jul 15 19:54:09.727100 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:09.727045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcq68\" (UniqueName: \"kubernetes.io/projected/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-kube-api-access-kcq68\") pod \"maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7\" (UID: \"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"
Jul 15 19:54:09.727300 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:09.727131    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-maas-api-tls\") pod \"maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7\" (UID: \"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"
Jul 15 19:54:09.727300 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:09.727190    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-openshift-service-ca\") pod \"maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7\" (UID: \"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"
Jul 15 19:54:09.828151 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:09.828118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcq68\" (UniqueName: \"kubernetes.io/projected/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-kube-api-access-kcq68\") pod \"maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7\" (UID: \"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"
Jul 15 19:54:09.828373 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:09.828173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-maas-api-tls\") pod \"maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7\" (UID: \"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"
Jul 15 19:54:09.828373 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:09.828257    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-openshift-service-ca\") pod \"maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7\" (UID: \"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"
Jul 15 19:54:09.828373 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:54:09.828334    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-serving-cert: secret "maas-api-e2e-api-b-58f4c5-serving-cert" not found
Jul 15 19:54:09.828567 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:54:09.828403    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-maas-api-tls podName:ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf nodeName:}" failed. No retries permitted until 2026-07-15 19:54:10.328382541 +0000 UTC m=+2374.266421008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-maas-api-tls") pod "maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7" (UID: "ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf") : secret "maas-api-e2e-api-b-58f4c5-serving-cert" not found
Jul 15 19:54:09.828864 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:09.828847    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-openshift-service-ca\") pod \"maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7\" (UID: \"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"
Jul 15 19:54:09.842001 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:09.841976    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcq68\" (UniqueName: \"kubernetes.io/projected/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-kube-api-access-kcq68\") pod \"maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7\" (UID: \"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"
Jul 15 19:54:10.333710 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:10.333665    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-maas-api-tls\") pod \"maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7\" (UID: \"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"
Jul 15 19:54:10.336475 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:10.336448    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-maas-api-tls\") pod \"maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7\" (UID: \"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"
Jul 15 19:54:10.539741 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:10.539714    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"
Jul 15 19:54:10.692274 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:10.692253    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"]
Jul 15 19:54:10.694448 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:54:10.694421    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2d6f31_01d9_498c_8bb9_0c8e30b4d6bf.slice/crio-f87e76f354400ad35e6a274b1811f2244c9a8a67d3187d7d42dd33377be387b1 WatchSource:0}: Error finding container f87e76f354400ad35e6a274b1811f2244c9a8a67d3187d7d42dd33377be387b1: Status 404 returned error can't find the container with id f87e76f354400ad35e6a274b1811f2244c9a8a67d3187d7d42dd33377be387b1
Jul 15 19:54:10.938468 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:10.938441    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"
Jul 15 19:54:10.959262 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:10.959225    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7" event={"ID":"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf","Type":"ContainerStarted","Data":"f87e76f354400ad35e6a274b1811f2244c9a8a67d3187d7d42dd33377be387b1"}
Jul 15 19:54:11.965985 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:11.965950    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7" event={"ID":"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf","Type":"ContainerStarted","Data":"e050acff991221a67a636139ebf08cfe2647eda8ab7b9963888785d36851704a"}
Jul 15 19:54:11.966401 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:11.966088    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"
Jul 15 19:54:12.002762 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:12.002711    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7" podStartSLOduration=2.635426316 podStartE2EDuration="3.002693646s" totalImagesPullingTime="367.26733ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:54:12.002246601 +0000 UTC m=+2375.940285070" watchObservedRunningTime="2026-07-15 19:54:12.002693646 +0000 UTC m=+2375.940732114"
Jul 15 19:54:17.977092 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:17.977066    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"
Jul 15 19:54:36.735521 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:36.735417    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:54:36.742016 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:36.741997    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:54:43.731280 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:43.731246    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"]
Jul 15 19:54:43.731713 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:43.731440    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5" podUID="6696e7b8-a5a4-484c-b233-28856462f207" containerName="maas-api" containerID="cri-o://00b00f5e4d46d0f1941079560abe4a2fe7a7538e821994ff02e28ea76c3d0b7c" gracePeriod=30
Jul 15 19:54:43.982753 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:43.982697    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"
Jul 15 19:54:44.038731 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.038706    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6696e7b8-a5a4-484c-b233-28856462f207-openshift-service-ca\") pod \"6696e7b8-a5a4-484c-b233-28856462f207\" (UID: \"6696e7b8-a5a4-484c-b233-28856462f207\") "
Jul 15 19:54:44.038894 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.038750    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6696e7b8-a5a4-484c-b233-28856462f207-maas-api-tls\") pod \"6696e7b8-a5a4-484c-b233-28856462f207\" (UID: \"6696e7b8-a5a4-484c-b233-28856462f207\") "
Jul 15 19:54:44.038894 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.038810    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kxf7\" (UniqueName: \"kubernetes.io/projected/6696e7b8-a5a4-484c-b233-28856462f207-kube-api-access-5kxf7\") pod \"6696e7b8-a5a4-484c-b233-28856462f207\" (UID: \"6696e7b8-a5a4-484c-b233-28856462f207\") "
Jul 15 19:54:44.039100 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.039070    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6696e7b8-a5a4-484c-b233-28856462f207-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6696e7b8-a5a4-484c-b233-28856462f207" (UID: "6696e7b8-a5a4-484c-b233-28856462f207"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:54:44.040771 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.040741    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6696e7b8-a5a4-484c-b233-28856462f207-kube-api-access-5kxf7" (OuterVolumeSpecName: "kube-api-access-5kxf7") pod "6696e7b8-a5a4-484c-b233-28856462f207" (UID: "6696e7b8-a5a4-484c-b233-28856462f207"). InnerVolumeSpecName "kube-api-access-5kxf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:54:44.040850 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.040816    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6696e7b8-a5a4-484c-b233-28856462f207-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6696e7b8-a5a4-484c-b233-28856462f207" (UID: "6696e7b8-a5a4-484c-b233-28856462f207"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:54:44.134611 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.134585    2565 generic.go:356] "Generic (PLEG): container finished" podID="6696e7b8-a5a4-484c-b233-28856462f207" containerID="00b00f5e4d46d0f1941079560abe4a2fe7a7538e821994ff02e28ea76c3d0b7c" exitCode=0
Jul 15 19:54:44.134736 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.134628    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"
Jul 15 19:54:44.134736 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.134674    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5" event={"ID":"6696e7b8-a5a4-484c-b233-28856462f207","Type":"ContainerDied","Data":"00b00f5e4d46d0f1941079560abe4a2fe7a7538e821994ff02e28ea76c3d0b7c"}
Jul 15 19:54:44.134736 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.134719    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5" event={"ID":"6696e7b8-a5a4-484c-b233-28856462f207","Type":"ContainerDied","Data":"ea90e2074dbfc9de77ef8a8fb6a49b31188de9891ecc4d4af7f41d9f3cd1d640"}
Jul 15 19:54:44.134840 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.134740    2565 scope.go:117] "RemoveContainer" containerID="00b00f5e4d46d0f1941079560abe4a2fe7a7538e821994ff02e28ea76c3d0b7c"
Jul 15 19:54:44.139607 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.139582    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6696e7b8-a5a4-484c-b233-28856462f207-openshift-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:54:44.139607 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.139603    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6696e7b8-a5a4-484c-b233-28856462f207-maas-api-tls\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:54:44.139739 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.139614    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kxf7\" (UniqueName: \"kubernetes.io/projected/6696e7b8-a5a4-484c-b233-28856462f207-kube-api-access-5kxf7\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:54:44.144076 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.144059    2565 scope.go:117] "RemoveContainer" containerID="00b00f5e4d46d0f1941079560abe4a2fe7a7538e821994ff02e28ea76c3d0b7c"
Jul 15 19:54:44.144361 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:54:44.144343    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00b00f5e4d46d0f1941079560abe4a2fe7a7538e821994ff02e28ea76c3d0b7c\": container with ID starting with 00b00f5e4d46d0f1941079560abe4a2fe7a7538e821994ff02e28ea76c3d0b7c not found: ID does not exist" containerID="00b00f5e4d46d0f1941079560abe4a2fe7a7538e821994ff02e28ea76c3d0b7c"
Jul 15 19:54:44.144422 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.144369    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00b00f5e4d46d0f1941079560abe4a2fe7a7538e821994ff02e28ea76c3d0b7c"} err="failed to get container status \"00b00f5e4d46d0f1941079560abe4a2fe7a7538e821994ff02e28ea76c3d0b7c\": rpc error: code = NotFound desc = could not find container \"00b00f5e4d46d0f1941079560abe4a2fe7a7538e821994ff02e28ea76c3d0b7c\": container with ID starting with 00b00f5e4d46d0f1941079560abe4a2fe7a7538e821994ff02e28ea76c3d0b7c not found: ID does not exist"
Jul 15 19:54:44.167299 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.167278    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"]
Jul 15 19:54:44.178019 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.177994    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ee1301-5d888fb49b-kw9t5"]
Jul 15 19:54:44.689110 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:44.689076    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6696e7b8-a5a4-484c-b233-28856462f207" path="/var/lib/kubelet/pods/6696e7b8-a5a4-484c-b233-28856462f207/volumes"
Jul 15 19:54:58.796255 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:58.796156    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-58f4c5-6kp9w"]
Jul 15 19:54:58.796703 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:58.796603    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6696e7b8-a5a4-484c-b233-28856462f207" containerName="maas-api"
Jul 15 19:54:58.796703 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:58.796616    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6696e7b8-a5a4-484c-b233-28856462f207" containerName="maas-api"
Jul 15 19:54:58.796703 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:58.796686    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6696e7b8-a5a4-484c-b233-28856462f207" containerName="maas-api"
Jul 15 19:54:58.801268 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:58.801247    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-58f4c5-6kp9w"
Jul 15 19:54:58.810142 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:58.810124    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhrw8\""
Jul 15 19:54:58.856171 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:58.856146    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-58f4c5-6kp9w"]
Jul 15 19:54:58.880229 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:58.880185    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e14050b-958d-4eb5-9edf-c95d71327151-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-58f4c5-6kp9w\" (UID: \"4e14050b-958d-4eb5-9edf-c95d71327151\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-58f4c5-6kp9w"
Jul 15 19:54:58.980787 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:58.980751    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e14050b-958d-4eb5-9edf-c95d71327151-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-58f4c5-6kp9w\" (UID: \"4e14050b-958d-4eb5-9edf-c95d71327151\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-58f4c5-6kp9w"
Jul 15 19:54:58.981426 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:58.981407    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e14050b-958d-4eb5-9edf-c95d71327151-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-58f4c5-6kp9w\" (UID: \"4e14050b-958d-4eb5-9edf-c95d71327151\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-58f4c5-6kp9w"
Jul 15 19:54:59.111228 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:59.111192    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-58f4c5-6kp9w"
Jul 15 19:54:59.261707 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:54:59.261684    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-58f4c5-6kp9w"]
Jul 15 19:54:59.263892 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:54:59.263853    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e14050b_958d_4eb5_9edf_c95d71327151.slice/crio-ec3bdc187dd707d42a4e08c531a743ea0aed8f492a5822210b648ff0e337e64e WatchSource:0}: Error finding container ec3bdc187dd707d42a4e08c531a743ea0aed8f492a5822210b648ff0e337e64e: Status 404 returned error can't find the container with id ec3bdc187dd707d42a4e08c531a743ea0aed8f492a5822210b648ff0e337e64e
Jul 15 19:55:00.222735 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:00.222697    2565 generic.go:356] "Generic (PLEG): container finished" podID="4e14050b-958d-4eb5-9edf-c95d71327151" containerID="5e10404ac10c6c5e94628be1b78a93b156302cbe2a3a4db7b7cdbc962ad4786a" exitCode=0
Jul 15 19:55:00.223134 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:00.222770    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-58f4c5-6kp9w" event={"ID":"4e14050b-958d-4eb5-9edf-c95d71327151","Type":"ContainerDied","Data":"5e10404ac10c6c5e94628be1b78a93b156302cbe2a3a4db7b7cdbc962ad4786a"}
Jul 15 19:55:00.223134 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:00.222813    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-58f4c5-6kp9w" event={"ID":"4e14050b-958d-4eb5-9edf-c95d71327151","Type":"ContainerStarted","Data":"ec3bdc187dd707d42a4e08c531a743ea0aed8f492a5822210b648ff0e337e64e"}
Jul 15 19:55:01.361570 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:01.361543    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-58f4c5-6kp9w"
Jul 15 19:55:01.508576 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:01.508501    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e14050b-958d-4eb5-9edf-c95d71327151-maas-api-service-ca\") pod \"4e14050b-958d-4eb5-9edf-c95d71327151\" (UID: \"4e14050b-958d-4eb5-9edf-c95d71327151\") "
Jul 15 19:55:01.508894 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:01.508873    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e14050b-958d-4eb5-9edf-c95d71327151-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4e14050b-958d-4eb5-9edf-c95d71327151" (UID: "4e14050b-958d-4eb5-9edf-c95d71327151"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:55:01.610044 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:01.610013    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e14050b-958d-4eb5-9edf-c95d71327151-maas-api-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:55:02.235335 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:02.235309    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-58f4c5-6kp9w"
Jul 15 19:55:02.235335 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:02.235315    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-58f4c5-6kp9w" event={"ID":"4e14050b-958d-4eb5-9edf-c95d71327151","Type":"ContainerDied","Data":"ec3bdc187dd707d42a4e08c531a743ea0aed8f492a5822210b648ff0e337e64e"}
Jul 15 19:55:02.235551 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:02.235362    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec3bdc187dd707d42a4e08c531a743ea0aed8f492a5822210b648ff0e337e64e"
Jul 15 19:55:09.524343 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:09.524306    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"]
Jul 15 19:55:09.524750 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:09.524507    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7" podUID="ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf" containerName="maas-api" containerID="cri-o://e050acff991221a67a636139ebf08cfe2647eda8ab7b9963888785d36851704a" gracePeriod=30
Jul 15 19:55:09.779671 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:09.779602    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"
Jul 15 19:55:09.885773 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:09.885742    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-maas-api-tls\") pod \"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf\" (UID: \"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf\") "
Jul 15 19:55:09.885939 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:09.885794    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcq68\" (UniqueName: \"kubernetes.io/projected/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-kube-api-access-kcq68\") pod \"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf\" (UID: \"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf\") "
Jul 15 19:55:09.885939 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:09.885907    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-openshift-service-ca\") pod \"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf\" (UID: \"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf\") "
Jul 15 19:55:09.886285 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:09.886260    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf" (UID: "ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:55:09.887717 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:09.887696    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-kube-api-access-kcq68" (OuterVolumeSpecName: "kube-api-access-kcq68") pod "ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf" (UID: "ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf"). InnerVolumeSpecName "kube-api-access-kcq68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:55:09.887856 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:09.887841    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf" (UID: "ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:55:09.987102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:09.987072    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-maas-api-tls\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:55:09.987102 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:09.987102    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcq68\" (UniqueName: \"kubernetes.io/projected/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-kube-api-access-kcq68\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:55:09.987306 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:09.987111    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf-openshift-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 19:55:10.280156 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:10.280119    2565 generic.go:356] "Generic (PLEG): container finished" podID="ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf" containerID="e050acff991221a67a636139ebf08cfe2647eda8ab7b9963888785d36851704a" exitCode=0
Jul 15 19:55:10.280379 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:10.280164    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"
Jul 15 19:55:10.280379 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:10.280171    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7" event={"ID":"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf","Type":"ContainerDied","Data":"e050acff991221a67a636139ebf08cfe2647eda8ab7b9963888785d36851704a"}
Jul 15 19:55:10.280379 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:10.280240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7" event={"ID":"ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf","Type":"ContainerDied","Data":"f87e76f354400ad35e6a274b1811f2244c9a8a67d3187d7d42dd33377be387b1"}
Jul 15 19:55:10.280379 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:10.280268    2565 scope.go:117] "RemoveContainer" containerID="e050acff991221a67a636139ebf08cfe2647eda8ab7b9963888785d36851704a"
Jul 15 19:55:10.290494 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:10.290476    2565 scope.go:117] "RemoveContainer" containerID="e050acff991221a67a636139ebf08cfe2647eda8ab7b9963888785d36851704a"
Jul 15 19:55:10.290733 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:55:10.290717    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e050acff991221a67a636139ebf08cfe2647eda8ab7b9963888785d36851704a\": container with ID starting with e050acff991221a67a636139ebf08cfe2647eda8ab7b9963888785d36851704a not found: ID does not exist" containerID="e050acff991221a67a636139ebf08cfe2647eda8ab7b9963888785d36851704a"
Jul 15 19:55:10.290771 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:10.290741    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e050acff991221a67a636139ebf08cfe2647eda8ab7b9963888785d36851704a"} err="failed to get container status \"e050acff991221a67a636139ebf08cfe2647eda8ab7b9963888785d36851704a\": rpc error: code = NotFound desc = could not find container \"e050acff991221a67a636139ebf08cfe2647eda8ab7b9963888785d36851704a\": container with ID starting with e050acff991221a67a636139ebf08cfe2647eda8ab7b9963888785d36851704a not found: ID does not exist"
Jul 15 19:55:10.317514 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:10.317494    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"]
Jul 15 19:55:10.322985 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:10.322961    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-58f4c5-67f8d5cc69-v9lb7"]
Jul 15 19:55:10.695113 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:10.695076    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf" path="/var/lib/kubelet/pods/ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf/volumes"
Jul 15 19:55:29.173215 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.173171    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"]
Jul 15 19:55:29.173587 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.173574    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf" containerName="maas-api"
Jul 15 19:55:29.173631 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.173588    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf" containerName="maas-api"
Jul 15 19:55:29.173631 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.173609    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e14050b-958d-4eb5-9edf-c95d71327151" containerName="revoke-keys"
Jul 15 19:55:29.173631 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.173614    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e14050b-958d-4eb5-9edf-c95d71327151" containerName="revoke-keys"
Jul 15 19:55:29.173723 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.173678    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef2d6f31-01d9-498c-8bb9-0c8e30b4d6bf" containerName="maas-api"
Jul 15 19:55:29.173723 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.173688    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e14050b-958d-4eb5-9edf-c95d71327151" containerName="revoke-keys"
Jul 15 19:55:29.176863 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.176844    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"
Jul 15 19:55:29.179916 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.179899    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-77bf75-serving-cert\""
Jul 15 19:55:29.195676 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.195656    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"]
Jul 15 19:55:29.260226 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.260169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13494ff2-3500-45f4-9fdf-1ccce125a9f9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft\" (UID: \"13494ff2-3500-45f4-9fdf-1ccce125a9f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"
Jul 15 19:55:29.260395 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.260232    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkbr9\" (UniqueName: \"kubernetes.io/projected/13494ff2-3500-45f4-9fdf-1ccce125a9f9-kube-api-access-hkbr9\") pod \"maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft\" (UID: \"13494ff2-3500-45f4-9fdf-1ccce125a9f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"
Jul 15 19:55:29.260395 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.260282    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13494ff2-3500-45f4-9fdf-1ccce125a9f9-maas-api-tls\") pod \"maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft\" (UID: \"13494ff2-3500-45f4-9fdf-1ccce125a9f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"
Jul 15 19:55:29.361536 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.361505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13494ff2-3500-45f4-9fdf-1ccce125a9f9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft\" (UID: \"13494ff2-3500-45f4-9fdf-1ccce125a9f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"
Jul 15 19:55:29.361536 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.361538    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkbr9\" (UniqueName: \"kubernetes.io/projected/13494ff2-3500-45f4-9fdf-1ccce125a9f9-kube-api-access-hkbr9\") pod \"maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft\" (UID: \"13494ff2-3500-45f4-9fdf-1ccce125a9f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"
Jul 15 19:55:29.361719 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.361571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13494ff2-3500-45f4-9fdf-1ccce125a9f9-maas-api-tls\") pod \"maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft\" (UID: \"13494ff2-3500-45f4-9fdf-1ccce125a9f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"
Jul 15 19:55:29.362212 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.362173    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13494ff2-3500-45f4-9fdf-1ccce125a9f9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft\" (UID: \"13494ff2-3500-45f4-9fdf-1ccce125a9f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"
Jul 15 19:55:29.363873 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.363851    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13494ff2-3500-45f4-9fdf-1ccce125a9f9-maas-api-tls\") pod \"maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft\" (UID: \"13494ff2-3500-45f4-9fdf-1ccce125a9f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"
Jul 15 19:55:29.378945 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.378922    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkbr9\" (UniqueName: \"kubernetes.io/projected/13494ff2-3500-45f4-9fdf-1ccce125a9f9-kube-api-access-hkbr9\") pod \"maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft\" (UID: \"13494ff2-3500-45f4-9fdf-1ccce125a9f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"
Jul 15 19:55:29.487122 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.487057    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"
Jul 15 19:55:29.643338 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:29.643312    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"]
Jul 15 19:55:29.645884 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:55:29.645845    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13494ff2_3500_45f4_9fdf_1ccce125a9f9.slice/crio-9ec2ad2fa3423fa42db4ca3f10f4e3d319aa886b212f12cc65de9612b1401919 WatchSource:0}: Error finding container 9ec2ad2fa3423fa42db4ca3f10f4e3d319aa886b212f12cc65de9612b1401919: Status 404 returned error can't find the container with id 9ec2ad2fa3423fa42db4ca3f10f4e3d319aa886b212f12cc65de9612b1401919
Jul 15 19:55:30.397017 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:30.396972    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft" event={"ID":"13494ff2-3500-45f4-9fdf-1ccce125a9f9","Type":"ContainerStarted","Data":"ee26ed86224660578d5fc2956511f7cd93d479c7bb396f6292fe89ebf43a9b95"}
Jul 15 19:55:30.397411 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:30.397057    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft" event={"ID":"13494ff2-3500-45f4-9fdf-1ccce125a9f9","Type":"ContainerStarted","Data":"9ec2ad2fa3423fa42db4ca3f10f4e3d319aa886b212f12cc65de9612b1401919"}
Jul 15 19:55:30.397411 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:30.397104    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"
Jul 15 19:55:30.434436 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:30.434385    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft" podStartSLOduration=1.0348333730000001 podStartE2EDuration="1.434369973s" totalImagesPullingTime="399.5366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:55:30.431158936 +0000 UTC m=+2454.369197403" watchObservedRunningTime="2026-07-15 19:55:30.434369973 +0000 UTC m=+2454.372408479"
Jul 15 19:55:36.407747 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:36.407721    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"
Jul 15 19:55:38.445344 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:38.445309    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"]
Jul 15 19:55:38.450352 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:38.450329    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"
Jul 15 19:55:38.453650 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:38.453624    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-fcd095-serving-cert\""
Jul 15 19:55:38.492593 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:38.492565    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"]
Jul 15 19:55:38.554777 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:38.554742    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp96z\" (UniqueName: \"kubernetes.io/projected/10c59146-02aa-43bb-b5c7-f864fc27e7a8-kube-api-access-kp96z\") pod \"maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx\" (UID: \"10c59146-02aa-43bb-b5c7-f864fc27e7a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"
Jul 15 19:55:38.554964 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:38.554789    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10c59146-02aa-43bb-b5c7-f864fc27e7a8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx\" (UID: \"10c59146-02aa-43bb-b5c7-f864fc27e7a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"
Jul 15 19:55:38.554964 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:38.554807    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10c59146-02aa-43bb-b5c7-f864fc27e7a8-maas-api-tls\") pod \"maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx\" (UID: \"10c59146-02aa-43bb-b5c7-f864fc27e7a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"
Jul 15 19:55:38.655698 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:38.655662    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp96z\" (UniqueName: \"kubernetes.io/projected/10c59146-02aa-43bb-b5c7-f864fc27e7a8-kube-api-access-kp96z\") pod \"maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx\" (UID: \"10c59146-02aa-43bb-b5c7-f864fc27e7a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"
Jul 15 19:55:38.655896 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:38.655708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10c59146-02aa-43bb-b5c7-f864fc27e7a8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx\" (UID: \"10c59146-02aa-43bb-b5c7-f864fc27e7a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"
Jul 15 19:55:38.655896 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:38.655725    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10c59146-02aa-43bb-b5c7-f864fc27e7a8-maas-api-tls\") pod \"maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx\" (UID: \"10c59146-02aa-43bb-b5c7-f864fc27e7a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"
Jul 15 19:55:38.655896 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:55:38.655883    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-serving-cert: secret "maas-api-e2e-shared-b-fcd095-serving-cert" not found
Jul 15 19:55:38.656072 ip-10-0-134-30 kubenswrapper[2565]: E0715 19:55:38.655946    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10c59146-02aa-43bb-b5c7-f864fc27e7a8-maas-api-tls podName:10c59146-02aa-43bb-b5c7-f864fc27e7a8 nodeName:}" failed. No retries permitted until 2026-07-15 19:55:39.155925775 +0000 UTC m=+2463.093964237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/10c59146-02aa-43bb-b5c7-f864fc27e7a8-maas-api-tls") pod "maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx" (UID: "10c59146-02aa-43bb-b5c7-f864fc27e7a8") : secret "maas-api-e2e-shared-b-fcd095-serving-cert" not found
Jul 15 19:55:38.656330 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:38.656312    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10c59146-02aa-43bb-b5c7-f864fc27e7a8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx\" (UID: \"10c59146-02aa-43bb-b5c7-f864fc27e7a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"
Jul 15 19:55:38.669228 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:38.669178    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp96z\" (UniqueName: \"kubernetes.io/projected/10c59146-02aa-43bb-b5c7-f864fc27e7a8-kube-api-access-kp96z\") pod \"maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx\" (UID: \"10c59146-02aa-43bb-b5c7-f864fc27e7a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"
Jul 15 19:55:39.161505 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:39.161471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10c59146-02aa-43bb-b5c7-f864fc27e7a8-maas-api-tls\") pod \"maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx\" (UID: \"10c59146-02aa-43bb-b5c7-f864fc27e7a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"
Jul 15 19:55:39.163834 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:39.163812    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10c59146-02aa-43bb-b5c7-f864fc27e7a8-maas-api-tls\") pod \"maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx\" (UID: \"10c59146-02aa-43bb-b5c7-f864fc27e7a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"
Jul 15 19:55:39.364345 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:39.364311    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"
Jul 15 19:55:39.511674 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:39.511649    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"]
Jul 15 19:55:39.513791 ip-10-0-134-30 kubenswrapper[2565]: W0715 19:55:39.513765    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10c59146_02aa_43bb_b5c7_f864fc27e7a8.slice/crio-8d8e62f19b6e58b9dc919fa58464f1c6171bfc77e9c5b7ef621482ffc05e03c0 WatchSource:0}: Error finding container 8d8e62f19b6e58b9dc919fa58464f1c6171bfc77e9c5b7ef621482ffc05e03c0: Status 404 returned error can't find the container with id 8d8e62f19b6e58b9dc919fa58464f1c6171bfc77e9c5b7ef621482ffc05e03c0
Jul 15 19:55:40.455946 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:40.455913    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx" event={"ID":"10c59146-02aa-43bb-b5c7-f864fc27e7a8","Type":"ContainerStarted","Data":"1f4004edb3057abf13e29cb2a73254628351ab36e26f92b880409696477a6c43"}
Jul 15 19:55:40.456123 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:40.455960    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx" event={"ID":"10c59146-02aa-43bb-b5c7-f864fc27e7a8","Type":"ContainerStarted","Data":"8d8e62f19b6e58b9dc919fa58464f1c6171bfc77e9c5b7ef621482ffc05e03c0"}
Jul 15 19:55:40.456123 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:40.455989    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"
Jul 15 19:55:40.492661 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:40.492619    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx" podStartSLOduration=2.196325975 podStartE2EDuration="2.49260454s" totalImagesPullingTime="296.278565ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:55:40.488051728 +0000 UTC m=+2464.426090219" watchObservedRunningTime="2026-07-15 19:55:40.49260454 +0000 UTC m=+2464.430643047"
Jul 15 19:55:46.466841 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:55:46.466806    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"
Jul 15 19:59:36.772036 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:59:36.771915    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 19:59:36.779261 ip-10-0-134-30 kubenswrapper[2565]: I0715 19:59:36.779237    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whcqx_9c4ac0eb-5179-4f51-b8dd-8204f934a1d3/ovn-acl-logging/0.log"
Jul 15 20:00:00.168782 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.168742    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fcd095-29735760-79txj"]
Jul 15 20:00:00.172768 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.172741    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77bf75-29735760-q48hc"]
Jul 15 20:00:00.172925 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.172863    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fcd095-29735760-79txj"
Jul 15 20:00:00.178131 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.178107    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qhrw8\""
Jul 15 20:00:00.178294 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.178117    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735760-fv2qx"]
Jul 15 20:00:00.178294 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.178192    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77bf75-29735760-q48hc"
Jul 15 20:00:00.182140 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.182120    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735760-fv2qx"
Jul 15 20:00:00.184992 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.184971    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fcd095-29735760-79txj"
Jul 15 20:00:00.186608 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.186588    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fcd095-29735760-79txj"]
Jul 15 20:00:00.192354 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.191567    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77bf75-29735760-q48hc"]
Jul 15 20:00:00.195348 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.195144    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77bf75-29735760-q48hc"
Jul 15 20:00:00.201890 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.201489    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735760-fv2qx"]
Jul 15 20:00:00.237595 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.237569    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735760-fv2qx"
Jul 15 20:00:00.371045 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.371012    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fcd095-29735760-79txj"]
Jul 15 20:00:00.373875 ip-10-0-134-30 kubenswrapper[2565]: W0715 20:00:00.373829    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2acfac54_5781_4f45_9bf2_ef4aa000ae07.slice/crio-6564c59d72f8fe69a2d0e78cdcfb982efaec876bda5f2bf1942b87f357cdc966 WatchSource:0}: Error finding container 6564c59d72f8fe69a2d0e78cdcfb982efaec876bda5f2bf1942b87f357cdc966: Status 404 returned error can't find the container with id 6564c59d72f8fe69a2d0e78cdcfb982efaec876bda5f2bf1942b87f357cdc966
Jul 15 20:00:00.429411 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.429386    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735760-fv2qx"]
Jul 15 20:00:00.430888 ip-10-0-134-30 kubenswrapper[2565]: W0715 20:00:00.430866    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42bb4b2_6589_45b9_b3b7_92b67b9869bf.slice/crio-f794733c745c173b62524ae6ba45adafe18887f3fa1afe5b12fa957b4b2b53a3 WatchSource:0}: Error finding container f794733c745c173b62524ae6ba45adafe18887f3fa1afe5b12fa957b4b2b53a3: Status 404 returned error can't find the container with id f794733c745c173b62524ae6ba45adafe18887f3fa1afe5b12fa957b4b2b53a3
Jul 15 20:00:00.600981 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.600939    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77bf75-29735760-q48hc"]
Jul 15 20:00:00.603314 ip-10-0-134-30 kubenswrapper[2565]: W0715 20:00:00.603285    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6345ecac_8602_444c_8f88_b3d6c778f7d9.slice/crio-aa89df1bb88e57012c93e1d870e982bc4583fe9adc09f9387c5074131c7da0dc WatchSource:0}: Error finding container aa89df1bb88e57012c93e1d870e982bc4583fe9adc09f9387c5074131c7da0dc: Status 404 returned error can't find the container with id aa89df1bb88e57012c93e1d870e982bc4583fe9adc09f9387c5074131c7da0dc
Jul 15 20:00:00.890724 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.890684    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735760-fv2qx" event={"ID":"f42bb4b2-6589-45b9-b3b7-92b67b9869bf","Type":"ContainerStarted","Data":"a2e445265151b17c216d4196284e0cfdc15f6469e4e6afff995451a8aa5c4f17"}
Jul 15 20:00:00.890909 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.890749    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735760-fv2qx" event={"ID":"f42bb4b2-6589-45b9-b3b7-92b67b9869bf","Type":"ContainerStarted","Data":"f794733c745c173b62524ae6ba45adafe18887f3fa1afe5b12fa957b4b2b53a3"}
Jul 15 20:00:00.892341 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.892310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fcd095-29735760-79txj" event={"ID":"2acfac54-5781-4f45-9bf2-ef4aa000ae07","Type":"ContainerStarted","Data":"6642480d1bdc3829c45e77fcab88da03e47a722e944c672cfb95dd81fd990304"}
Jul 15 20:00:00.892486 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.892356    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fcd095-29735760-79txj" event={"ID":"2acfac54-5781-4f45-9bf2-ef4aa000ae07","Type":"ContainerStarted","Data":"6564c59d72f8fe69a2d0e78cdcfb982efaec876bda5f2bf1942b87f357cdc966"}
Jul 15 20:00:00.893565 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.893542    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77bf75-29735760-q48hc" event={"ID":"6345ecac-8602-444c-8f88-b3d6c778f7d9","Type":"ContainerStarted","Data":"aa89df1bb88e57012c93e1d870e982bc4583fe9adc09f9387c5074131c7da0dc"}
Jul 15 20:00:00.917197 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.917142    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735760-fv2qx" podStartSLOduration=0.917120223 podStartE2EDuration="917.120223ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:00:00.913159085 +0000 UTC m=+2724.851197557" watchObservedRunningTime="2026-07-15 20:00:00.917120223 +0000 UTC m=+2724.855158693"
Jul 15 20:00:00.952074 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:00.952021    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fcd095-29735760-79txj" podStartSLOduration=0.952004656 podStartE2EDuration="952.004656ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:00:00.951307092 +0000 UTC m=+2724.889345562" watchObservedRunningTime="2026-07-15 20:00:00.952004656 +0000 UTC m=+2724.890043125"
Jul 15 20:00:01.901661 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:01.901628    2565 generic.go:356] "Generic (PLEG): container finished" podID="f42bb4b2-6589-45b9-b3b7-92b67b9869bf" containerID="a2e445265151b17c216d4196284e0cfdc15f6469e4e6afff995451a8aa5c4f17" exitCode=0
Jul 15 20:00:01.902098 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:01.901669    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735760-fv2qx" event={"ID":"f42bb4b2-6589-45b9-b3b7-92b67b9869bf","Type":"ContainerDied","Data":"a2e445265151b17c216d4196284e0cfdc15f6469e4e6afff995451a8aa5c4f17"}
Jul 15 20:00:01.903163 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:01.903144    2565 generic.go:356] "Generic (PLEG): container finished" podID="2acfac54-5781-4f45-9bf2-ef4aa000ae07" containerID="6642480d1bdc3829c45e77fcab88da03e47a722e944c672cfb95dd81fd990304" exitCode=0
Jul 15 20:00:01.903249 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:01.903170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fcd095-29735760-79txj" event={"ID":"2acfac54-5781-4f45-9bf2-ef4aa000ae07","Type":"ContainerDied","Data":"6642480d1bdc3829c45e77fcab88da03e47a722e944c672cfb95dd81fd990304"}
Jul 15 20:00:01.904625 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:01.904605    2565 generic.go:356] "Generic (PLEG): container finished" podID="6345ecac-8602-444c-8f88-b3d6c778f7d9" containerID="68c24d6d1580e2089846e54c398b7506a6d7eb4a06f71edc3f3076a3d5e933e6" exitCode=0
Jul 15 20:00:01.904698 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:01.904683    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77bf75-29735760-q48hc" event={"ID":"6345ecac-8602-444c-8f88-b3d6c778f7d9","Type":"ContainerDied","Data":"68c24d6d1580e2089846e54c398b7506a6d7eb4a06f71edc3f3076a3d5e933e6"}
Jul 15 20:00:03.061180 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:03.061149    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fcd095-29735760-79txj"
Jul 15 20:00:03.108082 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:03.108062    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735760-fv2qx"
Jul 15 20:00:03.111195 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:03.111172    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77bf75-29735760-q48hc"
Jul 15 20:00:03.917664 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:03.917640    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735760-fv2qx"
Jul 15 20:00:03.917664 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:03.917644    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735760-fv2qx" event={"ID":"f42bb4b2-6589-45b9-b3b7-92b67b9869bf","Type":"ContainerDied","Data":"f794733c745c173b62524ae6ba45adafe18887f3fa1afe5b12fa957b4b2b53a3"}
Jul 15 20:00:03.917886 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:03.917691    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f794733c745c173b62524ae6ba45adafe18887f3fa1afe5b12fa957b4b2b53a3"
Jul 15 20:00:03.918998 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:03.918984    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fcd095-29735760-79txj"
Jul 15 20:00:03.919097 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:03.919010    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fcd095-29735760-79txj" event={"ID":"2acfac54-5781-4f45-9bf2-ef4aa000ae07","Type":"ContainerDied","Data":"6564c59d72f8fe69a2d0e78cdcfb982efaec876bda5f2bf1942b87f357cdc966"}
Jul 15 20:00:03.919097 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:03.919040    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6564c59d72f8fe69a2d0e78cdcfb982efaec876bda5f2bf1942b87f357cdc966"
Jul 15 20:00:03.920376 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:03.920353    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77bf75-29735760-q48hc" event={"ID":"6345ecac-8602-444c-8f88-b3d6c778f7d9","Type":"ContainerDied","Data":"aa89df1bb88e57012c93e1d870e982bc4583fe9adc09f9387c5074131c7da0dc"}
Jul 15 20:00:03.920376 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:03.920367    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77bf75-29735760-q48hc"
Jul 15 20:00:03.920571 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:00:03.920384    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa89df1bb88e57012c93e1d870e982bc4583fe9adc09f9387c5074131c7da0dc"
Jul 15 20:02:18.923914 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:18.923877    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"]
Jul 15 20:02:18.924389 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:18.924089    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft" podUID="13494ff2-3500-45f4-9fdf-1ccce125a9f9" containerName="maas-api" containerID="cri-o://ee26ed86224660578d5fc2956511f7cd93d479c7bb396f6292fe89ebf43a9b95" gracePeriod=30
Jul 15 20:02:18.995359 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:18.995331    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77bf75-29735760-q48hc"]
Jul 15 20:02:18.999985 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:18.999953    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77bf75-29735760-q48hc"]
Jul 15 20:02:19.176932 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.176871    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"
Jul 15 20:02:19.338490 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.338450    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13494ff2-3500-45f4-9fdf-1ccce125a9f9-maas-api-tls\") pod \"13494ff2-3500-45f4-9fdf-1ccce125a9f9\" (UID: \"13494ff2-3500-45f4-9fdf-1ccce125a9f9\") "
Jul 15 20:02:19.338703 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.338515    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13494ff2-3500-45f4-9fdf-1ccce125a9f9-openshift-service-ca\") pod \"13494ff2-3500-45f4-9fdf-1ccce125a9f9\" (UID: \"13494ff2-3500-45f4-9fdf-1ccce125a9f9\") "
Jul 15 20:02:19.338703 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.338544    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkbr9\" (UniqueName: \"kubernetes.io/projected/13494ff2-3500-45f4-9fdf-1ccce125a9f9-kube-api-access-hkbr9\") pod \"13494ff2-3500-45f4-9fdf-1ccce125a9f9\" (UID: \"13494ff2-3500-45f4-9fdf-1ccce125a9f9\") "
Jul 15 20:02:19.338985 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.338953    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13494ff2-3500-45f4-9fdf-1ccce125a9f9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "13494ff2-3500-45f4-9fdf-1ccce125a9f9" (UID: "13494ff2-3500-45f4-9fdf-1ccce125a9f9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:02:19.340627 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.340598    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13494ff2-3500-45f4-9fdf-1ccce125a9f9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "13494ff2-3500-45f4-9fdf-1ccce125a9f9" (UID: "13494ff2-3500-45f4-9fdf-1ccce125a9f9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:02:19.340844 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.340824    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13494ff2-3500-45f4-9fdf-1ccce125a9f9-kube-api-access-hkbr9" (OuterVolumeSpecName: "kube-api-access-hkbr9") pod "13494ff2-3500-45f4-9fdf-1ccce125a9f9" (UID: "13494ff2-3500-45f4-9fdf-1ccce125a9f9"). InnerVolumeSpecName "kube-api-access-hkbr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:02:19.439447 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.439364    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13494ff2-3500-45f4-9fdf-1ccce125a9f9-maas-api-tls\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 20:02:19.439447 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.439406    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13494ff2-3500-45f4-9fdf-1ccce125a9f9-openshift-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 20:02:19.439447 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.439418    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkbr9\" (UniqueName: \"kubernetes.io/projected/13494ff2-3500-45f4-9fdf-1ccce125a9f9-kube-api-access-hkbr9\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 20:02:19.682969 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.682936    2565 generic.go:356] "Generic (PLEG): container finished" podID="13494ff2-3500-45f4-9fdf-1ccce125a9f9" containerID="ee26ed86224660578d5fc2956511f7cd93d479c7bb396f6292fe89ebf43a9b95" exitCode=0
Jul 15 20:02:19.683143 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.682974    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"
Jul 15 20:02:19.683143 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.683014    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft" event={"ID":"13494ff2-3500-45f4-9fdf-1ccce125a9f9","Type":"ContainerDied","Data":"ee26ed86224660578d5fc2956511f7cd93d479c7bb396f6292fe89ebf43a9b95"}
Jul 15 20:02:19.683143 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.683061    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft" event={"ID":"13494ff2-3500-45f4-9fdf-1ccce125a9f9","Type":"ContainerDied","Data":"9ec2ad2fa3423fa42db4ca3f10f4e3d319aa886b212f12cc65de9612b1401919"}
Jul 15 20:02:19.683143 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.683089    2565 scope.go:117] "RemoveContainer" containerID="ee26ed86224660578d5fc2956511f7cd93d479c7bb396f6292fe89ebf43a9b95"
Jul 15 20:02:19.692995 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.692976    2565 scope.go:117] "RemoveContainer" containerID="ee26ed86224660578d5fc2956511f7cd93d479c7bb396f6292fe89ebf43a9b95"
Jul 15 20:02:19.693303 ip-10-0-134-30 kubenswrapper[2565]: E0715 20:02:19.693283    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee26ed86224660578d5fc2956511f7cd93d479c7bb396f6292fe89ebf43a9b95\": container with ID starting with ee26ed86224660578d5fc2956511f7cd93d479c7bb396f6292fe89ebf43a9b95 not found: ID does not exist" containerID="ee26ed86224660578d5fc2956511f7cd93d479c7bb396f6292fe89ebf43a9b95"
Jul 15 20:02:19.693382 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.693311    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee26ed86224660578d5fc2956511f7cd93d479c7bb396f6292fe89ebf43a9b95"} err="failed to get container status \"ee26ed86224660578d5fc2956511f7cd93d479c7bb396f6292fe89ebf43a9b95\": rpc error: code = NotFound desc = could not find container \"ee26ed86224660578d5fc2956511f7cd93d479c7bb396f6292fe89ebf43a9b95\": container with ID starting with ee26ed86224660578d5fc2956511f7cd93d479c7bb396f6292fe89ebf43a9b95 not found: ID does not exist"
Jul 15 20:02:19.711391 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.711355    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"]
Jul 15 20:02:19.719356 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:19.719332    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77bf75-b47c796fb-8dcft"]
Jul 15 20:02:20.688944 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:20.688912    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13494ff2-3500-45f4-9fdf-1ccce125a9f9" path="/var/lib/kubelet/pods/13494ff2-3500-45f4-9fdf-1ccce125a9f9/volumes"
Jul 15 20:02:20.689392 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:20.689245    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6345ecac-8602-444c-8f88-b3d6c778f7d9" path="/var/lib/kubelet/pods/6345ecac-8602-444c-8f88-b3d6c778f7d9/volumes"
Jul 15 20:02:45.975779 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:45.975747    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"]
Jul 15 20:02:45.976598 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:45.975984    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx" podUID="10c59146-02aa-43bb-b5c7-f864fc27e7a8" containerName="maas-api" containerID="cri-o://1f4004edb3057abf13e29cb2a73254628351ab36e26f92b880409696477a6c43" gracePeriod=30
Jul 15 20:02:46.032344 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:46.032305    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fcd095-29735760-79txj"]
Jul 15 20:02:46.040003 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:46.039967    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-fcd095-29735760-79txj"]
Jul 15 20:02:46.461926 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:46.461880    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx" podUID="10c59146-02aa-43bb-b5c7-f864fc27e7a8" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.65:8443/health\": dial tcp 10.134.0.65:8443: connect: connection refused"
Jul 15 20:02:46.689301 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:46.689270    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2acfac54-5781-4f45-9bf2-ef4aa000ae07" path="/var/lib/kubelet/pods/2acfac54-5781-4f45-9bf2-ef4aa000ae07/volumes"
Jul 15 20:02:47.226552 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.226529    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"
Jul 15 20:02:47.302817 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.302720    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10c59146-02aa-43bb-b5c7-f864fc27e7a8-openshift-service-ca\") pod \"10c59146-02aa-43bb-b5c7-f864fc27e7a8\" (UID: \"10c59146-02aa-43bb-b5c7-f864fc27e7a8\") "
Jul 15 20:02:47.302817 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.302784    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10c59146-02aa-43bb-b5c7-f864fc27e7a8-maas-api-tls\") pod \"10c59146-02aa-43bb-b5c7-f864fc27e7a8\" (UID: \"10c59146-02aa-43bb-b5c7-f864fc27e7a8\") "
Jul 15 20:02:47.303053 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.302869    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kp96z\" (UniqueName: \"kubernetes.io/projected/10c59146-02aa-43bb-b5c7-f864fc27e7a8-kube-api-access-kp96z\") pod \"10c59146-02aa-43bb-b5c7-f864fc27e7a8\" (UID: \"10c59146-02aa-43bb-b5c7-f864fc27e7a8\") "
Jul 15 20:02:47.303236 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.303179    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10c59146-02aa-43bb-b5c7-f864fc27e7a8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "10c59146-02aa-43bb-b5c7-f864fc27e7a8" (UID: "10c59146-02aa-43bb-b5c7-f864fc27e7a8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:02:47.305010 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.304985    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10c59146-02aa-43bb-b5c7-f864fc27e7a8-kube-api-access-kp96z" (OuterVolumeSpecName: "kube-api-access-kp96z") pod "10c59146-02aa-43bb-b5c7-f864fc27e7a8" (UID: "10c59146-02aa-43bb-b5c7-f864fc27e7a8"). InnerVolumeSpecName "kube-api-access-kp96z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:02:47.305143 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.305128    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10c59146-02aa-43bb-b5c7-f864fc27e7a8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "10c59146-02aa-43bb-b5c7-f864fc27e7a8" (UID: "10c59146-02aa-43bb-b5c7-f864fc27e7a8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:02:47.403738 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.403706    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10c59146-02aa-43bb-b5c7-f864fc27e7a8-openshift-service-ca\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 20:02:47.403738 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.403735    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10c59146-02aa-43bb-b5c7-f864fc27e7a8-maas-api-tls\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 20:02:47.403738 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.403746    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp96z\" (UniqueName: \"kubernetes.io/projected/10c59146-02aa-43bb-b5c7-f864fc27e7a8-kube-api-access-kp96z\") on node \"ip-10-0-134-30.ec2.internal\" DevicePath \"\""
Jul 15 20:02:47.844747 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.844711    2565 generic.go:356] "Generic (PLEG): container finished" podID="10c59146-02aa-43bb-b5c7-f864fc27e7a8" containerID="1f4004edb3057abf13e29cb2a73254628351ab36e26f92b880409696477a6c43" exitCode=0
Jul 15 20:02:47.844959 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.844763    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"
Jul 15 20:02:47.844959 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.844799    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx" event={"ID":"10c59146-02aa-43bb-b5c7-f864fc27e7a8","Type":"ContainerDied","Data":"1f4004edb3057abf13e29cb2a73254628351ab36e26f92b880409696477a6c43"}
Jul 15 20:02:47.844959 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.844859    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx" event={"ID":"10c59146-02aa-43bb-b5c7-f864fc27e7a8","Type":"ContainerDied","Data":"8d8e62f19b6e58b9dc919fa58464f1c6171bfc77e9c5b7ef621482ffc05e03c0"}
Jul 15 20:02:47.844959 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.844892    2565 scope.go:117] "RemoveContainer" containerID="1f4004edb3057abf13e29cb2a73254628351ab36e26f92b880409696477a6c43"
Jul 15 20:02:47.855341 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.855323    2565 scope.go:117] "RemoveContainer" containerID="1f4004edb3057abf13e29cb2a73254628351ab36e26f92b880409696477a6c43"
Jul 15 20:02:47.855631 ip-10-0-134-30 kubenswrapper[2565]: E0715 20:02:47.855611    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f4004edb3057abf13e29cb2a73254628351ab36e26f92b880409696477a6c43\": container with ID starting with 1f4004edb3057abf13e29cb2a73254628351ab36e26f92b880409696477a6c43 not found: ID does not exist" containerID="1f4004edb3057abf13e29cb2a73254628351ab36e26f92b880409696477a6c43"
Jul 15 20:02:47.855708 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.855639    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f4004edb3057abf13e29cb2a73254628351ab36e26f92b880409696477a6c43"} err="failed to get container status \"1f4004edb3057abf13e29cb2a73254628351ab36e26f92b880409696477a6c43\": rpc error: code = NotFound desc = could not find container \"1f4004edb3057abf13e29cb2a73254628351ab36e26f92b880409696477a6c43\": container with ID starting with 1f4004edb3057abf13e29cb2a73254628351ab36e26f92b880409696477a6c43 not found: ID does not exist"
Jul 15 20:02:47.878601 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.878573    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"]
Jul 15 20:02:47.889340 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:47.889307    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fcd095-55fb7845cb-n7bkx"]
Jul 15 20:02:48.688784 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:02:48.688748    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10c59146-02aa-43bb-b5c7-f864fc27e7a8" path="/var/lib/kubelet/pods/10c59146-02aa-43bb-b5c7-f864fc27e7a8/volumes"
Jul 15 20:03:07.514755 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:07.514727    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65ff68966d-wgrmd_d0ceec2c-a8b5-4226-ba4a-2d9c8b7fef3c/manager/0.log"
Jul 15 20:03:08.247622 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:08.247596    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d9998b69-zljwb_07ad3215-d7e9-4d58-94de-638a382f7bf6/copy-manifests/0.log"
Jul 15 20:03:08.265625 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:08.265589    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d9998b69-zljwb_07ad3215-d7e9-4d58-94de-638a382f7bf6/manager/0.log"
Jul 15 20:03:08.642383 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:08.642351    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-745557885d-z2c22_f220d278-cec6-47c7-b45e-29449d311485/maas-api/0.log"
Jul 15 20:03:08.767904 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:08.767875    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735730-sds4k_54e13040-a0ac-4e5c-ab54-e4a4b12f75b4/cleanup/0.log"
Jul 15 20:03:08.889456 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:08.889424    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735745-m9sv2_d8bd8eba-6649-44b2-8811-78f2c91916e2/cleanup/0.log"
Jul 15 20:03:09.016768 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:09.016686    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735760-fv2qx_f42bb4b2-6589-45b9-b3b7-92b67b9869bf/cleanup/0.log"
Jul 15 20:03:09.138441 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:09.138413    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-805941a5-5vdt2_c22c3a74-a76c-444f-9465-1ae08236ca1e/revoke-keys/0.log"
Jul 15 20:03:09.266480 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:09.266451    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-e3a43be3-thnx2_5db1edfb-b666-4f3a-ac64-120ea5bd7870/revoke-keys/0.log"
Jul 15 20:03:09.500512 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:09.500484    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-58f4c5-6kp9w_4e14050b-958d-4eb5-9edf-c95d71327151/revoke-keys/0.log"
Jul 15 20:03:09.633993 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:09.633962    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-65a7a336-mz2lj_0b46f086-5ca9-41e7-87d0-1842ba1c2689/revoke-keys/0.log"
Jul 15 20:03:09.755300 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:09.755216    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-9130b1-wdzjb_aa0a1330-a7a8-4e91-8fb9-d0dd937d66c3/revoke-keys/0.log"
Jul 15 20:03:09.868476 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:09.868438    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-2908a6-b5dzb_98a72b21-131b-469a-baae-675a6da8f65e/revoke-keys/0.log"
Jul 15 20:03:09.986736 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:09.986709    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-c29a5b8d-qkz8r_55534029-a1a2-4cdb-91b5-c83fba90a1a0/revoke-keys/0.log"
Jul 15 20:03:10.103821 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:10.103796    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-3b5f1eb0-5qbdh_a70b3d17-b778-46b1-b6cd-12e9e341c6de/revoke-keys/0.log"
Jul 15 20:03:10.230926 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:10.230900    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-73d57350-vrnpz_36698776-7eac-4c31-b67c-15912ef52a67/revoke-keys/0.log"
Jul 15 20:03:10.601890 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:10.601859    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-fjb5k_e589e8a3-3c47-49b0-87da-fb0344d380ab/postgres/0.log"
Jul 15 20:03:13.706879 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:13.706849    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2h2qf_38bdfd7f-8580-495f-979c-fec93b263069/discovery/0.log"
Jul 15 20:03:14.236025 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:14.235996    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-khp7q_41208604-de23-480c-b7eb-ab8f81054d08/payload-pre-processing/0.log"
Jul 15 20:03:14.362923 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:14.362896    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-jc9j7_67f135b2-4e28-4a97-99c6-4f8cbe76cbde/payload-processing/0.log"
Jul 15 20:03:15.020994 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:15.020967    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-jhh6l_1a7eda3a-71c4-49b8-8324-90108d993732/main/0.log"
Jul 15 20:03:15.173156 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:15.173112    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-x42xq_a0f00808-f247-429c-aa5a-985c431e1572/main/0.log"
Jul 15 20:03:24.887885 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:24.887836    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kqpm4_c7a2b3c1-48cc-4e71-aa49-174dcab5b8d0/global-pull-secret-syncer/0.log"
Jul 15 20:03:25.189359 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:25.189286    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qj5fv_a7ad72a4-2fca-4e84-987b-8cd04ea99c2b/konnectivity-agent/0.log"
Jul 15 20:03:25.353944 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:25.353911    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-30.ec2.internal_9ed8bf5af08da7fafa3062ddefc6174a/haproxy/0.log"
Jul 15 20:03:32.719108 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:32.719083    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24c78229-a44a-49eb-9ebd-4a3ec843a88a/alertmanager/0.log"
Jul 15 20:03:32.758664 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:32.758633    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24c78229-a44a-49eb-9ebd-4a3ec843a88a/config-reloader/0.log"
Jul 15 20:03:32.811606 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:32.811530    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24c78229-a44a-49eb-9ebd-4a3ec843a88a/kube-rbac-proxy-web/0.log"
Jul 15 20:03:32.850196 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:32.850170    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24c78229-a44a-49eb-9ebd-4a3ec843a88a/kube-rbac-proxy/0.log"
Jul 15 20:03:32.896542 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:32.896517    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24c78229-a44a-49eb-9ebd-4a3ec843a88a/kube-rbac-proxy-metric/0.log"
Jul 15 20:03:32.941304 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:32.941281    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24c78229-a44a-49eb-9ebd-4a3ec843a88a/prom-label-proxy/0.log"
Jul 15 20:03:32.978148 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:32.978124    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_24c78229-a44a-49eb-9ebd-4a3ec843a88a/init-config-reloader/0.log"
Jul 15 20:03:33.078564 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:33.078469    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-wmb6z_77c666ab-c766-4239-90aa-f10646b718b8/kube-state-metrics/0.log"
Jul 15 20:03:33.117158 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:33.117128    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-wmb6z_77c666ab-c766-4239-90aa-f10646b718b8/kube-rbac-proxy-main/0.log"
Jul 15 20:03:33.149932 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:33.149908    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-wmb6z_77c666ab-c766-4239-90aa-f10646b718b8/kube-rbac-proxy-self/0.log"
Jul 15 20:03:33.190578 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:33.190551    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-669449d7c6-lrdrw_7c5da22f-7255-48f9-9897-20e39b4464e1/metrics-server/0.log"
Jul 15 20:03:33.249371 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:33.249349    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-lphqw_9ed2432e-1d94-48cc-8104-26f62fdf152b/monitoring-plugin/0.log"
Jul 15 20:03:33.430647 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:33.430615    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p2rnr_feb09d05-4fb6-4254-8c5e-600e9de57790/node-exporter/0.log"
Jul 15 20:03:33.466331 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:33.466304    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p2rnr_feb09d05-4fb6-4254-8c5e-600e9de57790/kube-rbac-proxy/0.log"
Jul 15 20:03:33.532344 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:33.532319    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p2rnr_feb09d05-4fb6-4254-8c5e-600e9de57790/init-textfile/0.log"
Jul 15 20:03:33.696776 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:33.696688    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-crsfn_7b1202b2-ce2c-42de-b65a-5176f5b55db6/kube-rbac-proxy-main/0.log"
Jul 15 20:03:33.753614 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:33.753588    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-crsfn_7b1202b2-ce2c-42de-b65a-5176f5b55db6/kube-rbac-proxy-self/0.log"
Jul 15 20:03:33.809914 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:33.809886    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-crsfn_7b1202b2-ce2c-42de-b65a-5176f5b55db6/openshift-state-metrics/0.log"
Jul 15 20:03:33.882279 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:33.882251    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cb784d21-0c9d-48fa-9b60-144c236e0531/prometheus/0.log"
Jul 15 20:03:33.929113 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:33.929088    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cb784d21-0c9d-48fa-9b60-144c236e0531/config-reloader/0.log"
Jul 15 20:03:33.995883 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:33.995814    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cb784d21-0c9d-48fa-9b60-144c236e0531/thanos-sidecar/0.log"
Jul 15 20:03:34.057519 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.057491    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cb784d21-0c9d-48fa-9b60-144c236e0531/kube-rbac-proxy-web/0.log"
Jul 15 20:03:34.109893 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.109873    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cb784d21-0c9d-48fa-9b60-144c236e0531/kube-rbac-proxy/0.log"
Jul 15 20:03:34.160704 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.160681    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cb784d21-0c9d-48fa-9b60-144c236e0531/kube-rbac-proxy-thanos/0.log"
Jul 15 20:03:34.204121 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.204097    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cb784d21-0c9d-48fa-9b60-144c236e0531/init-config-reloader/0.log"
Jul 15 20:03:34.251970 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.251895    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-d5ngb_a35a40d8-5a72-416e-8853-98f84d574002/prometheus-operator/0.log"
Jul 15 20:03:34.303811 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.303784    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-d5ngb_a35a40d8-5a72-416e-8853-98f84d574002/kube-rbac-proxy/0.log"
Jul 15 20:03:34.351246 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.351193    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-frx8v_2938884e-5963-4aab-b95d-078099762bd0/prometheus-operator-admission-webhook/0.log"
Jul 15 20:03:34.415412 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.415389    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84fc887489-d8mr6_3a5f8957-d340-4d8b-968d-4d076be11482/telemeter-client/0.log"
Jul 15 20:03:34.472318 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.472291    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84fc887489-d8mr6_3a5f8957-d340-4d8b-968d-4d076be11482/reload/0.log"
Jul 15 20:03:34.545548 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.545469    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84fc887489-d8mr6_3a5f8957-d340-4d8b-968d-4d076be11482/kube-rbac-proxy/0.log"
Jul 15 20:03:34.607431 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.607408    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-569d4cb59c-65njw_2929e077-432a-4052-9f8c-ac570d5ab22e/thanos-query/0.log"
Jul 15 20:03:34.655329 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.655301    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-569d4cb59c-65njw_2929e077-432a-4052-9f8c-ac570d5ab22e/kube-rbac-proxy-web/0.log"
Jul 15 20:03:34.701991 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.701960    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-569d4cb59c-65njw_2929e077-432a-4052-9f8c-ac570d5ab22e/kube-rbac-proxy/0.log"
Jul 15 20:03:34.740007 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.739977    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"]
Jul 15 20:03:34.740443 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.740430    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2acfac54-5781-4f45-9bf2-ef4aa000ae07" containerName="cleanup"
Jul 15 20:03:34.740496 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.740444    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2acfac54-5781-4f45-9bf2-ef4aa000ae07" containerName="cleanup"
Jul 15 20:03:34.740496 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.740460    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13494ff2-3500-45f4-9fdf-1ccce125a9f9" containerName="maas-api"
Jul 15 20:03:34.740496 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.740465    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="13494ff2-3500-45f4-9fdf-1ccce125a9f9" containerName="maas-api"
Jul 15 20:03:34.740496 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.740471    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10c59146-02aa-43bb-b5c7-f864fc27e7a8" containerName="maas-api"
Jul 15 20:03:34.740496 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.740476    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="10c59146-02aa-43bb-b5c7-f864fc27e7a8" containerName="maas-api"
Jul 15 20:03:34.740496 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.740483    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6345ecac-8602-444c-8f88-b3d6c778f7d9" containerName="cleanup"
Jul 15 20:03:34.740496 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.740490    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6345ecac-8602-444c-8f88-b3d6c778f7d9" containerName="cleanup"
Jul 15 20:03:34.740713 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.740502    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f42bb4b2-6589-45b9-b3b7-92b67b9869bf" containerName="cleanup"
Jul 15 20:03:34.740713 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.740507    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f42bb4b2-6589-45b9-b3b7-92b67b9869bf" containerName="cleanup"
Jul 15 20:03:34.740713 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.740570    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6345ecac-8602-444c-8f88-b3d6c778f7d9" containerName="cleanup"
Jul 15 20:03:34.740713 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.740579    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="13494ff2-3500-45f4-9fdf-1ccce125a9f9" containerName="maas-api"
Jul 15 20:03:34.740713 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.740584    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2acfac54-5781-4f45-9bf2-ef4aa000ae07" containerName="cleanup"
Jul 15 20:03:34.740713 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.740590    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f42bb4b2-6589-45b9-b3b7-92b67b9869bf" containerName="cleanup"
Jul 15 20:03:34.740713 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.740597    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="10c59146-02aa-43bb-b5c7-f864fc27e7a8" containerName="maas-api"
Jul 15 20:03:34.744131 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.744108    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:34.747349 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.747320    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g4t46\"/\"default-dockercfg-jjljq\""
Jul 15 20:03:34.747897 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.747881    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g4t46\"/\"openshift-service-ca.crt\""
Jul 15 20:03:34.748017 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.747999    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g4t46\"/\"kube-root-ca.crt\""
Jul 15 20:03:34.784615 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.784579    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"]
Jul 15 20:03:34.857175 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.857144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9b3254a1-da7c-4428-bf40-4fbbbd8ccd90-podres\") pod \"perf-node-gather-daemonset-qptdp\" (UID: \"9b3254a1-da7c-4428-bf40-4fbbbd8ccd90\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:34.857370 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.857243    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9b3254a1-da7c-4428-bf40-4fbbbd8ccd90-proc\") pod \"perf-node-gather-daemonset-qptdp\" (UID: \"9b3254a1-da7c-4428-bf40-4fbbbd8ccd90\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:34.857370 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.857335    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b3254a1-da7c-4428-bf40-4fbbbd8ccd90-lib-modules\") pod \"perf-node-gather-daemonset-qptdp\" (UID: \"9b3254a1-da7c-4428-bf40-4fbbbd8ccd90\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:34.857456 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.857404    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b3254a1-da7c-4428-bf40-4fbbbd8ccd90-sys\") pod \"perf-node-gather-daemonset-qptdp\" (UID: \"9b3254a1-da7c-4428-bf40-4fbbbd8ccd90\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:34.857501 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.857489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfmk9\" (UniqueName: \"kubernetes.io/projected/9b3254a1-da7c-4428-bf40-4fbbbd8ccd90-kube-api-access-wfmk9\") pod \"perf-node-gather-daemonset-qptdp\" (UID: \"9b3254a1-da7c-4428-bf40-4fbbbd8ccd90\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:34.858967 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.858940    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-569d4cb59c-65njw_2929e077-432a-4052-9f8c-ac570d5ab22e/prom-label-proxy/0.log"
Jul 15 20:03:34.958068 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.958039    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfmk9\" (UniqueName: \"kubernetes.io/projected/9b3254a1-da7c-4428-bf40-4fbbbd8ccd90-kube-api-access-wfmk9\") pod \"perf-node-gather-daemonset-qptdp\" (UID: \"9b3254a1-da7c-4428-bf40-4fbbbd8ccd90\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:34.958281 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.958078    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9b3254a1-da7c-4428-bf40-4fbbbd8ccd90-podres\") pod \"perf-node-gather-daemonset-qptdp\" (UID: \"9b3254a1-da7c-4428-bf40-4fbbbd8ccd90\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:34.958281 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.958093    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-569d4cb59c-65njw_2929e077-432a-4052-9f8c-ac570d5ab22e/kube-rbac-proxy-rules/0.log"
Jul 15 20:03:34.958281 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.958126    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9b3254a1-da7c-4428-bf40-4fbbbd8ccd90-proc\") pod \"perf-node-gather-daemonset-qptdp\" (UID: \"9b3254a1-da7c-4428-bf40-4fbbbd8ccd90\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:34.958281 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.958164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b3254a1-da7c-4428-bf40-4fbbbd8ccd90-lib-modules\") pod \"perf-node-gather-daemonset-qptdp\" (UID: \"9b3254a1-da7c-4428-bf40-4fbbbd8ccd90\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:34.958281 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.958194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b3254a1-da7c-4428-bf40-4fbbbd8ccd90-sys\") pod \"perf-node-gather-daemonset-qptdp\" (UID: \"9b3254a1-da7c-4428-bf40-4fbbbd8ccd90\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:34.958281 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.958244    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9b3254a1-da7c-4428-bf40-4fbbbd8ccd90-proc\") pod \"perf-node-gather-daemonset-qptdp\" (UID: \"9b3254a1-da7c-4428-bf40-4fbbbd8ccd90\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:34.958281 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.958280    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9b3254a1-da7c-4428-bf40-4fbbbd8ccd90-podres\") pod \"perf-node-gather-daemonset-qptdp\" (UID: \"9b3254a1-da7c-4428-bf40-4fbbbd8ccd90\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:34.958531 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.958288    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b3254a1-da7c-4428-bf40-4fbbbd8ccd90-sys\") pod \"perf-node-gather-daemonset-qptdp\" (UID: \"9b3254a1-da7c-4428-bf40-4fbbbd8ccd90\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:34.958531 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.958298    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b3254a1-da7c-4428-bf40-4fbbbd8ccd90-lib-modules\") pod \"perf-node-gather-daemonset-qptdp\" (UID: \"9b3254a1-da7c-4428-bf40-4fbbbd8ccd90\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:34.972490 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:34.972459    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfmk9\" (UniqueName: \"kubernetes.io/projected/9b3254a1-da7c-4428-bf40-4fbbbd8ccd90-kube-api-access-wfmk9\") pod \"perf-node-gather-daemonset-qptdp\" (UID: \"9b3254a1-da7c-4428-bf40-4fbbbd8ccd90\") " pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:35.054481 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:35.054449    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:35.094845 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:35.094817    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-569d4cb59c-65njw_2929e077-432a-4052-9f8c-ac570d5ab22e/kube-rbac-proxy-metrics/0.log"
Jul 15 20:03:35.203734 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:35.203707    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"]
Jul 15 20:03:35.206134 ip-10-0-134-30 kubenswrapper[2565]: W0715 20:03:35.206107    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9b3254a1_da7c_4428_bf40_4fbbbd8ccd90.slice/crio-786894e537b23d07bbb0ba0fd20fb84d54d48cb7e324344097b2790cdf477fc4 WatchSource:0}: Error finding container 786894e537b23d07bbb0ba0fd20fb84d54d48cb7e324344097b2790cdf477fc4: Status 404 returned error can't find the container with id 786894e537b23d07bbb0ba0fd20fb84d54d48cb7e324344097b2790cdf477fc4
Jul 15 20:03:36.123602 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:36.123563    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp" event={"ID":"9b3254a1-da7c-4428-bf40-4fbbbd8ccd90","Type":"ContainerStarted","Data":"68b53b5b14a6ae2e88e816afbd5dc311b4bd43b80cbf65ac86a32b6f4e20d333"}
Jul 15 20:03:36.124011 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:36.123612    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp" event={"ID":"9b3254a1-da7c-4428-bf40-4fbbbd8ccd90","Type":"ContainerStarted","Data":"786894e537b23d07bbb0ba0fd20fb84d54d48cb7e324344097b2790cdf477fc4"}
Jul 15 20:03:36.124011 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:36.123642    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:36.147254 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:36.147178    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp" podStartSLOduration=2.147161534 podStartE2EDuration="2.147161534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:03:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:03:36.145054669 +0000 UTC m=+2940.083093141" watchObservedRunningTime="2026-07-15 20:03:36.147161534 +0000 UTC m=+2940.085200002"
Jul 15 20:03:37.606475 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:37.606448    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-b6tsh_1220340b-be76-4b6b-a382-49ec608a1054/download-server/0.log"
Jul 15 20:03:39.801785 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:39.801757    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dsxld_5037a0cb-d1d4-414e-bbca-b8e190db70f3/dns/0.log"
Jul 15 20:03:39.849857 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:39.849832    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dsxld_5037a0cb-d1d4-414e-bbca-b8e190db70f3/kube-rbac-proxy/0.log"
Jul 15 20:03:40.009681 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:40.009653    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xkhrx_403b76f2-1f50-4cbe-8e15-2f801a1a00bf/dns-node-resolver/0.log"
Jul 15 20:03:40.845999 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:40.845967    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-85vb9_f1515c25-1fb1-42ea-87ce-26b955623a40/node-ca/0.log"
Jul 15 20:03:42.139644 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:42.139611    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g4t46/perf-node-gather-daemonset-qptdp"
Jul 15 20:03:42.275396 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:42.275361    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2h2qf_38bdfd7f-8580-495f-979c-fec93b263069/discovery/0.log"
Jul 15 20:03:42.535623 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:42.535545    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-khp7q_41208604-de23-480c-b7eb-ab8f81054d08/payload-pre-processing/0.log"
Jul 15 20:03:42.590855 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:42.590831    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-jc9j7_67f135b2-4e28-4a97-99c6-4f8cbe76cbde/payload-processing/0.log"
Jul 15 20:03:43.800835 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:43.800810    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6wddf_753cbcd0-a844-4e99-aeea-45aadbcbdc87/serve-healthcheck-canary/0.log"
Jul 15 20:03:44.870181 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:44.870145    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2h2qf_38bdfd7f-8580-495f-979c-fec93b263069/discovery/0.log"
Jul 15 20:03:44.965373 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:44.965275    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gs9w2_67800f37-87dc-468b-9e62-0f5813790484/kube-rbac-proxy/0.log"
Jul 15 20:03:45.032725 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:45.032691    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gs9w2_67800f37-87dc-468b-9e62-0f5813790484/exporter/0.log"
Jul 15 20:03:45.057730 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:45.057703    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-khp7q_41208604-de23-480c-b7eb-ab8f81054d08/payload-pre-processing/0.log"
Jul 15 20:03:45.092570 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:45.092532    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-jc9j7_67f135b2-4e28-4a97-99c6-4f8cbe76cbde/payload-processing/0.log"
Jul 15 20:03:45.095792 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:45.095770    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gs9w2_67800f37-87dc-468b-9e62-0f5813790484/extractor/0.log"
Jul 15 20:03:46.561398 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:46.561364    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2h2qf_38bdfd7f-8580-495f-979c-fec93b263069/discovery/0.log"
Jul 15 20:03:46.697722 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:46.697632    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-khp7q_41208604-de23-480c-b7eb-ab8f81054d08/payload-pre-processing/0.log"
Jul 15 20:03:46.722014 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:46.721975    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-jc9j7_67f135b2-4e28-4a97-99c6-4f8cbe76cbde/payload-processing/0.log"
Jul 15 20:03:48.140379 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:48.140345    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65ff68966d-wgrmd_d0ceec2c-a8b5-4226-ba4a-2d9c8b7fef3c/manager/0.log"
Jul 15 20:03:48.522944 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:48.522857    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d9998b69-zljwb_07ad3215-d7e9-4d58-94de-638a382f7bf6/manager/0.log"
Jul 15 20:03:48.559167 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:48.559140    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d9998b69-zljwb_07ad3215-d7e9-4d58-94de-638a382f7bf6/copy-manifests/0.log"
Jul 15 20:03:49.746215 ip-10-0-134-30 kubenswrapper[2565]: I0715 20:03:49.746181    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-756b7fb4f9-6snlr_817fce24-acdb-4f66-bdec-5f5db48cd1dd/manager/0.log"