Jul 22 03:07:42.371924 ip-10-0-128-205 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 03:07:42.914548 ip-10-0-128-205 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 03:07:42.914548 ip-10-0-128-205 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 03:07:42.914548 ip-10-0-128-205 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 03:07:42.914548 ip-10-0-128-205 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 03:07:42.914548 ip-10-0-128-205 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 03:07:42.914548 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.857993    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 03:07:42.914548 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865200    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 03:07:42.914548 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865220    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 03:07:42.914548 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865225    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 03:07:42.914548 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865229    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 03:07:42.914548 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865233    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 03:07:42.914548 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865236    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 03:07:42.914548 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865240    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 03:07:42.914548 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865243    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 03:07:42.914548 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865247    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865250    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865253    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865258    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865263    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865267    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865270    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865273    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865277    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865280    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865284    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865287    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865289    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865293    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865297    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865301    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865305    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865308    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865311    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 03:07:42.915669 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865315    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865320    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865324    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865328    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865331    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865333    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865337    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865341    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865344    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865347    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865350    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865352    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865355    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865358    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865361    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865364    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865367    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865370    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865373    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 03:07:42.916318 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865376    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865378    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865382    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865385    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865388    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865391    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865393    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865396    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865399    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865402    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865405    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865408    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865411    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865414    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865418    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865421    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865424    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865426    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865429    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865432    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 03:07:42.917010 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865435    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865437    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865440    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865443    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865446    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865448    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865451    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865455    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865458    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865463    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865467    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865470    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865473    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865476    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865479    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865481    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865484    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865487    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865490    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 03:07:42.917930 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865492    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865495    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865498    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865501    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865504    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865507    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865509    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865512    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865515    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865518    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865520    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865523    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865526    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.865528    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866358    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866365    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866369    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866372    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866376    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866379    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 03:07:42.918648 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866383    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866387    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866389    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866392    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866395    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866398    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866401    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866404    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866407    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866410    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866413    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866416    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866420    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866422    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866427    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866429    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866432    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866437    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866442    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866445    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 03:07:42.919343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866448    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866451    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866454    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866457    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866460    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866463    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866466    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866469    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866472    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866475    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866477    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866480    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866484    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866487    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866489    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866492    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866495    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866498    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866501    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866504    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 03:07:42.922369 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866506    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866509    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866513    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866516    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866518    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866521    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866524    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866526    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866529    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866532    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866535    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866538    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866541    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866544    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866547    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866551    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866555    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866558    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866561    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866564    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 03:07:42.923056 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866568    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866571    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866574    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866577    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866580    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866583    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866586    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866589    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866591    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866594    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866597    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866599    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866604    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866607    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866611    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866614    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866617    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866619    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866622    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 03:07:42.924192 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866624    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866627    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866647    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866650    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866654    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866658    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866661    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866665    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866667    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866670    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866673    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866676    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866679    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.866682    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867137    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867143    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867146    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867149    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867153    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867156    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 03:07:42.924880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867159    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867162    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867165    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867168    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867171    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867174    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867177    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867179    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867182    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867185    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867187    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867190    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867193    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867197    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867199    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867202    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867205    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867208    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867211    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867214    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 03:07:42.926021 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867218    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867224    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867228    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867232    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867235    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867240    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867244    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867248    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867251    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867254    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867257    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867261    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867264    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867267    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867270    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867273    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867276    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867279    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867281    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 03:07:42.926940 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867284    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867287    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867290    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867292    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867296    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867300    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867303    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867306    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867309    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867312    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867316    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867318    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867321    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867324    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867328    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867333    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867336    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867340    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867343    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 03:07:42.931555 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867346    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867349    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867352    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867355    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867358    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867361    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867364    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867367    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867370    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867373    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867375    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867378    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867381    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867384    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867387    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867389    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867392    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867395    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867401    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867404    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 03:07:42.932278 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867407    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867409    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867413    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867416    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867419    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867421    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867424    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867428    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867431    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867434    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867436    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867439    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867442    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867445    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.867447    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867542    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867550    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867557    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867562    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867568    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867572    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 03:07:42.933410 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867577    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867582    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867585    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867588    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867592    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867596    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867599    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867603    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867606    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867613    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867616    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867619    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867625    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867628    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867648    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867651    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867655    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867660    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867665    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867668    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867672    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867676    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867679    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867682    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 03:07:42.934114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867686    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867689    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867693    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867696    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867699    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867703    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867706    2565 flags.go:64] FLAG: --enable-server="true"
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867710    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867715    2565 flags.go:64] FLAG: --event-burst="100"
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867718    2565 flags.go:64] FLAG: --event-qps="50"
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867721    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867724    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867728    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867732    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867735    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867739    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867742    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867746    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867750    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867754    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867757    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867760    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867763    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867766    2565 flags.go:64] FLAG: --feature-gates=""
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867770    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 03:07:42.935254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867774    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867780    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867784    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867787    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867791    2565 flags.go:64] FLAG: --help="false"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867794    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867797    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867800    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867804    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867807    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867811    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867815    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867818    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867821    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867824    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867828    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867831    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867834    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867837    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867840    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867844    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867847    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867849    2565 flags.go:64] FLAG: --lock-file=""
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867852    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 03:07:43.038352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867857    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 03:07:42.984215 ip-10-0-128-205 systemd[1]: Started Kubernetes Kubelet.
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867860    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867866    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867869    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867872    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867875    2565 flags.go:64] FLAG: --logging-format="text"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867878    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867882    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867885    2565 flags.go:64] FLAG: --manifest-url=""
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867890    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867894    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867898    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867902    2565 flags.go:64] FLAG: --max-pods="110"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867905    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867909    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867912    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867915    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867918    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867921    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867925    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867933    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867936    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867939    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 03:07:43.039407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867943    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867946    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867953    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867956    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867959    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867962    2565 flags.go:64] FLAG: --port="10250"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867966    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867969    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09f70f5c793157e27"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867972    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867975    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867980    2565 flags.go:64] FLAG: --register-node="true"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867983    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867987    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867990    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867993    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.867996    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868000    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868003    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868008    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868011    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868014    2565 flags.go:64] FLAG: --runonce="false"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868017    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868021    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868024    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868027    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 03:07:43.040589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868030    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868034    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868037    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868040    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868043    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868046    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868049    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868052    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868055    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868059    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868062    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868068    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868071    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868074    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868079    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868082    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868085    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868089    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868092    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868095    2565 flags.go:64] FLAG: --v="2"
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868100    2565 flags.go:64] FLAG: --version="false"
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868105    2565 flags.go:64] FLAG: --vmodule=""
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868109    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.868113    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868243    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 03:07:43.042469 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868248    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868252    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868255    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868258    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868261    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868264    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868267    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868271    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868274    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868277    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868280    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868283    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868286    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868289    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868292    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868294    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868297    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868301    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868303    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868306    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 03:07:43.043880 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868309    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868312    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868315    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868317    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868322    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868324    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868327    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868330    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868333    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868335    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868338    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868341    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868345    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868348    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868351    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868353    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868356    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868359    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868363    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868367    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 03:07:43.044980 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868370    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868373    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868375    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868379    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868381    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868384    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868387    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868389    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868392    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868395    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868398    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868400    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868403    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868406    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868409    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868412    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868415    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868418    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868421    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868424    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 03:07:43.047235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868427    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868429    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868432    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868435    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868439    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868441    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868444    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868447    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868450    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868452    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868455    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868458    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868462    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868465    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868469    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868472    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868475    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868478    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868482    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 03:07:43.048098 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868485    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 03:07:43.049670 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868488    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 03:07:43.049670 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868491    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 03:07:43.049670 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868493    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 03:07:43.049670 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868497    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 03:07:43.049670 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868499    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 03:07:43.049670 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868502    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 03:07:43.049670 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868505    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 03:07:43.049670 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868508    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 03:07:43.049670 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868512    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 03:07:43.049670 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868515    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 03:07:43.049670 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868517    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 03:07:43.049670 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868522    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 03:07:43.049670 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868525    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 03:07:43.049670 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868528    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 03:07:43.049670 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868531    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 03:07:43.049670 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868534    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 03:07:43.049670 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868538    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 03:07:43.049670 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.868541    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 03:07:43.050350 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.869518    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 03:07:43.050350 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.877197    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 03:07:43.050350 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.877222    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 03:07:43.050350 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.883898    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 03:07:43.050350 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.883917    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 03:07:43.050350 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884000    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 03:07:43.050350 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884010    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 03:07:43.050350 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884014    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 03:07:43.050350 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884018    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 03:07:43.050350 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884022    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 03:07:43.050350 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884025    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 03:07:43.050350 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884028    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 03:07:43.050350 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884032    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 03:07:43.050350 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884035    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884038    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884041    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884045    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884049    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884053    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884056    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884059    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884063    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884066    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884069    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884073    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884075    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884078    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884081    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884084    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884087    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884090    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884093    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884096    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 03:07:43.050986 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884098    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884103    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884106    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884109    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884112    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884114    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884117    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884120    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884122    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884125    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884128    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884130    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884133    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884136    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884139    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884142    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884144    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884147    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884150    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884157    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 03:07:43.051763 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884160    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884163    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884166    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884169    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884171    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884174    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884177    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884181    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884183    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884186    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884189    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884192    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884195    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884197    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884201    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884204    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884207    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884209    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884213    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884216    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 03:07:43.052345 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884218    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884221    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884224    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884227    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884230    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884232    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884235    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884238    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884240    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884244    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884248    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884253    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884256    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884259    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884262    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884264    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884268    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884271    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884273    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 03:07:43.053271 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884278    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 03:07:43.053947 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884281    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 03:07:43.053947 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884284    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 03:07:43.053947 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884286    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 03:07:43.053947 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884289    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 03:07:43.053947 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884292    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 03:07:43.053947 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884295    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 03:07:43.053947 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884298    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 03:07:43.053947 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884301    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 03:07:43.053947 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884304    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 03:07:43.053947 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884307    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 03:07:43.053947 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884309    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 03:07:43.053947 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.884316    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 03:07:43.053947 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884454    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 03:07:43.053947 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884460    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 03:07:43.053947 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884463    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884466    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884469    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884472    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884475    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884478    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884480    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884483    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884486    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884490    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884493    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884495    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884498    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884501    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884504    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884507    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884509    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884512    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884516    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884519    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 03:07:43.054652 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884522    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884525    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884528    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884530    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884533    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884536    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884539    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884542    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884545    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884547    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884550    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884553    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884556    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884558    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884561    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884564    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884567    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884571    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884575    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884578    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 03:07:43.055268 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884581    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884586    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884589    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884592    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884596    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884599    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884602    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884605    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884609    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884632    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884639    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884645    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884649    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884653    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884656    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884659    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884661    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884664    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884667    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884671    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 03:07:43.055925 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884674    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884677    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884680    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884682    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884685    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884688    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884690    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884693    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884696    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884699    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884702    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884704    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884707    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884713    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884716    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884718    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884721    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884724    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884726    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884729    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 03:07:43.056590 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884732    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 03:07:43.057243 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884734    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 03:07:43.057243 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884739    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 03:07:43.057243 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884742    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 03:07:43.057243 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884744    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 03:07:43.057243 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884747    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 03:07:43.057243 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884750    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 03:07:43.057243 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884753    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 03:07:43.057243 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884755    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 03:07:43.057243 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884758    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 03:07:43.057243 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884761    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 03:07:43.057243 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884764    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 03:07:43.057243 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884767    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 03:07:43.057243 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884772    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 03:07:43.057243 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884775    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 03:07:43.057243 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884779    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 03:07:43.057243 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:42.884782    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 03:07:43.057753 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.884787    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 03:07:43.057753 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.884955    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 03:07:43.057753 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.887321    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 03:07:43.057753 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.888775    2565 server.go:1019] "Starting client certificate rotation"
Jul 22 03:07:43.057753 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.888887    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 03:07:43.057753 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.888970    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 03:07:43.057753 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.893781    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 03:07:43.057753 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.902396    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 03:07:43.057753 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.914505    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 22 03:07:43.057753 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.942367    2565 log.go:25] "Validated CRI v1 image API"
Jul 22 03:07:43.057753 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.944243    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 03:07:43.057753 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.948860    2565 fs.go:135] Filesystem UUIDs: map[24d7fae5-3e97-40d9-986c-852e2b285fc4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e155cc70-9210-4b8c-92f8-21a72f504b94:/dev/nvme0n1p4]
Jul 22 03:07:43.058179 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.948887    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 03:07:43.058370 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.955307    2565 manager.go:216] Machine: {Timestamp:2026-07-22 03:07:42.953449429 +0000 UTC m=+0.414999828 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098851 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bbe386c5f022f8431b690f8e3c076 SystemUUID:ec2bbe38-6c5f-022f-8431-b690f8e3c076 BootID:3683ce7e-5e42-414b-8853-816f97102122 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b7:2c:45:34:c9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b7:2c:45:34:c9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:20:4c:98:66:a9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 03:07:43.058370 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.955434    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 03:07:43.058370 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.955573    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 03:07:43.058370 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.959132    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 03:07:43.058370 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.959170    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-205.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 03:07:43.058370 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.960040    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 03:07:43.058370 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.960051    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 03:07:43.058370 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.960060    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.960796    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.962279    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.965556    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.966165    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.966299    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.966329    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.966343    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.966359    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.966368    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.966379    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.966743    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.966760    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.969285    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.972432    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.972467    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.973813    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.973828    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.973835    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.973841    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.973851    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.973871    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.973880    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.973887    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.973894    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.973900    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.973914    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.973919    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.974806    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.974821    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:42.978665    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.978707    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-205.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.978750    2565 server.go:1268] "Started kubelet"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.983233    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.983343    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:42.983837    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.984049    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.988145    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.988396    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fcsc9"
Jul 22 03:07:43.058736 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:42.988829    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:42.996543    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-205.ec2.internal.18c47dcaf4288a45  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-205.ec2.internal,UID:ip-10-0-128-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-205.ec2.internal,},FirstTimestamp:2026-07-22 03:07:42.978722373 +0000 UTC m=+0.440272775,LastTimestamp:2026-07-22 03:07:42.978722373 +0000 UTC m=+0.440272775,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-205.ec2.internal,}"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:42.999661    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.000663    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.000730    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:43.000753    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.001471    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.001502    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.001514    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.001642    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.001651    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.001887    2565 factory.go:55] Registering systemd factory
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.001921    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.002193    2565 factory.go:153] Registering CRI-O factory
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.002206    2565 factory.go:223] Registration of the crio container factory successfully
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.002255    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.002277    2565 factory.go:103] Registering Raw factory
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.002290    2565 manager.go:1196] Started watching for new ooms in manager
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.002671    2565 manager.go:349] Starting recovery of all containers
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.003669    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fcsc9"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.009200    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.010417    2565 manager.go:354] Recovery completed
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.016188    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.018435    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.018468    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.018482    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.019042    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.019055    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.019063    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.019077    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.019882    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.019913    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.019928    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.021804    2565 policy_none.go:49] "None policy: Start"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.021820    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.021831    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.023014    2565 policy_none.go:47] "Start"
Jul 22 03:07:43.197714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.028066    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 03:07:43.216922 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:43.031432    2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-205.ec2.internal\" not found" node="ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.216922 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.067701    2565 manager.go:337] "Starting Device Plugin manager"
Jul 22 03:07:43.216922 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:43.067750    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 03:07:43.216922 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.067763    2565 server.go:87] "Starting device plugin registration server"
Jul 22 03:07:43.216922 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.068172    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 03:07:43.216922 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.068186    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 03:07:43.216922 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.068311    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 03:07:43.216922 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.068423    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 03:07:43.216922 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.068445    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 03:07:43.216922 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:43.071045    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 03:07:43.216922 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:43.071111    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 22 03:07:43.216922 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.170306    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:07:43.216922 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.171453    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:07:43.216922 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.171484    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:07:43.216922 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.171496    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:07:43.216922 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.171524    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.216922 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.186093    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.216922 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:43.186120    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-205.ec2.internal\": node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 22 03:07:43.223530 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:43.223319    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.237779    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.237833    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.237858    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:43.237893    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.240872    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:43.324153    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.338346    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal"]
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.338453    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.340772    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.340806    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.340824    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.342762    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.342891    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.342931    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.343659    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.343687    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.343706    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.343659    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.343746    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.343759    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.345262    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.345287    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.346033    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.346067    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:07:43.370538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.346078    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:07:43.508688 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:43.380709    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-205.ec2.internal\" not found" node="ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.508688 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:43.385687    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-205.ec2.internal\" not found" node="ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.508688 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.403989    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4e0d70cfb1676971a8271ab86129053d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal\" (UID: \"4e0d70cfb1676971a8271ab86129053d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.508688 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.404028    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e0d70cfb1676971a8271ab86129053d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal\" (UID: \"4e0d70cfb1676971a8271ab86129053d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.508688 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.404055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/88f274895667f5ef1e2f7c5805ba677d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-205.ec2.internal\" (UID: \"88f274895667f5ef1e2f7c5805ba677d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.508688 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:43.425391    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 22 03:07:43.508688 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.504309    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4e0d70cfb1676971a8271ab86129053d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal\" (UID: \"4e0d70cfb1676971a8271ab86129053d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.508688 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.504340    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e0d70cfb1676971a8271ab86129053d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal\" (UID: \"4e0d70cfb1676971a8271ab86129053d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.508688 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.504360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/88f274895667f5ef1e2f7c5805ba677d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-205.ec2.internal\" (UID: \"88f274895667f5ef1e2f7c5805ba677d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.508688 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.504412    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e0d70cfb1676971a8271ab86129053d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal\" (UID: \"4e0d70cfb1676971a8271ab86129053d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.508688 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.504427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4e0d70cfb1676971a8271ab86129053d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal\" (UID: \"4e0d70cfb1676971a8271ab86129053d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.508688 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.504458    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/88f274895667f5ef1e2f7c5805ba677d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-205.ec2.internal\" (UID: \"88f274895667f5ef1e2f7c5805ba677d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.664892 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:43.527140    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 22 03:07:43.664892 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:43.628854    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 22 03:07:43.810513 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.684531    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.810513 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.695111    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal"
Jul 22 03:07:43.810513 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:43.729614    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 22 03:07:43.950474 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:43.831248    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 22 03:07:43.950474 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.891241    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 03:07:43.950474 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.891473    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 03:07:43.950474 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:43.891484    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 03:07:43.950474 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:43.932990    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-205.ec2.internal\" not found"
Jul 22 03:07:44.096178 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.012925    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 03:02:43 +0000 UTC" deadline="2027-12-18 22:44:27.475373538 +0000 UTC"
Jul 22 03:07:44.096178 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.012982    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12355h36m43.462396233s"
Jul 22 03:07:44.096178 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.026465    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 03:07:44.242960 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.103667    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal"
Jul 22 03:07:44.242960 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.115070    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 03:07:44.242960 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.120176    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal"
Jul 22 03:07:44.242960 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.136847    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 03:07:44.449709 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.449673    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 03:07:44.598215 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:44.598156    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f274895667f5ef1e2f7c5805ba677d.slice/crio-a632e7e0e681f3d377903c590187b2f09e4dee53500ef682173d730ed277c225 WatchSource:0}: Error finding container a632e7e0e681f3d377903c590187b2f09e4dee53500ef682173d730ed277c225: Status 404 returned error can't find the container with id a632e7e0e681f3d377903c590187b2f09e4dee53500ef682173d730ed277c225
Jul 22 03:07:44.598479 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:44.598453    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e0d70cfb1676971a8271ab86129053d.slice/crio-76114170eec7e265e72c15bfdeabe404dbf0ddd7967d5169689ddd07ca819dce WatchSource:0}: Error finding container 76114170eec7e265e72c15bfdeabe404dbf0ddd7967d5169689ddd07ca819dce: Status 404 returned error can't find the container with id 76114170eec7e265e72c15bfdeabe404dbf0ddd7967d5169689ddd07ca819dce
Jul 22 03:07:44.603218 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.603200    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:07:44.861214 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.861127    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 03:07:44.929374 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.929336    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 03:07:44.969067 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.969029    2565 apiserver.go:52] "Watching apiserver"
Jul 22 03:07:44.975844 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.975821    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 03:07:44.977832 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.977804    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-hz6gj","openshift-ovn-kubernetes/ovnkube-node-wl9bk","kube-system/konnectivity-agent-lm5vf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp","openshift-cluster-node-tuning-operator/tuned-wfdf7","openshift-dns/node-resolver-rnn7l","openshift-image-registry/node-ca-lptm9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal","openshift-multus/multus-additional-cni-plugins-d64cf","openshift-multus/multus-cjt4l","kube-system/global-pull-secret-syncer-x8mph","kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal","openshift-multus/network-metrics-daemon-pnq86","openshift-network-diagnostics/network-check-target-jhwrs"]
Jul 22 03:07:44.980382 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.980361    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lptm9"
Jul 22 03:07:44.982278 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.982254    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:07:44.982371 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:44.982346    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnq86" podUID="8e82838b-2f39-4a24-9b24-455344248ad3"
Jul 22 03:07:44.983520 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.983501    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lm5vf"
Jul 22 03:07:44.984924 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.984904    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:44.986344 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.986323    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:44.988008 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.987793    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rnn7l"
Jul 22 03:07:44.989287 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.989264    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:44.990740 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.990720    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hz6gj"
Jul 22 03:07:44.992277 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.992258    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:44.993797 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.993780    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:44.995305 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.995284    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:44.995433 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:44.995389    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x8mph" podUID="2e2a9ce4-415f-4f0e-b878-a19f08496cb9"
Jul 22 03:07:44.996872 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.996853    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:07:44.996967 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:44.996922    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwrs" podUID="14410091-686c-48cd-8c74-acacf64654a8"
Jul 22 03:07:44.997454 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.997435    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 03:07:44.997571 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:44.997553    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gwx5k\""
Jul 22 03:07:45.001242 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.001225    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 03:07:45.001474 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.001453    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 03:07:45.001571 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.001453    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 03:07:45.001685 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.001666    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v2wvj\""
Jul 22 03:07:45.003028 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.002761    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 03:07:45.004338 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.004314    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 03:07:45.004489 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.004392    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 03:07:45.004489 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.004412    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 03:07:45.004619 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.004583    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 03:07:45.004619 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.004614    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 03:07:45.004739 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.004618    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 03:07:45.005095 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.004928    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 03:07:45.005095 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.004968    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 03:07:45.005095 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.005053    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 03:07:45.005258 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.005235    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 03:07:45.006125 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.005397    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 03:07:45.006125 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.005476    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 03:07:45.006125 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.005553    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 03:07:45.006125 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.005658    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 03:07:45.006125 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.005748    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 03:07:45.006125 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.005926    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n27g6\""
Jul 22 03:07:45.006125 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.005996    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 03:07:45.006125 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.005996    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f2gv4\""
Jul 22 03:07:45.007100 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.006866    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l6phf\""
Jul 22 03:07:45.007100 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.006879    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 03:07:45.007100 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.007018    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-864pd\""
Jul 22 03:07:45.007257 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.007124    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 03:07:45.007257 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.007156    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 03:07:45.007360 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.007325    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ft5h7\""
Jul 22 03:07:45.007439 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.007410    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 03:07:45.007439 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.007429    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 03:07:45.007537 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.007522    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 03:07:45.008172 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.008146    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qc4g7\""
Jul 22 03:07:45.008321 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.008291    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 03:07:45.008321 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.008315    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-n49s5\""
Jul 22 03:07:45.013083 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013057    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1c64ef25-ed44-4731-8c1d-fba203cee498-hosts-file\") pod \"node-resolver-rnn7l\" (UID: \"1c64ef25-ed44-4731-8c1d-fba203cee498\") " pod="openshift-dns/node-resolver-rnn7l"
Jul 22 03:07:45.013184 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013098    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-systemd-units\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.013184 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013127    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-slash\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.013184 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013153    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs\") pod \"network-metrics-daemon-pnq86\" (UID: \"8e82838b-2f39-4a24-9b24-455344248ad3\") " pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:07:45.013299 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013215    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-var-lib-kubelet\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.013299 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013242    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8dc80ec4-2110-496c-a4b4-9c47947bca8c-socket-dir\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.013299 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-cni-bin\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.013431 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013300    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.013431 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013324    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-host-var-lib-kubelet\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.013431 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013343    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-etc-modprobe-d\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.013431 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-lib-modules\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.013431 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5fb16bbd-19c6-403c-8298-4f217dda4b19-os-release\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.013431 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8dc80ec4-2110-496c-a4b4-9c47947bca8c-registration-dir\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.013678 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-cni-netd\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.013678 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-system-cni-dir\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.013678 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013525    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-multus-socket-dir-parent\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.013678 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013547    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-sys\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.013678 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013569    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-host\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.013678 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fb16bbd-19c6-403c-8298-4f217dda4b19-system-cni-dir\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.013678 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8dc80ec4-2110-496c-a4b4-9c47947bca8c-sys-fs\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.014056 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013698    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-cnibin\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.014056 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013727    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-etc-sysconfig\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.014056 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013752    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-etc-kubernetes\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.014056 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013776    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5fb16bbd-19c6-403c-8298-4f217dda4b19-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.014056 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013853    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d7lt\" (UniqueName: \"kubernetes.io/projected/5fb16bbd-19c6-403c-8298-4f217dda4b19-kube-api-access-4d7lt\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.014056 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-host-var-lib-cni-bin\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.014056 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-multus-conf-dir\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.014056 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.013981    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr7qz\" (UniqueName: \"kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz\") pod \"network-check-target-jhwrs\" (UID: \"14410091-686c-48cd-8c74-acacf64654a8\") " pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:07:45.014056 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014009    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-etc-systemd\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.014517 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014065    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw6rx\" (UniqueName: \"kubernetes.io/projected/1c64ef25-ed44-4731-8c1d-fba203cee498-kube-api-access-tw6rx\") pod \"node-resolver-rnn7l\" (UID: \"1c64ef25-ed44-4731-8c1d-fba203cee498\") " pod="openshift-dns/node-resolver-rnn7l"
Jul 22 03:07:45.014517 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5fb16bbd-19c6-403c-8298-4f217dda4b19-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.014517 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-run-systemd\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.014517 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-host-run-netns\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.014517 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014197    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret\") pod \"global-pull-secret-syncer-x8mph\" (UID: \"2e2a9ce4-415f-4f0e-b878-a19f08496cb9\") " pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:45.014517 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014223    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-etc-sysctl-d\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.014517 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014264    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c64ef25-ed44-4731-8c1d-fba203cee498-tmp-dir\") pod \"node-resolver-rnn7l\" (UID: \"1c64ef25-ed44-4731-8c1d-fba203cee498\") " pod="openshift-dns/node-resolver-rnn7l"
Jul 22 03:07:45.014517 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fb16bbd-19c6-403c-8298-4f217dda4b19-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.014517 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014315    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed-iptables-alerter-script\") pod \"iptables-alerter-hz6gj\" (UID: \"da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed\") " pod="openshift-network-operator/iptables-alerter-hz6gj"
Jul 22 03:07:45.014517 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014340    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-log-socket\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.014517 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/18b30cc6-991b-4450-930e-23189b47e0bc-ovnkube-config\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.014517 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/18b30cc6-991b-4450-930e-23189b47e0bc-ovnkube-script-lib\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.014517 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014485    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-host-var-lib-cni-multus\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.015142 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8dc80ec4-2110-496c-a4b4-9c47947bca8c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.015142 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014540    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7plw\" (UniqueName: \"kubernetes.io/projected/18b30cc6-991b-4450-930e-23189b47e0bc-kube-api-access-v7plw\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.015142 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014568    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-os-release\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.015142 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-host-run-multus-certs\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.015142 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014702    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4c74ab3-d9f1-4901-932f-841e01504f79-host\") pod \"node-ca-lptm9\" (UID: \"a4c74ab3-d9f1-4901-932f-841e01504f79\") " pod="openshift-image-registry/node-ca-lptm9"
Jul 22 03:07:45.015142 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014759    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4d6d9fc-050a-472c-8189-78067e8fd96c-agent-certs\") pod \"konnectivity-agent-lm5vf\" (UID: \"f4d6d9fc-050a-472c-8189-78067e8fd96c\") " pod="kube-system/konnectivity-agent-lm5vf"
Jul 22 03:07:45.015142 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014792    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/565506ac-b6f1-4776-97cd-65ff7a606674-tmp\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.015142 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014831    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fb16bbd-19c6-403c-8298-4f217dda4b19-cni-binary-copy\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.015142 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.014858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-kubelet\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.015619 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015248    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/18b30cc6-991b-4450-930e-23189b47e0bc-ovn-node-metrics-cert\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.015619 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015300    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed-host-slash\") pod \"iptables-alerter-hz6gj\" (UID: \"da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed\") " pod="openshift-network-operator/iptables-alerter-hz6gj"
Jul 22 03:07:45.015619 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5g9x\" (UniqueName: \"kubernetes.io/projected/a4c74ab3-d9f1-4901-932f-841e01504f79-kube-api-access-p5g9x\") pod \"node-ca-lptm9\" (UID: \"a4c74ab3-d9f1-4901-932f-841e01504f79\") " pod="openshift-image-registry/node-ca-lptm9"
Jul 22 03:07:45.015619 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/565506ac-b6f1-4776-97cd-65ff7a606674-etc-tuned\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.015619 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015430    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8dc80ec4-2110-496c-a4b4-9c47947bca8c-device-dir\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.015619 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015468    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8dc80ec4-2110-496c-a4b4-9c47947bca8c-etc-selinux\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.015619 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-etc-openvswitch\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.015619 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015530    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-etc-kubernetes\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.015619 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015553    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4d6d9fc-050a-472c-8189-78067e8fd96c-konnectivity-ca\") pod \"konnectivity-agent-lm5vf\" (UID: \"f4d6d9fc-050a-472c-8189-78067e8fd96c\") " pod="kube-system/konnectivity-agent-lm5vf"
Jul 22 03:07:45.015619 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015604    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-run-netns\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.016033 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015655    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.016033 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015682    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f6827cb-5a20-4701-b53b-93bebefd8994-cni-binary-copy\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.016033 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015708    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-host-run-k8s-cni-cncf-io\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.016033 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-hostroot\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.016033 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015761    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spn87\" (UniqueName: \"kubernetes.io/projected/8e82838b-2f39-4a24-9b24-455344248ad3-kube-api-access-spn87\") pod \"network-metrics-daemon-pnq86\" (UID: \"8e82838b-2f39-4a24-9b24-455344248ad3\") " pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:07:45.016033 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/18b30cc6-991b-4450-930e-23189b47e0bc-env-overrides\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.016033 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015829    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f6827cb-5a20-4701-b53b-93bebefd8994-multus-daemon-config\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.016033 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015861    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9qjz\" (UniqueName: \"kubernetes.io/projected/5f6827cb-5a20-4701-b53b-93bebefd8994-kube-api-access-j9qjz\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.016033 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-kubelet-config\") pod \"global-pull-secret-syncer-x8mph\" (UID: \"2e2a9ce4-415f-4f0e-b878-a19f08496cb9\") " pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:45.016033 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4c74ab3-d9f1-4901-932f-841e01504f79-serviceca\") pod \"node-ca-lptm9\" (UID: \"a4c74ab3-d9f1-4901-932f-841e01504f79\") " pod="openshift-image-registry/node-ca-lptm9"
Jul 22 03:07:45.016033 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015932    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx9lg\" (UniqueName: \"kubernetes.io/projected/da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed-kube-api-access-dx9lg\") pod \"iptables-alerter-hz6gj\" (UID: \"da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed\") " pod="openshift-network-operator/iptables-alerter-hz6gj"
Jul 22 03:07:45.016033 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-node-log\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.016033 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015976    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-multus-cni-dir\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.016033 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.015999    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-etc-sysctl-conf\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.016576 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.016023    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh4zv\" (UniqueName: \"kubernetes.io/projected/565506ac-b6f1-4776-97cd-65ff7a606674-kube-api-access-qh4zv\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.016576 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.016047    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fb16bbd-19c6-403c-8298-4f217dda4b19-cnibin\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.016576 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.016071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-run-openvswitch\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.016576 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.016093    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-dbus\") pod \"global-pull-secret-syncer-x8mph\" (UID: \"2e2a9ce4-415f-4f0e-b878-a19f08496cb9\") " pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:45.016576 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.016129    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-run\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.016576 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.016161    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s5wg\" (UniqueName: \"kubernetes.io/projected/8dc80ec4-2110-496c-a4b4-9c47947bca8c-kube-api-access-2s5wg\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.016576 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.016187    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-var-lib-openvswitch\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.016576 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.016202    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-run-ovn\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.022059 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.022035    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 03:07:45.032949 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.032917    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 03:07:45.116649 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.116544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/565506ac-b6f1-4776-97cd-65ff7a606674-tmp\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.116649 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.116609    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fb16bbd-19c6-403c-8298-4f217dda4b19-cni-binary-copy\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.116649 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.116638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-kubelet\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.116951 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.116663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/18b30cc6-991b-4450-930e-23189b47e0bc-ovn-node-metrics-cert\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.116951 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.116690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed-host-slash\") pod \"iptables-alerter-hz6gj\" (UID: \"da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed\") " pod="openshift-network-operator/iptables-alerter-hz6gj"
Jul 22 03:07:45.116951 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.116717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5g9x\" (UniqueName: \"kubernetes.io/projected/a4c74ab3-d9f1-4901-932f-841e01504f79-kube-api-access-p5g9x\") pod \"node-ca-lptm9\" (UID: \"a4c74ab3-d9f1-4901-932f-841e01504f79\") " pod="openshift-image-registry/node-ca-lptm9"
Jul 22 03:07:45.116951 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.116741    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/565506ac-b6f1-4776-97cd-65ff7a606674-etc-tuned\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.116951 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.116764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8dc80ec4-2110-496c-a4b4-9c47947bca8c-device-dir\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.116951 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.116792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8dc80ec4-2110-496c-a4b4-9c47947bca8c-etc-selinux\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.116951 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.116818    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-etc-openvswitch\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.116951 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.116891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-etc-kubernetes\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.116951 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.116918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4d6d9fc-050a-472c-8189-78067e8fd96c-konnectivity-ca\") pod \"konnectivity-agent-lm5vf\" (UID: \"f4d6d9fc-050a-472c-8189-78067e8fd96c\") " pod="kube-system/konnectivity-agent-lm5vf"
Jul 22 03:07:45.116951 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.116942    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-run-netns\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.117470 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.116966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.117470 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.116991    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f6827cb-5a20-4701-b53b-93bebefd8994-cni-binary-copy\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.117470 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-host-run-k8s-cni-cncf-io\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.117470 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-hostroot\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.117470 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117078    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spn87\" (UniqueName: \"kubernetes.io/projected/8e82838b-2f39-4a24-9b24-455344248ad3-kube-api-access-spn87\") pod \"network-metrics-daemon-pnq86\" (UID: \"8e82838b-2f39-4a24-9b24-455344248ad3\") " pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:07:45.117470 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/18b30cc6-991b-4450-930e-23189b47e0bc-env-overrides\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.117470 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117114    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8dc80ec4-2110-496c-a4b4-9c47947bca8c-device-dir\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.117470 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117150    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f6827cb-5a20-4701-b53b-93bebefd8994-multus-daemon-config\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.117470 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9qjz\" (UniqueName: \"kubernetes.io/projected/5f6827cb-5a20-4701-b53b-93bebefd8994-kube-api-access-j9qjz\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.117470 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117197    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-kubelet-config\") pod \"global-pull-secret-syncer-x8mph\" (UID: \"2e2a9ce4-415f-4f0e-b878-a19f08496cb9\") " pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:45.117470 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4c74ab3-d9f1-4901-932f-841e01504f79-serviceca\") pod \"node-ca-lptm9\" (UID: \"a4c74ab3-d9f1-4901-932f-841e01504f79\") " pod="openshift-image-registry/node-ca-lptm9"
Jul 22 03:07:45.117470 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx9lg\" (UniqueName: \"kubernetes.io/projected/da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed-kube-api-access-dx9lg\") pod \"iptables-alerter-hz6gj\" (UID: \"da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed\") " pod="openshift-network-operator/iptables-alerter-hz6gj"
Jul 22 03:07:45.117470 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117290    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-node-log\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.117470 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117314    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-multus-cni-dir\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.117470 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117349    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-etc-sysctl-conf\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.118164 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh4zv\" (UniqueName: \"kubernetes.io/projected/565506ac-b6f1-4776-97cd-65ff7a606674-kube-api-access-qh4zv\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.118164 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fb16bbd-19c6-403c-8298-4f217dda4b19-cnibin\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.118164 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117422    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-run-openvswitch\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.118164 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-dbus\") pod \"global-pull-secret-syncer-x8mph\" (UID: \"2e2a9ce4-415f-4f0e-b878-a19f08496cb9\") " pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:45.118164 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117483    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-run\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.118164 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117509    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s5wg\" (UniqueName: \"kubernetes.io/projected/8dc80ec4-2110-496c-a4b4-9c47947bca8c-kube-api-access-2s5wg\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.118164 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117538    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-var-lib-openvswitch\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.118164 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117564    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-run-ovn\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.118164 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1c64ef25-ed44-4731-8c1d-fba203cee498-hosts-file\") pod \"node-resolver-rnn7l\" (UID: \"1c64ef25-ed44-4731-8c1d-fba203cee498\") " pod="openshift-dns/node-resolver-rnn7l"
Jul 22 03:07:45.118164 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-systemd-units\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.118164 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117699    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-slash\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.118164 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs\") pod \"network-metrics-daemon-pnq86\" (UID: \"8e82838b-2f39-4a24-9b24-455344248ad3\") " pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:07:45.118164 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-var-lib-kubelet\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.118164 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117779    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8dc80ec4-2110-496c-a4b4-9c47947bca8c-socket-dir\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.118580 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117816    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-cni-bin\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.118580 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.118580 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-host-var-lib-kubelet\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.118580 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-etc-modprobe-d\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.118580 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-lib-modules\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.118580 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5fb16bbd-19c6-403c-8298-4f217dda4b19-os-release\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.118580 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117984    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8dc80ec4-2110-496c-a4b4-9c47947bca8c-registration-dir\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.118580 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118019    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-cni-netd\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.118580 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-system-cni-dir\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.118580 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-multus-socket-dir-parent\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.118580 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-sys\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.118580 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-host\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.118580 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118174    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-kubelet\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.118580 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fb16bbd-19c6-403c-8298-4f217dda4b19-system-cni-dir\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.119063 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118271    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fb16bbd-19c6-403c-8298-4f217dda4b19-system-cni-dir\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.119063 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118408    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8dc80ec4-2110-496c-a4b4-9c47947bca8c-sys-fs\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.119063 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-cnibin\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.119063 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118460    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-etc-openvswitch\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.119063 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-etc-sysconfig\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.119063 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118504    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-etc-kubernetes\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.119063 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118510    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-etc-kubernetes\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.119063 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118537    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5fb16bbd-19c6-403c-8298-4f217dda4b19-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.119063 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d7lt\" (UniqueName: \"kubernetes.io/projected/5fb16bbd-19c6-403c-8298-4f217dda4b19-kube-api-access-4d7lt\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.119063 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-host-var-lib-cni-bin\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.119063 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-multus-conf-dir\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.119063 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118687    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr7qz\" (UniqueName: \"kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz\") pod \"network-check-target-jhwrs\" (UID: \"14410091-686c-48cd-8c74-acacf64654a8\") " pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:07:45.119063 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118720    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-etc-systemd\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.119063 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw6rx\" (UniqueName: \"kubernetes.io/projected/1c64ef25-ed44-4731-8c1d-fba203cee498-kube-api-access-tw6rx\") pod \"node-resolver-rnn7l\" (UID: \"1c64ef25-ed44-4731-8c1d-fba203cee498\") " pod="openshift-dns/node-resolver-rnn7l"
Jul 22 03:07:45.119473 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5fb16bbd-19c6-403c-8298-4f217dda4b19-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.119473 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118805    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-run-systemd\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.119473 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-host-run-netns\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.119473 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118859    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret\") pod \"global-pull-secret-syncer-x8mph\" (UID: \"2e2a9ce4-415f-4f0e-b878-a19f08496cb9\") " pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:45.119473 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118886    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-etc-sysctl-d\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.119473 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118932    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c64ef25-ed44-4731-8c1d-fba203cee498-tmp-dir\") pod \"node-resolver-rnn7l\" (UID: \"1c64ef25-ed44-4731-8c1d-fba203cee498\") " pod="openshift-dns/node-resolver-rnn7l"
Jul 22 03:07:45.119473 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118962    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fb16bbd-19c6-403c-8298-4f217dda4b19-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.119473 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed-iptables-alerter-script\") pod \"iptables-alerter-hz6gj\" (UID: \"da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed\") " pod="openshift-network-operator/iptables-alerter-hz6gj"
Jul 22 03:07:45.119473 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.119031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-log-socket\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.119473 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.119046    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4d6d9fc-050a-472c-8189-78067e8fd96c-konnectivity-ca\") pod \"konnectivity-agent-lm5vf\" (UID: \"f4d6d9fc-050a-472c-8189-78067e8fd96c\") " pod="kube-system/konnectivity-agent-lm5vf"
Jul 22 03:07:45.119473 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.119058    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/18b30cc6-991b-4450-930e-23189b47e0bc-ovnkube-config\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.119473 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.119089    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/18b30cc6-991b-4450-930e-23189b47e0bc-ovnkube-script-lib\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.119473 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.119116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-host-var-lib-cni-multus\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.119473 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.119142    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.119906 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.119146    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8dc80ec4-2110-496c-a4b4-9c47947bca8c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.119906 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.119177    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7plw\" (UniqueName: \"kubernetes.io/projected/18b30cc6-991b-4450-930e-23189b47e0bc-kube-api-access-v7plw\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.119906 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.119203    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-os-release\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.119906 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.119233    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-host-run-multus-certs\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.119906 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.119272    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4c74ab3-d9f1-4901-932f-841e01504f79-host\") pod \"node-ca-lptm9\" (UID: \"a4c74ab3-d9f1-4901-932f-841e01504f79\") " pod="openshift-image-registry/node-ca-lptm9"
Jul 22 03:07:45.119906 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.119302    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4d6d9fc-050a-472c-8189-78067e8fd96c-agent-certs\") pod \"konnectivity-agent-lm5vf\" (UID: \"f4d6d9fc-050a-472c-8189-78067e8fd96c\") " pod="kube-system/konnectivity-agent-lm5vf"
Jul 22 03:07:45.119906 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.119628    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed-host-slash\") pod \"iptables-alerter-hz6gj\" (UID: \"da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed\") " pod="openshift-network-operator/iptables-alerter-hz6gj"
Jul 22 03:07:45.119906 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.119667    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f6827cb-5a20-4701-b53b-93bebefd8994-cni-binary-copy\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.119906 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.119726    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-host-run-k8s-cni-cncf-io\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.119906 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.119766    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-hostroot\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.120203 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.120152    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8dc80ec4-2110-496c-a4b4-9c47947bca8c-sys-fs\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.120203 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118409    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8dc80ec4-2110-496c-a4b4-9c47947bca8c-etc-selinux\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.120267 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.120221    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-cnibin\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.120301 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.120269    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-etc-sysconfig\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.120337 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.120318    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-etc-kubernetes\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.120371 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.120317    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/18b30cc6-991b-4450-930e-23189b47e0bc-env-overrides\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.120612 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.120590    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-host-var-lib-cni-bin\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.120693 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.120675    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-multus-conf-dir\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.120823 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.120794    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f6827cb-5a20-4701-b53b-93bebefd8994-multus-daemon-config\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.123424 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.120925    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-etc-systemd\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.123424 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.121058    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-kubelet-config\") pod \"global-pull-secret-syncer-x8mph\" (UID: \"2e2a9ce4-415f-4f0e-b878-a19f08496cb9\") " pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:45.123424 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.121504    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4c74ab3-d9f1-4901-932f-841e01504f79-serviceca\") pod \"node-ca-lptm9\" (UID: \"a4c74ab3-d9f1-4901-932f-841e01504f79\") " pod="openshift-image-registry/node-ca-lptm9"
Jul 22 03:07:45.123424 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.121566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5fb16bbd-19c6-403c-8298-4f217dda4b19-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.123424 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.121623    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-run-systemd\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.123424 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.121693    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-host-run-netns\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.123424 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:45.121778    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:45.123424 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.121788    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-node-log\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.123424 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:45.121846    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret podName:2e2a9ce4-415f-4f0e-b878-a19f08496cb9 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:45.621825782 +0000 UTC m=+3.083376182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret") pod "global-pull-secret-syncer-x8mph" (UID: "2e2a9ce4-415f-4f0e-b878-a19f08496cb9") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:45.123424 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.122021    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-multus-cni-dir\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.123424 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.122078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-etc-sysctl-d\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.123424 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.122181    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-etc-sysctl-conf\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.123424 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.122346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-host-var-lib-cni-multus\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.124174 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.122366    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c64ef25-ed44-4731-8c1d-fba203cee498-tmp-dir\") pod \"node-resolver-rnn7l\" (UID: \"1c64ef25-ed44-4731-8c1d-fba203cee498\") " pod="openshift-dns/node-resolver-rnn7l"
Jul 22 03:07:45.124174 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.122411    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-log-socket\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.124174 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.122544    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fb16bbd-19c6-403c-8298-4f217dda4b19-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.124174 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.122590    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-host-run-multus-certs\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.124174 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.122608    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8dc80ec4-2110-496c-a4b4-9c47947bca8c-socket-dir\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.124174 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.122660    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8dc80ec4-2110-496c-a4b4-9c47947bca8c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.124174 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.122659    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fb16bbd-19c6-403c-8298-4f217dda4b19-cnibin\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.124174 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.122701    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-run-openvswitch\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.124174 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.122756    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-dbus\") pod \"global-pull-secret-syncer-x8mph\" (UID: \"2e2a9ce4-415f-4f0e-b878-a19f08496cb9\") " pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:45.124174 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.122804    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-run\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.124174 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.122953    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed-iptables-alerter-script\") pod \"iptables-alerter-hz6gj\" (UID: \"da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed\") " pod="openshift-network-operator/iptables-alerter-hz6gj"
Jul 22 03:07:45.124174 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.122971    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-os-release\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.124174 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123010    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1c64ef25-ed44-4731-8c1d-fba203cee498-hosts-file\") pod \"node-resolver-rnn7l\" (UID: \"1c64ef25-ed44-4731-8c1d-fba203cee498\") " pod="openshift-dns/node-resolver-rnn7l"
Jul 22 03:07:45.124174 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.117498    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 03:07:45.125431 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123014    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-slash\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.125431 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123050    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-var-lib-openvswitch\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.125431 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123055    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-systemd-units\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.125431 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123057    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/18b30cc6-991b-4450-930e-23189b47e0bc-ovnkube-config\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.125431 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:45.123064    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:45.125431 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:45.124440    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs podName:8e82838b-2f39-4a24-9b24-455344248ad3 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:45.624414399 +0000 UTC m=+3.085964795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs") pod "network-metrics-daemon-pnq86" (UID: "8e82838b-2f39-4a24-9b24-455344248ad3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:45.125431 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123096    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4c74ab3-d9f1-4901-932f-841e01504f79-host\") pod \"node-ca-lptm9\" (UID: \"a4c74ab3-d9f1-4901-932f-841e01504f79\") " pod="openshift-image-registry/node-ca-lptm9"
Jul 22 03:07:45.125431 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.118128    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fb16bbd-19c6-403c-8298-4f217dda4b19-cni-binary-copy\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.125431 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123114    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-var-lib-kubelet\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.125431 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123132    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-cni-bin\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.125431 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123146    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-multus-socket-dir-parent\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.125431 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123153    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-sys\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.125431 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123172    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.125431 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123191    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-cni-netd\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.126093 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123215    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-host-var-lib-kubelet\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.126093 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123242    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-host\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.126093 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123282    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-etc-modprobe-d\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.126093 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123294    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5fb16bbd-19c6-403c-8298-4f217dda4b19-os-release\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.126093 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123329    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f6827cb-5a20-4701-b53b-93bebefd8994-system-cni-dir\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.126093 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123338    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/565506ac-b6f1-4776-97cd-65ff7a606674-lib-modules\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.126093 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-host-run-netns\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.126093 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123463    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8dc80ec4-2110-496c-a4b4-9c47947bca8c-registration-dir\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.126093 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123579    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5fb16bbd-19c6-403c-8298-4f217dda4b19-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.126093 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123625    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/18b30cc6-991b-4450-930e-23189b47e0bc-ovnkube-script-lib\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.126093 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.123088    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/18b30cc6-991b-4450-930e-23189b47e0bc-run-ovn\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.129156 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.128963    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/565506ac-b6f1-4776-97cd-65ff7a606674-etc-tuned\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.129156 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.129117    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/565506ac-b6f1-4776-97cd-65ff7a606674-tmp\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.129983 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.129880    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4d6d9fc-050a-472c-8189-78067e8fd96c-agent-certs\") pod \"konnectivity-agent-lm5vf\" (UID: \"f4d6d9fc-050a-472c-8189-78067e8fd96c\") " pod="kube-system/konnectivity-agent-lm5vf"
Jul 22 03:07:45.130803 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.130771    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cxqpd"
Jul 22 03:07:45.130981 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.130959    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/18b30cc6-991b-4450-930e-23189b47e0bc-ovn-node-metrics-cert\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.137956 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:45.137756    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:07:45.137956 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:45.137784    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:07:45.137956 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:45.137800    2565 projected.go:196] Error preparing data for projected volume kube-api-access-pr7qz for pod openshift-network-diagnostics/network-check-target-jhwrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:45.137956 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:45.137880    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz podName:14410091-686c-48cd-8c74-acacf64654a8 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:45.637859552 +0000 UTC m=+3.099409944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pr7qz" (UniqueName: "kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz") pod "network-check-target-jhwrs" (UID: "14410091-686c-48cd-8c74-acacf64654a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:45.142082 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.142050    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx9lg\" (UniqueName: \"kubernetes.io/projected/da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed-kube-api-access-dx9lg\") pod \"iptables-alerter-hz6gj\" (UID: \"da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed\") " pod="openshift-network-operator/iptables-alerter-hz6gj"
Jul 22 03:07:45.143020 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.142985    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9qjz\" (UniqueName: \"kubernetes.io/projected/5f6827cb-5a20-4701-b53b-93bebefd8994-kube-api-access-j9qjz\") pod \"multus-cjt4l\" (UID: \"5f6827cb-5a20-4701-b53b-93bebefd8994\") " pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.143597 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.143567    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cxqpd"
Jul 22 03:07:45.144225 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.143797    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw6rx\" (UniqueName: \"kubernetes.io/projected/1c64ef25-ed44-4731-8c1d-fba203cee498-kube-api-access-tw6rx\") pod \"node-resolver-rnn7l\" (UID: \"1c64ef25-ed44-4731-8c1d-fba203cee498\") " pod="openshift-dns/node-resolver-rnn7l"
Jul 22 03:07:45.147170 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.147120    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spn87\" (UniqueName: \"kubernetes.io/projected/8e82838b-2f39-4a24-9b24-455344248ad3-kube-api-access-spn87\") pod \"network-metrics-daemon-pnq86\" (UID: \"8e82838b-2f39-4a24-9b24-455344248ad3\") " pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:07:45.147496 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.147472    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s5wg\" (UniqueName: \"kubernetes.io/projected/8dc80ec4-2110-496c-a4b4-9c47947bca8c-kube-api-access-2s5wg\") pod \"aws-ebs-csi-driver-node-9lfgp\" (UID: \"8dc80ec4-2110-496c-a4b4-9c47947bca8c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.148673 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.148106    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh4zv\" (UniqueName: \"kubernetes.io/projected/565506ac-b6f1-4776-97cd-65ff7a606674-kube-api-access-qh4zv\") pod \"tuned-wfdf7\" (UID: \"565506ac-b6f1-4776-97cd-65ff7a606674\") " pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.148673 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.148552    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d7lt\" (UniqueName: \"kubernetes.io/projected/5fb16bbd-19c6-403c-8298-4f217dda4b19-kube-api-access-4d7lt\") pod \"multus-additional-cni-plugins-d64cf\" (UID: \"5fb16bbd-19c6-403c-8298-4f217dda4b19\") " pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.149615 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.149574    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7plw\" (UniqueName: \"kubernetes.io/projected/18b30cc6-991b-4450-930e-23189b47e0bc-kube-api-access-v7plw\") pod \"ovnkube-node-wl9bk\" (UID: \"18b30cc6-991b-4450-930e-23189b47e0bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.151253 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.151232    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5g9x\" (UniqueName: \"kubernetes.io/projected/a4c74ab3-d9f1-4901-932f-841e01504f79-kube-api-access-p5g9x\") pod \"node-ca-lptm9\" (UID: \"a4c74ab3-d9f1-4901-932f-841e01504f79\") " pod="openshift-image-registry/node-ca-lptm9"
Jul 22 03:07:45.244909 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.244779    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal" event={"ID":"88f274895667f5ef1e2f7c5805ba677d","Type":"ContainerStarted","Data":"a632e7e0e681f3d377903c590187b2f09e4dee53500ef682173d730ed277c225"}
Jul 22 03:07:45.246863 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.246795    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal" event={"ID":"4e0d70cfb1676971a8271ab86129053d","Type":"ContainerStarted","Data":"76114170eec7e265e72c15bfdeabe404dbf0ddd7967d5169689ddd07ca819dce"}
Jul 22 03:07:45.290998 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.290963    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lptm9"
Jul 22 03:07:45.297709 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.297681    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lm5vf"
Jul 22 03:07:45.302864 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:45.302827    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c74ab3_d9f1_4901_932f_841e01504f79.slice/crio-60c91d8ebfc28d7d55bed8050d869f2701bdceea9158a64f21f32fb91db40c8d WatchSource:0}: Error finding container 60c91d8ebfc28d7d55bed8050d869f2701bdceea9158a64f21f32fb91db40c8d: Status 404 returned error can't find the container with id 60c91d8ebfc28d7d55bed8050d869f2701bdceea9158a64f21f32fb91db40c8d
Jul 22 03:07:45.308806 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.308779    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp"
Jul 22 03:07:45.312941 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:45.312910    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d6d9fc_050a_472c_8189_78067e8fd96c.slice/crio-ab38676ee18207c889d5e10291624e90c575879f8ec8cfc1112c872583e5e0da WatchSource:0}: Error finding container ab38676ee18207c889d5e10291624e90c575879f8ec8cfc1112c872583e5e0da: Status 404 returned error can't find the container with id ab38676ee18207c889d5e10291624e90c575879f8ec8cfc1112c872583e5e0da
Jul 22 03:07:45.315808 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.315776    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wfdf7"
Jul 22 03:07:45.320750 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:45.320716    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dc80ec4_2110_496c_a4b4_9c47947bca8c.slice/crio-7a68a6f1133d77be43c6da39403ea97cd09a5fc8b2a6180106e6abd41cd6cd38 WatchSource:0}: Error finding container 7a68a6f1133d77be43c6da39403ea97cd09a5fc8b2a6180106e6abd41cd6cd38: Status 404 returned error can't find the container with id 7a68a6f1133d77be43c6da39403ea97cd09a5fc8b2a6180106e6abd41cd6cd38
Jul 22 03:07:45.324832 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.324806    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rnn7l"
Jul 22 03:07:45.328983 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:45.328952    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod565506ac_b6f1_4776_97cd_65ff7a606674.slice/crio-da0f0af6a79c31eca174a7c7e168def43117b8b0716c9dd8a7a37cb63dab587a WatchSource:0}: Error finding container da0f0af6a79c31eca174a7c7e168def43117b8b0716c9dd8a7a37cb63dab587a: Status 404 returned error can't find the container with id da0f0af6a79c31eca174a7c7e168def43117b8b0716c9dd8a7a37cb63dab587a
Jul 22 03:07:45.333665 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.333634    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d64cf"
Jul 22 03:07:45.337148 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:45.337112    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c64ef25_ed44_4731_8c1d_fba203cee498.slice/crio-02128ada6aba800d9976511dd333f92cde2eff32459c3319b487c40d03eb0342 WatchSource:0}: Error finding container 02128ada6aba800d9976511dd333f92cde2eff32459c3319b487c40d03eb0342: Status 404 returned error can't find the container with id 02128ada6aba800d9976511dd333f92cde2eff32459c3319b487c40d03eb0342
Jul 22 03:07:45.343197 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.343173    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hz6gj"
Jul 22 03:07:45.350649 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:45.350588    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb16bbd_19c6_403c_8298_4f217dda4b19.slice/crio-9b5a9a7665f5545a24a27735ba4556bf211cd60d40dacdc2450a8455e64a686d WatchSource:0}: Error finding container 9b5a9a7665f5545a24a27735ba4556bf211cd60d40dacdc2450a8455e64a686d: Status 404 returned error can't find the container with id 9b5a9a7665f5545a24a27735ba4556bf211cd60d40dacdc2450a8455e64a686d
Jul 22 03:07:45.351882 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.351860    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:07:45.360075 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.360041    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cjt4l"
Jul 22 03:07:45.361164 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:45.361132    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4c2d4d_9afc_4bfe_97db_e7da3ba0f6ed.slice/crio-c91faa73aba0e739a2f9f40b5b7eaec8287b5f9c191aeca1ebeb71fbe9bac1e6 WatchSource:0}: Error finding container c91faa73aba0e739a2f9f40b5b7eaec8287b5f9c191aeca1ebeb71fbe9bac1e6: Status 404 returned error can't find the container with id c91faa73aba0e739a2f9f40b5b7eaec8287b5f9c191aeca1ebeb71fbe9bac1e6
Jul 22 03:07:45.368825 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:45.368759    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b30cc6_991b_4450_930e_23189b47e0bc.slice/crio-9b2ba8f777542e646116809437985fdb6531117ef876c43e18405fb5b4689f64 WatchSource:0}: Error finding container 9b2ba8f777542e646116809437985fdb6531117ef876c43e18405fb5b4689f64: Status 404 returned error can't find the container with id 9b2ba8f777542e646116809437985fdb6531117ef876c43e18405fb5b4689f64
Jul 22 03:07:45.373802 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:07:45.373599    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f6827cb_5a20_4701_b53b_93bebefd8994.slice/crio-f6452c85e8cd0141fc9903863a22d5ca1c5318d6f5e75ad7401484dfe04038aa WatchSource:0}: Error finding container f6452c85e8cd0141fc9903863a22d5ca1c5318d6f5e75ad7401484dfe04038aa: Status 404 returned error can't find the container with id f6452c85e8cd0141fc9903863a22d5ca1c5318d6f5e75ad7401484dfe04038aa
Jul 22 03:07:45.624025 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.623924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret\") pod \"global-pull-secret-syncer-x8mph\" (UID: \"2e2a9ce4-415f-4f0e-b878-a19f08496cb9\") " pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:45.624181 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:45.624103    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:45.624181 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:45.624171    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret podName:2e2a9ce4-415f-4f0e-b878-a19f08496cb9 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:46.62415657 +0000 UTC m=+4.085706974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret") pod "global-pull-secret-syncer-x8mph" (UID: "2e2a9ce4-415f-4f0e-b878-a19f08496cb9") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:45.725143 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.725103    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs\") pod \"network-metrics-daemon-pnq86\" (UID: \"8e82838b-2f39-4a24-9b24-455344248ad3\") " pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:07:45.725353 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:45.725169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr7qz\" (UniqueName: \"kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz\") pod \"network-check-target-jhwrs\" (UID: \"14410091-686c-48cd-8c74-acacf64654a8\") " pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:07:45.725353 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:45.725334    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:45.725473 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:45.725425    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs podName:8e82838b-2f39-4a24-9b24-455344248ad3 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:46.725401485 +0000 UTC m=+4.186951873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs") pod "network-metrics-daemon-pnq86" (UID: "8e82838b-2f39-4a24-9b24-455344248ad3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:45.725473 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:45.725342    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:07:45.725613 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:45.725477    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:07:45.725613 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:45.725492    2565 projected.go:196] Error preparing data for projected volume kube-api-access-pr7qz for pod openshift-network-diagnostics/network-check-target-jhwrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:45.725613 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:45.725556    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz podName:14410091-686c-48cd-8c74-acacf64654a8 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:46.725537383 +0000 UTC m=+4.187087785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pr7qz" (UniqueName: "kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz") pod "network-check-target-jhwrs" (UID: "14410091-686c-48cd-8c74-acacf64654a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:46.147833 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:46.147756    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 03:02:45 +0000 UTC" deadline="2028-03-16 12:10:23.988123652 +0000 UTC"
Jul 22 03:07:46.147833 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:46.147828    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14481h2m37.840300598s"
Jul 22 03:07:46.239257 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:46.238502    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:07:46.239257 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:46.238679    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnq86" podUID="8e82838b-2f39-4a24-9b24-455344248ad3"
Jul 22 03:07:46.239257 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:46.238781    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:07:46.239257 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:46.238863    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwrs" podUID="14410091-686c-48cd-8c74-acacf64654a8"
Jul 22 03:07:46.250515 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:46.250475    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d64cf" event={"ID":"5fb16bbd-19c6-403c-8298-4f217dda4b19","Type":"ContainerStarted","Data":"9b5a9a7665f5545a24a27735ba4556bf211cd60d40dacdc2450a8455e64a686d"}
Jul 22 03:07:46.252054 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:46.252018    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rnn7l" event={"ID":"1c64ef25-ed44-4731-8c1d-fba203cee498","Type":"ContainerStarted","Data":"02128ada6aba800d9976511dd333f92cde2eff32459c3319b487c40d03eb0342"}
Jul 22 03:07:46.253504 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:46.253473    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp" event={"ID":"8dc80ec4-2110-496c-a4b4-9c47947bca8c","Type":"ContainerStarted","Data":"7a68a6f1133d77be43c6da39403ea97cd09a5fc8b2a6180106e6abd41cd6cd38"}
Jul 22 03:07:46.255124 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:46.255097    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk" event={"ID":"18b30cc6-991b-4450-930e-23189b47e0bc","Type":"ContainerStarted","Data":"9b2ba8f777542e646116809437985fdb6531117ef876c43e18405fb5b4689f64"}
Jul 22 03:07:46.257451 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:46.257423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wfdf7" event={"ID":"565506ac-b6f1-4776-97cd-65ff7a606674","Type":"ContainerStarted","Data":"da0f0af6a79c31eca174a7c7e168def43117b8b0716c9dd8a7a37cb63dab587a"}
Jul 22 03:07:46.259018 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:46.258991    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lm5vf" event={"ID":"f4d6d9fc-050a-472c-8189-78067e8fd96c","Type":"ContainerStarted","Data":"ab38676ee18207c889d5e10291624e90c575879f8ec8cfc1112c872583e5e0da"}
Jul 22 03:07:46.261559 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:46.261502    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lptm9" event={"ID":"a4c74ab3-d9f1-4901-932f-841e01504f79","Type":"ContainerStarted","Data":"60c91d8ebfc28d7d55bed8050d869f2701bdceea9158a64f21f32fb91db40c8d"}
Jul 22 03:07:46.263484 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:46.263457    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cjt4l" event={"ID":"5f6827cb-5a20-4701-b53b-93bebefd8994","Type":"ContainerStarted","Data":"f6452c85e8cd0141fc9903863a22d5ca1c5318d6f5e75ad7401484dfe04038aa"}
Jul 22 03:07:46.265089 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:46.265065    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hz6gj" event={"ID":"da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed","Type":"ContainerStarted","Data":"c91faa73aba0e739a2f9f40b5b7eaec8287b5f9c191aeca1ebeb71fbe9bac1e6"}
Jul 22 03:07:46.635110 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:46.634408    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret\") pod \"global-pull-secret-syncer-x8mph\" (UID: \"2e2a9ce4-415f-4f0e-b878-a19f08496cb9\") " pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:46.635110 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:46.634577    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:46.635110 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:46.634674    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret podName:2e2a9ce4-415f-4f0e-b878-a19f08496cb9 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:48.634650305 +0000 UTC m=+6.096200699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret") pod "global-pull-secret-syncer-x8mph" (UID: "2e2a9ce4-415f-4f0e-b878-a19f08496cb9") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:46.735816 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:46.735770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs\") pod \"network-metrics-daemon-pnq86\" (UID: \"8e82838b-2f39-4a24-9b24-455344248ad3\") " pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:07:46.736016 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:46.735837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr7qz\" (UniqueName: \"kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz\") pod \"network-check-target-jhwrs\" (UID: \"14410091-686c-48cd-8c74-acacf64654a8\") " pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:07:46.736103 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:46.736026    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:07:46.736103 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:46.736049    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:07:46.736103 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:46.736063    2565 projected.go:196] Error preparing data for projected volume kube-api-access-pr7qz for pod openshift-network-diagnostics/network-check-target-jhwrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:46.736254 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:46.736132    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz podName:14410091-686c-48cd-8c74-acacf64654a8 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:48.736110503 +0000 UTC m=+6.197660893 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pr7qz" (UniqueName: "kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz") pod "network-check-target-jhwrs" (UID: "14410091-686c-48cd-8c74-acacf64654a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:46.736585 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:46.736559    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:46.736743 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:46.736621    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs podName:8e82838b-2f39-4a24-9b24-455344248ad3 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:48.736605193 +0000 UTC m=+6.198155579 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs") pod "network-metrics-daemon-pnq86" (UID: "8e82838b-2f39-4a24-9b24-455344248ad3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:47.149096 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:47.149047    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 03:02:45 +0000 UTC" deadline="2028-01-28 12:24:57.18889709 +0000 UTC"
Jul 22 03:07:47.149096 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:47.149092    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13329h17m10.039809757s"
Jul 22 03:07:47.240156 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:47.240060    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:47.240331 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:47.240233    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x8mph" podUID="2e2a9ce4-415f-4f0e-b878-a19f08496cb9"
Jul 22 03:07:48.239294 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:48.239255    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:07:48.239784 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:48.239410    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnq86" podUID="8e82838b-2f39-4a24-9b24-455344248ad3"
Jul 22 03:07:48.239867 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:48.239832    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:07:48.239976 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:48.239934    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwrs" podUID="14410091-686c-48cd-8c74-acacf64654a8"
Jul 22 03:07:48.658872 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:48.658097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret\") pod \"global-pull-secret-syncer-x8mph\" (UID: \"2e2a9ce4-415f-4f0e-b878-a19f08496cb9\") " pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:48.658872 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:48.658309    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:48.658872 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:48.658392    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret podName:2e2a9ce4-415f-4f0e-b878-a19f08496cb9 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:52.658368619 +0000 UTC m=+10.119919028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret") pod "global-pull-secret-syncer-x8mph" (UID: "2e2a9ce4-415f-4f0e-b878-a19f08496cb9") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:48.758833 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:48.758791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs\") pod \"network-metrics-daemon-pnq86\" (UID: \"8e82838b-2f39-4a24-9b24-455344248ad3\") " pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:07:48.758993 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:48.758865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr7qz\" (UniqueName: \"kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz\") pod \"network-check-target-jhwrs\" (UID: \"14410091-686c-48cd-8c74-acacf64654a8\") " pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:07:48.759124 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:48.759105    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:07:48.759189 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:48.759130    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:07:48.759244 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:48.759193    2565 projected.go:196] Error preparing data for projected volume kube-api-access-pr7qz for pod openshift-network-diagnostics/network-check-target-jhwrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:48.759300 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:48.759260    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz podName:14410091-686c-48cd-8c74-acacf64654a8 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:52.759239922 +0000 UTC m=+10.220790313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pr7qz" (UniqueName: "kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz") pod "network-check-target-jhwrs" (UID: "14410091-686c-48cd-8c74-acacf64654a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:48.759726 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:48.759701    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:48.759833 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:48.759760    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs podName:8e82838b-2f39-4a24-9b24-455344248ad3 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:52.759742655 +0000 UTC m=+10.221293047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs") pod "network-metrics-daemon-pnq86" (UID: "8e82838b-2f39-4a24-9b24-455344248ad3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:49.243022 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:49.242480    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:49.243022 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:49.242639    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x8mph" podUID="2e2a9ce4-415f-4f0e-b878-a19f08496cb9"
Jul 22 03:07:50.239472 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:50.238939    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:07:50.239472 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:50.239070    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwrs" podUID="14410091-686c-48cd-8c74-acacf64654a8"
Jul 22 03:07:50.239472 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:50.239171    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:07:50.239472 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:50.239266    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnq86" podUID="8e82838b-2f39-4a24-9b24-455344248ad3"
Jul 22 03:07:51.242749 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:51.242215    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:51.242749 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:51.242350    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x8mph" podUID="2e2a9ce4-415f-4f0e-b878-a19f08496cb9"
Jul 22 03:07:52.238153 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:52.238123    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:07:52.238319 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:52.238255    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwrs" podUID="14410091-686c-48cd-8c74-acacf64654a8"
Jul 22 03:07:52.238654 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:52.238090    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:07:52.238796 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:52.238763    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnq86" podUID="8e82838b-2f39-4a24-9b24-455344248ad3"
Jul 22 03:07:52.692337 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:52.692244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret\") pod \"global-pull-secret-syncer-x8mph\" (UID: \"2e2a9ce4-415f-4f0e-b878-a19f08496cb9\") " pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:52.692838 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:52.692408    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:52.692838 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:52.692474    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret podName:2e2a9ce4-415f-4f0e-b878-a19f08496cb9 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:00.692455079 +0000 UTC m=+18.154005468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret") pod "global-pull-secret-syncer-x8mph" (UID: "2e2a9ce4-415f-4f0e-b878-a19f08496cb9") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:52.793732 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:52.792838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr7qz\" (UniqueName: \"kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz\") pod \"network-check-target-jhwrs\" (UID: \"14410091-686c-48cd-8c74-acacf64654a8\") " pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:07:52.793732 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:52.792998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs\") pod \"network-metrics-daemon-pnq86\" (UID: \"8e82838b-2f39-4a24-9b24-455344248ad3\") " pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:07:52.793732 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:52.793138    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:52.793732 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:52.793201    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs podName:8e82838b-2f39-4a24-9b24-455344248ad3 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:00.793181281 +0000 UTC m=+18.254731671 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs") pod "network-metrics-daemon-pnq86" (UID: "8e82838b-2f39-4a24-9b24-455344248ad3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:52.793732 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:52.793627    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:07:52.793732 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:52.793645    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:07:52.793732 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:52.793657    2565 projected.go:196] Error preparing data for projected volume kube-api-access-pr7qz for pod openshift-network-diagnostics/network-check-target-jhwrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:52.793732 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:52.793706    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz podName:14410091-686c-48cd-8c74-acacf64654a8 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:00.793691275 +0000 UTC m=+18.255241662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pr7qz" (UniqueName: "kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz") pod "network-check-target-jhwrs" (UID: "14410091-686c-48cd-8c74-acacf64654a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:53.244254 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:53.244216    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:53.244470 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:53.244362    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x8mph" podUID="2e2a9ce4-415f-4f0e-b878-a19f08496cb9"
Jul 22 03:07:54.238528 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:54.238485    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:07:54.238982 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:54.238487    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:07:54.238982 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:54.238660    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnq86" podUID="8e82838b-2f39-4a24-9b24-455344248ad3"
Jul 22 03:07:54.238982 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:54.238743    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwrs" podUID="14410091-686c-48cd-8c74-acacf64654a8"
Jul 22 03:07:55.238674 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:55.238638    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:55.239105 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:55.238786    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x8mph" podUID="2e2a9ce4-415f-4f0e-b878-a19f08496cb9"
Jul 22 03:07:56.238894 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:56.238866    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:07:56.239285 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:56.238866    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:07:56.239285 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:56.238975    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwrs" podUID="14410091-686c-48cd-8c74-acacf64654a8"
Jul 22 03:07:56.239285 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:56.239048    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnq86" podUID="8e82838b-2f39-4a24-9b24-455344248ad3"
Jul 22 03:07:57.238623 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:57.238587    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:57.238790 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:57.238706    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x8mph" podUID="2e2a9ce4-415f-4f0e-b878-a19f08496cb9"
Jul 22 03:07:58.238479 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:58.238204    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:07:58.238479 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:58.238335    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnq86" podUID="8e82838b-2f39-4a24-9b24-455344248ad3"
Jul 22 03:07:58.238479 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:58.238203    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:07:58.238479 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:58.238463    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwrs" podUID="14410091-686c-48cd-8c74-acacf64654a8"
Jul 22 03:07:59.239041 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:07:59.239002    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:07:59.239459 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:07:59.239139    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x8mph" podUID="2e2a9ce4-415f-4f0e-b878-a19f08496cb9"
Jul 22 03:08:00.238168 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:00.238126    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:08:00.238355 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:00.238132    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:08:00.238355 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:00.238254    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwrs" podUID="14410091-686c-48cd-8c74-acacf64654a8"
Jul 22 03:08:00.238355 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:00.238335    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnq86" podUID="8e82838b-2f39-4a24-9b24-455344248ad3"
Jul 22 03:08:00.752681 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:00.752637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret\") pod \"global-pull-secret-syncer-x8mph\" (UID: \"2e2a9ce4-415f-4f0e-b878-a19f08496cb9\") " pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:08:00.753252 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:00.752813    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:08:00.753252 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:00.752923    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret podName:2e2a9ce4-415f-4f0e-b878-a19f08496cb9 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:16.752873472 +0000 UTC m=+34.214423857 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret") pod "global-pull-secret-syncer-x8mph" (UID: "2e2a9ce4-415f-4f0e-b878-a19f08496cb9") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:08:00.852990 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:00.852948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr7qz\" (UniqueName: \"kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz\") pod \"network-check-target-jhwrs\" (UID: \"14410091-686c-48cd-8c74-acacf64654a8\") " pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:08:00.853182 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:00.853075    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs\") pod \"network-metrics-daemon-pnq86\" (UID: \"8e82838b-2f39-4a24-9b24-455344248ad3\") " pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:08:00.853182 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:00.853148    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:08:00.853182 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:00.853175    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:08:00.853182 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:00.853178    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:08:00.853396 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:00.853188    2565 projected.go:196] Error preparing data for projected volume kube-api-access-pr7qz for pod openshift-network-diagnostics/network-check-target-jhwrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:08:00.853396 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:00.853243    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz podName:14410091-686c-48cd-8c74-acacf64654a8 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:16.853228047 +0000 UTC m=+34.314778451 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pr7qz" (UniqueName: "kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz") pod "network-check-target-jhwrs" (UID: "14410091-686c-48cd-8c74-acacf64654a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:08:00.853396 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:00.853261    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs podName:8e82838b-2f39-4a24-9b24-455344248ad3 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:16.85325346 +0000 UTC m=+34.314803843 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs") pod "network-metrics-daemon-pnq86" (UID: "8e82838b-2f39-4a24-9b24-455344248ad3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:08:01.238725 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:01.238639    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:08:01.238888 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:01.238780    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x8mph" podUID="2e2a9ce4-415f-4f0e-b878-a19f08496cb9"
Jul 22 03:08:02.239083 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:02.239039    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:08:02.239083 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:02.239095    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:08:02.239659 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:02.239230    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnq86" podUID="8e82838b-2f39-4a24-9b24-455344248ad3"
Jul 22 03:08:02.239659 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:02.239407    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwrs" podUID="14410091-686c-48cd-8c74-acacf64654a8"
Jul 22 03:08:03.239712 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:03.239673    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:08:03.240194 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:03.239800    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x8mph" podUID="2e2a9ce4-415f-4f0e-b878-a19f08496cb9"
Jul 22 03:08:04.238212 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:04.238174    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:08:04.238212 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:04.238198    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:08:04.238415 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:04.238302    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwrs" podUID="14410091-686c-48cd-8c74-acacf64654a8"
Jul 22 03:08:04.238415 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:04.238401    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnq86" podUID="8e82838b-2f39-4a24-9b24-455344248ad3"
Jul 22 03:08:05.238609 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.238277    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:08:05.239263 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:05.238692    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x8mph" podUID="2e2a9ce4-415f-4f0e-b878-a19f08496cb9"
Jul 22 03:08:05.300342 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.300300    2565 generic.go:356] "Generic (PLEG): container finished" podID="4e0d70cfb1676971a8271ab86129053d" containerID="fc0a1f7b05d3ce35115a054ef45217037bd759422fc7b4e22be22ee5ae7c891d" exitCode=0
Jul 22 03:08:05.300537 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.300388    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal" event={"ID":"4e0d70cfb1676971a8271ab86129053d","Type":"ContainerDied","Data":"fc0a1f7b05d3ce35115a054ef45217037bd759422fc7b4e22be22ee5ae7c891d"}
Jul 22 03:08:05.303518 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.303482    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk" event={"ID":"18b30cc6-991b-4450-930e-23189b47e0bc","Type":"ContainerStarted","Data":"788d5caf4c4312472339eb866d244879be826bcec0804a36fd414dcb77c1bf73"}
Jul 22 03:08:05.303680 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.303594    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk" event={"ID":"18b30cc6-991b-4450-930e-23189b47e0bc","Type":"ContainerStarted","Data":"795c51d9e6c6388c6ef4cca40b51f927890b100c07bea2c5758f39516294c13e"}
Jul 22 03:08:05.303680 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.303652    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk" event={"ID":"18b30cc6-991b-4450-930e-23189b47e0bc","Type":"ContainerStarted","Data":"b4dedf7884c5742a71fcf4ec3c03aca0ac3d54c6e362d132cf7b54ee143593f2"}
Jul 22 03:08:05.303785 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.303698    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk" event={"ID":"18b30cc6-991b-4450-930e-23189b47e0bc","Type":"ContainerStarted","Data":"339f27c66ab0df1e7e5e65764fe1f76eb2ab5f3cc5916ddfabb9dac12d72e600"}
Jul 22 03:08:05.305229 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.305203    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wfdf7" event={"ID":"565506ac-b6f1-4776-97cd-65ff7a606674","Type":"ContainerStarted","Data":"e2d97530b715c1cfccc106991f26b4e80afdc3deb7cf58d711efa2391406c70d"}
Jul 22 03:08:05.306766 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.306739    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lm5vf" event={"ID":"f4d6d9fc-050a-472c-8189-78067e8fd96c","Type":"ContainerStarted","Data":"f3fb6dd11e813cacb00d92715cb62c6bea543e8cc9f09aba98eece75e2d0e1bb"}
Jul 22 03:08:05.308235 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.308211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lptm9" event={"ID":"a4c74ab3-d9f1-4901-932f-841e01504f79","Type":"ContainerStarted","Data":"88050e3599fada31d940021569720ee813f4c241366081eba476410d47640b5b"}
Jul 22 03:08:05.309722 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.309698    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal" event={"ID":"88f274895667f5ef1e2f7c5805ba677d","Type":"ContainerStarted","Data":"42ea5eab27d9fd2bdec241172412868ac69c167e8e8f4d1cd122152b1515dc57"}
Jul 22 03:08:05.311178 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.311156    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cjt4l" event={"ID":"5f6827cb-5a20-4701-b53b-93bebefd8994","Type":"ContainerStarted","Data":"12e5aefe1e529e47ed81f52b6e84cb125e5af9ed89a2243306343dc2a1037d94"}
Jul 22 03:08:05.312762 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.312738    2565 generic.go:356] "Generic (PLEG): container finished" podID="5fb16bbd-19c6-403c-8298-4f217dda4b19" containerID="2e715287e57e283c8f95e823fb4f67f1f7e55d3676a2b8bfac1bd8b173b65cef" exitCode=0
Jul 22 03:08:05.312857 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.312816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d64cf" event={"ID":"5fb16bbd-19c6-403c-8298-4f217dda4b19","Type":"ContainerDied","Data":"2e715287e57e283c8f95e823fb4f67f1f7e55d3676a2b8bfac1bd8b173b65cef"}
Jul 22 03:08:05.314250 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.314223    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rnn7l" event={"ID":"1c64ef25-ed44-4731-8c1d-fba203cee498","Type":"ContainerStarted","Data":"68765ad91788efeb2c6231e9fbaf4036b74b292b9feff8659071331a4e92b52d"}
Jul 22 03:08:05.316110 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.315545    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp" event={"ID":"8dc80ec4-2110-496c-a4b4-9c47947bca8c","Type":"ContainerStarted","Data":"8c42f2fe9c347a2ac1807d868dc80eaae6cae25b93a14ae0d4267707c56c69e0"}
Jul 22 03:08:05.347692 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.347644    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wfdf7" podStartSLOduration=3.018967979 podStartE2EDuration="22.347628973s" totalImagesPullingTime="19.328660994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:05.347130631 +0000 UTC m=+22.808681037" watchObservedRunningTime="2026-07-22 03:08:05.347628973 +0000 UTC m=+22.809179378"
Jul 22 03:08:05.385097 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.385043    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-205.ec2.internal" podStartSLOduration=21.385017289 podStartE2EDuration="21.385017289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:05.384517482 +0000 UTC m=+22.846067889" watchObservedRunningTime="2026-07-22 03:08:05.385017289 +0000 UTC m=+22.846567694"
Jul 22 03:08:05.402217 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.402161    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lptm9" podStartSLOduration=11.499764129 podStartE2EDuration="22.402142808s" totalImagesPullingTime="10.902378679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:05.40205794 +0000 UTC m=+22.863608347" watchObservedRunningTime="2026-07-22 03:08:05.402142808 +0000 UTC m=+22.863693221"
Jul 22 03:08:05.420318 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.420276    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lm5vf" podStartSLOduration=3.422442058 podStartE2EDuration="22.420260324s" totalImagesPullingTime="18.997818266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:05.420181652 +0000 UTC m=+22.881732058" watchObservedRunningTime="2026-07-22 03:08:05.420260324 +0000 UTC m=+22.881810729"
Jul 22 03:08:05.477174 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.477114    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cjt4l" podStartSLOduration=3.061709414 podStartE2EDuration="22.477091021s" totalImagesPullingTime="19.415381607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:05.455742469 +0000 UTC m=+22.917292874" watchObservedRunningTime="2026-07-22 03:08:05.477091021 +0000 UTC m=+22.938641421"
Jul 22 03:08:05.478008 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:05.477959    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rnn7l" podStartSLOduration=3.504607027 podStartE2EDuration="22.477939616s" totalImagesPullingTime="18.973332589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:05.477220339 +0000 UTC m=+22.938770746" watchObservedRunningTime="2026-07-22 03:08:05.477939616 +0000 UTC m=+22.939490017"
Jul 22 03:08:06.239019 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:06.238810    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:08:06.239479 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:06.238837    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:08:06.239479 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:06.239130    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnq86" podUID="8e82838b-2f39-4a24-9b24-455344248ad3"
Jul 22 03:08:06.239479 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:06.239182    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwrs" podUID="14410091-686c-48cd-8c74-acacf64654a8"
Jul 22 03:08:06.321127 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:06.321020    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal" event={"ID":"4e0d70cfb1676971a8271ab86129053d","Type":"ContainerStarted","Data":"8205a22f5bc20a134f9cb8e84d4c3ec2adca8bed7ae7f918cf0b402b120750cf"}
Jul 22 03:08:06.325255 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:06.325211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk" event={"ID":"18b30cc6-991b-4450-930e-23189b47e0bc","Type":"ContainerStarted","Data":"9ccb2062b1781f85665aa52050cad51e5af1a8ad9745596e2d0b67b96873c7ed"}
Jul 22 03:08:06.325428 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:06.325298    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk" event={"ID":"18b30cc6-991b-4450-930e-23189b47e0bc","Type":"ContainerStarted","Data":"9bb31b26356caa3a6531d84ca24cbee4982769d72dbffd2dc35ec006061e1564"}
Jul 22 03:08:06.327389 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:06.327316    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hz6gj" event={"ID":"da4c2d4d-9afc-4bfe-97db-e7da3ba0f6ed","Type":"ContainerStarted","Data":"9563834c03b97e1fdc75fb7a95e44e58a2f292ac35fd3d1e262ec8794ca00190"}
Jul 22 03:08:06.351999 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:06.351939    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-205.ec2.internal" podStartSLOduration=22.351915394 podStartE2EDuration="22.351915394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:06.336996349 +0000 UTC m=+23.798546755" watchObservedRunningTime="2026-07-22 03:08:06.351915394 +0000 UTC m=+23.813465800"
Jul 22 03:08:06.352598 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:06.352441    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hz6gj" podStartSLOduration=4.401151813 podStartE2EDuration="23.35243177s" totalImagesPullingTime="18.951279957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:06.351566192 +0000 UTC m=+23.813116588" watchObservedRunningTime="2026-07-22 03:08:06.35243177 +0000 UTC m=+23.813982177"
Jul 22 03:08:06.968462 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:06.968426    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 03:08:07.082875 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:07.082720    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T03:08:06.968452412Z","UUID":"8a657fc1-a342-4d37-a85d-ce264493f880","Handler":null,"Name":"","Endpoint":""}
Jul 22 03:08:07.084437 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:07.084409    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 03:08:07.084622 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:07.084458    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 03:08:07.239081 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:07.239040    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:08:07.239623 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:07.239158    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x8mph" podUID="2e2a9ce4-415f-4f0e-b878-a19f08496cb9"
Jul 22 03:08:07.331826 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:07.331786    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp" event={"ID":"8dc80ec4-2110-496c-a4b4-9c47947bca8c","Type":"ContainerStarted","Data":"e93773e67c3946d3aa49ec47f08ec9346082210c863a18b9e388076641e863d1"}
Jul 22 03:08:08.238273 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:08.238238    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:08:08.238577 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:08.238241    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:08:08.238577 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:08.238385    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwrs" podUID="14410091-686c-48cd-8c74-acacf64654a8"
Jul 22 03:08:08.238577 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:08.238444    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnq86" podUID="8e82838b-2f39-4a24-9b24-455344248ad3"
Jul 22 03:08:08.338130 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:08.338090    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk" event={"ID":"18b30cc6-991b-4450-930e-23189b47e0bc","Type":"ContainerStarted","Data":"1240edbe63e8fd2db9d41f8a79aeeb356a3a943ba2242d01211fea29323a8c3b"}
Jul 22 03:08:09.238800 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:09.238764    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:08:09.239088 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:09.238889    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x8mph" podUID="2e2a9ce4-415f-4f0e-b878-a19f08496cb9"
Jul 22 03:08:09.587255 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:09.587170    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lm5vf"
Jul 22 03:08:10.238839 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:10.238617    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:08:10.238839 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:10.238648    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:08:10.239018 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:10.238900    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwrs" podUID="14410091-686c-48cd-8c74-acacf64654a8"
Jul 22 03:08:10.239081 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:10.239037    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnq86" podUID="8e82838b-2f39-4a24-9b24-455344248ad3"
Jul 22 03:08:10.251292 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:10.251268    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lm5vf"
Jul 22 03:08:10.251742 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:10.251729    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lm5vf"
Jul 22 03:08:10.345807 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:10.345773    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk" event={"ID":"18b30cc6-991b-4450-930e-23189b47e0bc","Type":"ContainerStarted","Data":"7e473a0fef9137034cbfed279b7320b3c4478f2b997d42b40faf96699d5e2c6c"}
Jul 22 03:08:10.346479 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:10.346052    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:08:10.346479 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:10.346123    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:08:10.346479 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:10.346171    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:08:10.352159 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:10.352134    2565 generic.go:356] "Generic (PLEG): container finished" podID="5fb16bbd-19c6-403c-8298-4f217dda4b19" containerID="6e47f54759ffc07c71b0d41eee7a0a5a1472be237743c9cfd8bbaa4aab661626" exitCode=0
Jul 22 03:08:10.352279 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:10.352210    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d64cf" event={"ID":"5fb16bbd-19c6-403c-8298-4f217dda4b19","Type":"ContainerDied","Data":"6e47f54759ffc07c71b0d41eee7a0a5a1472be237743c9cfd8bbaa4aab661626"}
Jul 22 03:08:10.354801 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:10.354777    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp" event={"ID":"8dc80ec4-2110-496c-a4b4-9c47947bca8c","Type":"ContainerStarted","Data":"2d4d6c932577eb9763a74b0500ef007bed31ce49f72133c1d70ace0abf59d5a5"}
Jul 22 03:08:10.355403 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:10.355382    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lm5vf"
Jul 22 03:08:10.362533 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:10.362511    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:08:10.364260 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:10.364241    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:08:10.393868 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:10.393830    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk" podStartSLOduration=8.033857508 podStartE2EDuration="27.393817293s" totalImagesPullingTime="19.359959785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:10.375299056 +0000 UTC m=+27.836849462" watchObservedRunningTime="2026-07-22 03:08:10.393817293 +0000 UTC m=+27.855367702"
Jul 22 03:08:10.394008 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:10.393991    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lfgp" podStartSLOduration=3.56835018 podStartE2EDuration="27.393986003s" totalImagesPullingTime="23.825635823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:10.393630371 +0000 UTC m=+27.855180777" watchObservedRunningTime="2026-07-22 03:08:10.393986003 +0000 UTC m=+27.855536442"
Jul 22 03:08:11.239065 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:11.238997    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:08:11.239623 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:11.239115    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x8mph" podUID="2e2a9ce4-415f-4f0e-b878-a19f08496cb9"
Jul 22 03:08:12.055112 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:12.054908    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pnq86"]
Jul 22 03:08:12.055288 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:12.055232    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:08:12.055339 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:12.055319    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnq86" podUID="8e82838b-2f39-4a24-9b24-455344248ad3"
Jul 22 03:08:12.063103 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:12.063073    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jhwrs"]
Jul 22 03:08:12.063217 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:12.063173    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:08:12.063263 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:12.063247    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwrs" podUID="14410091-686c-48cd-8c74-acacf64654a8"
Jul 22 03:08:12.078238 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:12.078209    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x8mph"]
Jul 22 03:08:12.078344 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:12.078292    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:08:12.078381 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:12.078362    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x8mph" podUID="2e2a9ce4-415f-4f0e-b878-a19f08496cb9"
Jul 22 03:08:12.362789 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:12.362673    2565 generic.go:356] "Generic (PLEG): container finished" podID="5fb16bbd-19c6-403c-8298-4f217dda4b19" containerID="426e114365336e1fb9ad169deefddbe74b234a97e744f18e6a1ba344b5a96b91" exitCode=0
Jul 22 03:08:12.362789 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:12.362769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d64cf" event={"ID":"5fb16bbd-19c6-403c-8298-4f217dda4b19","Type":"ContainerDied","Data":"426e114365336e1fb9ad169deefddbe74b234a97e744f18e6a1ba344b5a96b91"}
Jul 22 03:08:12.878790 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:12.878761    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rnn7l_1c64ef25-ed44-4731-8c1d-fba203cee498/dns-node-resolver/0.log"
Jul 22 03:08:13.448954 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:13.448931    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lptm9_a4c74ab3-d9f1-4901-932f-841e01504f79/node-ca/0.log"
Jul 22 03:08:14.238760 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:14.238734    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:08:14.238901 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:14.238812    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:08:14.238901 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:14.238821    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwrs" podUID="14410091-686c-48cd-8c74-acacf64654a8"
Jul 22 03:08:14.238901 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:14.238735    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:08:14.239012 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:14.238904    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x8mph" podUID="2e2a9ce4-415f-4f0e-b878-a19f08496cb9"
Jul 22 03:08:14.239012 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:14.238980    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnq86" podUID="8e82838b-2f39-4a24-9b24-455344248ad3"
Jul 22 03:08:14.369602 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:14.369575    2565 generic.go:356] "Generic (PLEG): container finished" podID="5fb16bbd-19c6-403c-8298-4f217dda4b19" containerID="f480dc360eb8966a4154aa7810aad8c2039c130ac420cab4921b553c3d3a534d" exitCode=0
Jul 22 03:08:14.369762 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:14.369615    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d64cf" event={"ID":"5fb16bbd-19c6-403c-8298-4f217dda4b19","Type":"ContainerDied","Data":"f480dc360eb8966a4154aa7810aad8c2039c130ac420cab4921b553c3d3a534d"}
Jul 22 03:08:16.238379 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:16.238286    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:08:16.238379 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:16.238318    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:08:16.238379 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:16.238330    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:08:16.239018 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:16.238417    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwrs" podUID="14410091-686c-48cd-8c74-acacf64654a8"
Jul 22 03:08:16.239018 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:16.238454    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x8mph" podUID="2e2a9ce4-415f-4f0e-b878-a19f08496cb9"
Jul 22 03:08:16.239018 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:16.238508    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pnq86" podUID="8e82838b-2f39-4a24-9b24-455344248ad3"
Jul 22 03:08:16.773804 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:16.773772    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret\") pod \"global-pull-secret-syncer-x8mph\" (UID: \"2e2a9ce4-415f-4f0e-b878-a19f08496cb9\") " pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:08:16.773976 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:16.773921    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:08:16.774033 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:16.773982    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret podName:2e2a9ce4-415f-4f0e-b878-a19f08496cb9 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:48.773967084 +0000 UTC m=+66.235517467 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret") pod "global-pull-secret-syncer-x8mph" (UID: "2e2a9ce4-415f-4f0e-b878-a19f08496cb9") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:08:16.874472 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:16.874440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr7qz\" (UniqueName: \"kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz\") pod \"network-check-target-jhwrs\" (UID: \"14410091-686c-48cd-8c74-acacf64654a8\") " pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:08:16.874653 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:16.874501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs\") pod \"network-metrics-daemon-pnq86\" (UID: \"8e82838b-2f39-4a24-9b24-455344248ad3\") " pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:08:16.874653 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:16.874592    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:08:16.874653 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:16.874607    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:08:16.874653 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:16.874632    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:08:16.874653 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:16.874646    2565 projected.go:196] Error preparing data for projected volume kube-api-access-pr7qz for pod openshift-network-diagnostics/network-check-target-jhwrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:08:16.874653 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:16.874652    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs podName:8e82838b-2f39-4a24-9b24-455344248ad3 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:48.874633745 +0000 UTC m=+66.336184146 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs") pod "network-metrics-daemon-pnq86" (UID: "8e82838b-2f39-4a24-9b24-455344248ad3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:08:16.874908 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:16.874693    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz podName:14410091-686c-48cd-8c74-acacf64654a8 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:48.874680619 +0000 UTC m=+66.336231016 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pr7qz" (UniqueName: "kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz") pod "network-check-target-jhwrs" (UID: "14410091-686c-48cd-8c74-acacf64654a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:08:17.769887 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.769857    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-205.ec2.internal" event="NodeReady"
Jul 22 03:08:17.770300 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.770008    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 03:08:17.826369 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.826333    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-64nw2"]
Jul 22 03:08:17.829120 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.829093    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-64nw2"
Jul 22 03:08:17.833329 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.833305    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sbs7p"]
Jul 22 03:08:17.833726 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.833699    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 03:08:17.833726 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.833709    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pc67s\""
Jul 22 03:08:17.833915 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.833709    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 03:08:17.834167 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.834140    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 03:08:17.836236 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.836219    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:17.839070 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.838857    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 03:08:17.839070 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.838873    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 03:08:17.839070 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.838882    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 03:08:17.839070 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.838935    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 03:08:17.839267 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.839226    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ms47k\""
Jul 22 03:08:17.842573 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.842534    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-64nw2"]
Jul 22 03:08:17.851811 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.851785    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sbs7p"]
Jul 22 03:08:17.854685 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.854654    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-94xck"]
Jul 22 03:08:17.856835 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.856813    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:17.859261 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.859241    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 03:08:17.859422 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.859406    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 03:08:17.859659 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.859641    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bmpz5\""
Jul 22 03:08:17.868693 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.868670    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-94xck"]
Jul 22 03:08:17.983380 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.983338    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xprv\" (UniqueName: \"kubernetes.io/projected/e5c57192-9ea2-40cd-bda6-4ef6ea7677ed-kube-api-access-9xprv\") pod \"ingress-canary-64nw2\" (UID: \"e5c57192-9ea2-40cd-bda6-4ef6ea7677ed\") " pod="openshift-ingress-canary/ingress-canary-64nw2"
Jul 22 03:08:17.983582 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.983391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knjht\" (UniqueName: \"kubernetes.io/projected/9fb47518-b064-48c7-a860-7bfb8b710eaa-kube-api-access-knjht\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:17.983582 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.983416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5c57192-9ea2-40cd-bda6-4ef6ea7677ed-cert\") pod \"ingress-canary-64nw2\" (UID: \"e5c57192-9ea2-40cd-bda6-4ef6ea7677ed\") " pod="openshift-ingress-canary/ingress-canary-64nw2"
Jul 22 03:08:17.983582 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.983436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9ee21e8-ac38-4118-837e-acbba4d2eb09-config-volume\") pod \"dns-default-94xck\" (UID: \"e9ee21e8-ac38-4118-837e-acbba4d2eb09\") " pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:17.983582 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.983465    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fb47518-b064-48c7-a860-7bfb8b710eaa-data-volume\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:17.983582 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.983516    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9fb47518-b064-48c7-a860-7bfb8b710eaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:17.983822 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.983588    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ee21e8-ac38-4118-837e-acbba4d2eb09-metrics-tls\") pod \"dns-default-94xck\" (UID: \"e9ee21e8-ac38-4118-837e-acbba4d2eb09\") " pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:17.983822 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.983614    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9ee21e8-ac38-4118-837e-acbba4d2eb09-tmp-dir\") pod \"dns-default-94xck\" (UID: \"e9ee21e8-ac38-4118-837e-acbba4d2eb09\") " pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:17.983822 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.983644    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9fb47518-b064-48c7-a860-7bfb8b710eaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:17.983822 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.983674    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt9nq\" (UniqueName: \"kubernetes.io/projected/e9ee21e8-ac38-4118-837e-acbba4d2eb09-kube-api-access-lt9nq\") pod \"dns-default-94xck\" (UID: \"e9ee21e8-ac38-4118-837e-acbba4d2eb09\") " pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:17.983822 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:17.983736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9fb47518-b064-48c7-a860-7bfb8b710eaa-crio-socket\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:18.084338 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.084259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fb47518-b064-48c7-a860-7bfb8b710eaa-data-volume\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:18.084338 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.084302    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9fb47518-b064-48c7-a860-7bfb8b710eaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:18.084338 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.084332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ee21e8-ac38-4118-837e-acbba4d2eb09-metrics-tls\") pod \"dns-default-94xck\" (UID: \"e9ee21e8-ac38-4118-837e-acbba4d2eb09\") " pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:18.084639 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:18.084432    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 03:08:18.084639 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:18.084451    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:18.084639 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.084469    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9ee21e8-ac38-4118-837e-acbba4d2eb09-tmp-dir\") pod \"dns-default-94xck\" (UID: \"e9ee21e8-ac38-4118-837e-acbba4d2eb09\") " pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:18.084639 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:18.084495    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9ee21e8-ac38-4118-837e-acbba4d2eb09-metrics-tls podName:e9ee21e8-ac38-4118-837e-acbba4d2eb09 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:18.584473565 +0000 UTC m=+36.046023953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9ee21e8-ac38-4118-837e-acbba4d2eb09-metrics-tls") pod "dns-default-94xck" (UID: "e9ee21e8-ac38-4118-837e-acbba4d2eb09") : secret "dns-default-metrics-tls" not found
Jul 22 03:08:18.084639 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:18.084515    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fb47518-b064-48c7-a860-7bfb8b710eaa-insights-runtime-extractor-tls podName:9fb47518-b064-48c7-a860-7bfb8b710eaa nodeName:}" failed. No retries permitted until 2026-07-22 03:08:18.584505305 +0000 UTC m=+36.046055693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9fb47518-b064-48c7-a860-7bfb8b710eaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sbs7p" (UID: "9fb47518-b064-48c7-a860-7bfb8b710eaa") : secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:18.084639 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.084543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9fb47518-b064-48c7-a860-7bfb8b710eaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:18.084639 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.084597    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt9nq\" (UniqueName: \"kubernetes.io/projected/e9ee21e8-ac38-4118-837e-acbba4d2eb09-kube-api-access-lt9nq\") pod \"dns-default-94xck\" (UID: \"e9ee21e8-ac38-4118-837e-acbba4d2eb09\") " pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:18.084968 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.084652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9fb47518-b064-48c7-a860-7bfb8b710eaa-crio-socket\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:18.084968 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:18.084695    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 03:08:18.084968 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.084720    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xprv\" (UniqueName: \"kubernetes.io/projected/e5c57192-9ea2-40cd-bda6-4ef6ea7677ed-kube-api-access-9xprv\") pod \"ingress-canary-64nw2\" (UID: \"e5c57192-9ea2-40cd-bda6-4ef6ea7677ed\") " pod="openshift-ingress-canary/ingress-canary-64nw2"
Jul 22 03:08:18.084968 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.084689    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9fb47518-b064-48c7-a860-7bfb8b710eaa-data-volume\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:18.084968 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.084749    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knjht\" (UniqueName: \"kubernetes.io/projected/9fb47518-b064-48c7-a860-7bfb8b710eaa-kube-api-access-knjht\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:18.084968 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:18.084771    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9fb47518-b064-48c7-a860-7bfb8b710eaa-kube-rbac-proxy-cm podName:9fb47518-b064-48c7-a860-7bfb8b710eaa nodeName:}" failed. No retries permitted until 2026-07-22 03:08:18.584760237 +0000 UTC m=+36.046310625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9fb47518-b064-48c7-a860-7bfb8b710eaa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sbs7p" (UID: "9fb47518-b064-48c7-a860-7bfb8b710eaa") : configmap "kube-rbac-proxy" not found
Jul 22 03:08:18.084968 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.084824    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9ee21e8-ac38-4118-837e-acbba4d2eb09-tmp-dir\") pod \"dns-default-94xck\" (UID: \"e9ee21e8-ac38-4118-837e-acbba4d2eb09\") " pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:18.084968 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.084872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5c57192-9ea2-40cd-bda6-4ef6ea7677ed-cert\") pod \"ingress-canary-64nw2\" (UID: \"e5c57192-9ea2-40cd-bda6-4ef6ea7677ed\") " pod="openshift-ingress-canary/ingress-canary-64nw2"
Jul 22 03:08:18.084968 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.084889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9ee21e8-ac38-4118-837e-acbba4d2eb09-config-volume\") pod \"dns-default-94xck\" (UID: \"e9ee21e8-ac38-4118-837e-acbba4d2eb09\") " pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:18.084968 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.084959    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9fb47518-b064-48c7-a860-7bfb8b710eaa-crio-socket\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:18.085366 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.085348    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e9ee21e8-ac38-4118-837e-acbba4d2eb09-config-volume\") pod \"dns-default-94xck\" (UID: \"e9ee21e8-ac38-4118-837e-acbba4d2eb09\") " pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:18.090032 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.089923    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5c57192-9ea2-40cd-bda6-4ef6ea7677ed-cert\") pod \"ingress-canary-64nw2\" (UID: \"e5c57192-9ea2-40cd-bda6-4ef6ea7677ed\") " pod="openshift-ingress-canary/ingress-canary-64nw2"
Jul 22 03:08:18.096176 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.096131    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knjht\" (UniqueName: \"kubernetes.io/projected/9fb47518-b064-48c7-a860-7bfb8b710eaa-kube-api-access-knjht\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:18.096790 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.096763    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt9nq\" (UniqueName: \"kubernetes.io/projected/e9ee21e8-ac38-4118-837e-acbba4d2eb09-kube-api-access-lt9nq\") pod \"dns-default-94xck\" (UID: \"e9ee21e8-ac38-4118-837e-acbba4d2eb09\") " pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:18.097121 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.097104    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xprv\" (UniqueName: \"kubernetes.io/projected/e5c57192-9ea2-40cd-bda6-4ef6ea7677ed-kube-api-access-9xprv\") pod \"ingress-canary-64nw2\" (UID: \"e5c57192-9ea2-40cd-bda6-4ef6ea7677ed\") " pod="openshift-ingress-canary/ingress-canary-64nw2"
Jul 22 03:08:18.143731 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.143692    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-64nw2"
Jul 22 03:08:18.238833 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.238804    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:08:18.238833 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.238829    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:08:18.241970 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.241843    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:08:18.246913 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.246728    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 03:08:18.246913 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.246761    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 03:08:18.247046 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.246953    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 03:08:18.247227 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.247209    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 03:08:18.247308 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.247292    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4gddc\""
Jul 22 03:08:18.247462 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.247416    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-glt2k\""
Jul 22 03:08:18.333986 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.333963    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-64nw2"]
Jul 22 03:08:18.337732 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:08:18.337709    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5c57192_9ea2_40cd_bda6_4ef6ea7677ed.slice/crio-843b21b4598efd75c740089cc2377c01bd6a293d532bdc74391a1a89d3e10983 WatchSource:0}: Error finding container 843b21b4598efd75c740089cc2377c01bd6a293d532bdc74391a1a89d3e10983: Status 404 returned error can't find the container with id 843b21b4598efd75c740089cc2377c01bd6a293d532bdc74391a1a89d3e10983
Jul 22 03:08:18.382454 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.382420    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d64cf" event={"ID":"5fb16bbd-19c6-403c-8298-4f217dda4b19","Type":"ContainerStarted","Data":"d724aa83b511a42493f17923fdca8ce0d61f2ae30bf9d2b1823a674a5f3f31fb"}
Jul 22 03:08:18.383614 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.383586    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-64nw2" event={"ID":"e5c57192-9ea2-40cd-bda6-4ef6ea7677ed","Type":"ContainerStarted","Data":"843b21b4598efd75c740089cc2377c01bd6a293d532bdc74391a1a89d3e10983"}
Jul 22 03:08:18.589270 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.589192    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9fb47518-b064-48c7-a860-7bfb8b710eaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:18.589270 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.589226    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ee21e8-ac38-4118-837e-acbba4d2eb09-metrics-tls\") pod \"dns-default-94xck\" (UID: \"e9ee21e8-ac38-4118-837e-acbba4d2eb09\") " pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:18.589270 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.589246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9fb47518-b064-48c7-a860-7bfb8b710eaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:18.589463 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:18.589310    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 03:08:18.589463 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:18.589336    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 03:08:18.589463 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:18.589362    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9fb47518-b064-48c7-a860-7bfb8b710eaa-kube-rbac-proxy-cm podName:9fb47518-b064-48c7-a860-7bfb8b710eaa nodeName:}" failed. No retries permitted until 2026-07-22 03:08:19.589347312 +0000 UTC m=+37.050897698 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9fb47518-b064-48c7-a860-7bfb8b710eaa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sbs7p" (UID: "9fb47518-b064-48c7-a860-7bfb8b710eaa") : configmap "kube-rbac-proxy" not found
Jul 22 03:08:18.589463 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:18.589384    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9ee21e8-ac38-4118-837e-acbba4d2eb09-metrics-tls podName:e9ee21e8-ac38-4118-837e-acbba4d2eb09 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:19.589370925 +0000 UTC m=+37.050921309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9ee21e8-ac38-4118-837e-acbba4d2eb09-metrics-tls") pod "dns-default-94xck" (UID: "e9ee21e8-ac38-4118-837e-acbba4d2eb09") : secret "dns-default-metrics-tls" not found
Jul 22 03:08:18.589463 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:18.589336    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:18.589463 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:18.589409    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fb47518-b064-48c7-a860-7bfb8b710eaa-insights-runtime-extractor-tls podName:9fb47518-b064-48c7-a860-7bfb8b710eaa nodeName:}" failed. No retries permitted until 2026-07-22 03:08:19.589403338 +0000 UTC m=+37.050953721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9fb47518-b064-48c7-a860-7bfb8b710eaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sbs7p" (UID: "9fb47518-b064-48c7-a860-7bfb8b710eaa") : secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:18.607029 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.607002    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hwtqv"]
Jul 22 03:08:18.608939 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.608924    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hwtqv"
Jul 22 03:08:18.611574 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.611541    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 22 03:08:18.611772 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.611749    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-g7jq4\""
Jul 22 03:08:18.611912 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.611896    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 22 03:08:18.622722 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.622702    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hwtqv"]
Jul 22 03:08:18.690395 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.690360    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69gk8\" (UniqueName: \"kubernetes.io/projected/9630dd09-b625-41ff-8f43-18c7713a3f56-kube-api-access-69gk8\") pod \"migrator-7cc9c7ffd7-hwtqv\" (UID: \"9630dd09-b625-41ff-8f43-18c7713a3f56\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hwtqv"
Jul 22 03:08:18.791479 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.791446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69gk8\" (UniqueName: \"kubernetes.io/projected/9630dd09-b625-41ff-8f43-18c7713a3f56-kube-api-access-69gk8\") pod \"migrator-7cc9c7ffd7-hwtqv\" (UID: \"9630dd09-b625-41ff-8f43-18c7713a3f56\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hwtqv"
Jul 22 03:08:18.801146 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.801126    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69gk8\" (UniqueName: \"kubernetes.io/projected/9630dd09-b625-41ff-8f43-18c7713a3f56-kube-api-access-69gk8\") pod \"migrator-7cc9c7ffd7-hwtqv\" (UID: \"9630dd09-b625-41ff-8f43-18c7713a3f56\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hwtqv"
Jul 22 03:08:18.918005 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:18.917921    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hwtqv"
Jul 22 03:08:19.056036 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:19.056004    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hwtqv"]
Jul 22 03:08:19.063509 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:08:19.063481    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9630dd09_b625_41ff_8f43_18c7713a3f56.slice/crio-d2e8b200d6cfa9d8d2e44bf128032d91546896013c06ee26ef60f5e230441eac WatchSource:0}: Error finding container d2e8b200d6cfa9d8d2e44bf128032d91546896013c06ee26ef60f5e230441eac: Status 404 returned error can't find the container with id d2e8b200d6cfa9d8d2e44bf128032d91546896013c06ee26ef60f5e230441eac
Jul 22 03:08:19.389698 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:19.389604    2565 generic.go:356] "Generic (PLEG): container finished" podID="5fb16bbd-19c6-403c-8298-4f217dda4b19" containerID="d724aa83b511a42493f17923fdca8ce0d61f2ae30bf9d2b1823a674a5f3f31fb" exitCode=0
Jul 22 03:08:19.389861 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:19.389710    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d64cf" event={"ID":"5fb16bbd-19c6-403c-8298-4f217dda4b19","Type":"ContainerDied","Data":"d724aa83b511a42493f17923fdca8ce0d61f2ae30bf9d2b1823a674a5f3f31fb"}
Jul 22 03:08:19.390913 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:19.390887    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hwtqv" event={"ID":"9630dd09-b625-41ff-8f43-18c7713a3f56","Type":"ContainerStarted","Data":"d2e8b200d6cfa9d8d2e44bf128032d91546896013c06ee26ef60f5e230441eac"}
Jul 22 03:08:19.600167 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:19.600126    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9fb47518-b064-48c7-a860-7bfb8b710eaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:19.600167 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:19.600170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ee21e8-ac38-4118-837e-acbba4d2eb09-metrics-tls\") pod \"dns-default-94xck\" (UID: \"e9ee21e8-ac38-4118-837e-acbba4d2eb09\") " pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:19.600404 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:19.600206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9fb47518-b064-48c7-a860-7bfb8b710eaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:19.600404 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:19.600293    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 03:08:19.600404 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:19.600321    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:19.600404 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:19.600346    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9fb47518-b064-48c7-a860-7bfb8b710eaa-kube-rbac-proxy-cm podName:9fb47518-b064-48c7-a860-7bfb8b710eaa nodeName:}" failed. No retries permitted until 2026-07-22 03:08:21.600332418 +0000 UTC m=+39.061882802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9fb47518-b064-48c7-a860-7bfb8b710eaa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sbs7p" (UID: "9fb47518-b064-48c7-a860-7bfb8b710eaa") : configmap "kube-rbac-proxy" not found
Jul 22 03:08:19.600404 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:19.600391    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fb47518-b064-48c7-a860-7bfb8b710eaa-insights-runtime-extractor-tls podName:9fb47518-b064-48c7-a860-7bfb8b710eaa nodeName:}" failed. No retries permitted until 2026-07-22 03:08:21.600369999 +0000 UTC m=+39.061920386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9fb47518-b064-48c7-a860-7bfb8b710eaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sbs7p" (UID: "9fb47518-b064-48c7-a860-7bfb8b710eaa") : secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:19.600741 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:19.600455    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 03:08:19.600741 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:19.600491    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9ee21e8-ac38-4118-837e-acbba4d2eb09-metrics-tls podName:e9ee21e8-ac38-4118-837e-acbba4d2eb09 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:21.600478694 +0000 UTC m=+39.062029079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9ee21e8-ac38-4118-837e-acbba4d2eb09-metrics-tls") pod "dns-default-94xck" (UID: "e9ee21e8-ac38-4118-837e-acbba4d2eb09") : secret "dns-default-metrics-tls" not found
Jul 22 03:08:20.397057 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:20.397012    2565 generic.go:356] "Generic (PLEG): container finished" podID="5fb16bbd-19c6-403c-8298-4f217dda4b19" containerID="b3100f5edee86d9e536b92dc8dc9d4f7ea368293418e9849b54a644a31ca328d" exitCode=0
Jul 22 03:08:20.397540 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:20.397091    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d64cf" event={"ID":"5fb16bbd-19c6-403c-8298-4f217dda4b19","Type":"ContainerDied","Data":"b3100f5edee86d9e536b92dc8dc9d4f7ea368293418e9849b54a644a31ca328d"}
Jul 22 03:08:21.403290 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:21.403199    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d64cf" event={"ID":"5fb16bbd-19c6-403c-8298-4f217dda4b19","Type":"ContainerStarted","Data":"c0183c56ae969fb862425482cf7adfa4c671458c5fa2d45ac8c15c1ddcdb72de"}
Jul 22 03:08:21.404840 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:21.404659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-64nw2" event={"ID":"e5c57192-9ea2-40cd-bda6-4ef6ea7677ed","Type":"ContainerStarted","Data":"012952eca18beaedd0296d000e225c4d8e55da27d8b0f49a9e2dd21699217232"}
Jul 22 03:08:21.406255 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:21.406230    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hwtqv" event={"ID":"9630dd09-b625-41ff-8f43-18c7713a3f56","Type":"ContainerStarted","Data":"b8d996622a29b006eb28d3c0646723f00daf65944e7f82f87f7c22879ed51db3"}
Jul 22 03:08:21.406356 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:21.406277    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hwtqv" event={"ID":"9630dd09-b625-41ff-8f43-18c7713a3f56","Type":"ContainerStarted","Data":"8efc48ada7bdf3bda400aa2912ad190f72d77743bf8b51d0258bb8596eca40e9"}
Jul 22 03:08:21.452135 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:21.452059    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d64cf" podStartSLOduration=8.961132353 podStartE2EDuration="38.45204453s" totalImagesPullingTime="29.490912177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:21.449407039 +0000 UTC m=+38.910957445" watchObservedRunningTime="2026-07-22 03:08:21.45204453 +0000 UTC m=+38.913594936"
Jul 22 03:08:21.492421 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:21.492378    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-64nw2" podStartSLOduration=1.849967311 podStartE2EDuration="4.492362614s" totalImagesPullingTime="2.642395303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:21.491240064 +0000 UTC m=+38.952790470" watchObservedRunningTime="2026-07-22 03:08:21.492362614 +0000 UTC m=+38.953912998"
Jul 22 03:08:21.518280 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:21.518238    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hwtqv" podStartSLOduration=1.5997382390000001 podStartE2EDuration="3.518222933s" totalImagesPullingTime="1.918484694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:21.517470878 +0000 UTC m=+38.979021286" watchObservedRunningTime="2026-07-22 03:08:21.518222933 +0000 UTC m=+38.979773339"
Jul 22 03:08:21.616439 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:21.616398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9fb47518-b064-48c7-a860-7bfb8b710eaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:21.616439 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:21.616437    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ee21e8-ac38-4118-837e-acbba4d2eb09-metrics-tls\") pod \"dns-default-94xck\" (UID: \"e9ee21e8-ac38-4118-837e-acbba4d2eb09\") " pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:21.616693 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:21.616457    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9fb47518-b064-48c7-a860-7bfb8b710eaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:21.616693 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:21.616547    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 03:08:21.616693 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:21.616549    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 03:08:21.616693 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:21.616551    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:21.616693 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:21.616627    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9fb47518-b064-48c7-a860-7bfb8b710eaa-kube-rbac-proxy-cm podName:9fb47518-b064-48c7-a860-7bfb8b710eaa nodeName:}" failed. No retries permitted until 2026-07-22 03:08:25.616615384 +0000 UTC m=+43.078165769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9fb47518-b064-48c7-a860-7bfb8b710eaa-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sbs7p" (UID: "9fb47518-b064-48c7-a860-7bfb8b710eaa") : configmap "kube-rbac-proxy" not found
Jul 22 03:08:21.616693 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:21.616641    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9ee21e8-ac38-4118-837e-acbba4d2eb09-metrics-tls podName:e9ee21e8-ac38-4118-837e-acbba4d2eb09 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:25.616635071 +0000 UTC m=+43.078185454 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9ee21e8-ac38-4118-837e-acbba4d2eb09-metrics-tls") pod "dns-default-94xck" (UID: "e9ee21e8-ac38-4118-837e-acbba4d2eb09") : secret "dns-default-metrics-tls" not found
Jul 22 03:08:21.616693 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:21.616651    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fb47518-b064-48c7-a860-7bfb8b710eaa-insights-runtime-extractor-tls podName:9fb47518-b064-48c7-a860-7bfb8b710eaa nodeName:}" failed. No retries permitted until 2026-07-22 03:08:25.616645103 +0000 UTC m=+43.078195487 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9fb47518-b064-48c7-a860-7bfb8b710eaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sbs7p" (UID: "9fb47518-b064-48c7-a860-7bfb8b710eaa") : secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:25.649877 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:25.649835    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9fb47518-b064-48c7-a860-7bfb8b710eaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:25.649877 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:25.649875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ee21e8-ac38-4118-837e-acbba4d2eb09-metrics-tls\") pod \"dns-default-94xck\" (UID: \"e9ee21e8-ac38-4118-837e-acbba4d2eb09\") " pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:25.650387 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:25.649895    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9fb47518-b064-48c7-a860-7bfb8b710eaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:25.650387 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:25.649998    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 03:08:25.650387 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:25.650060    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9ee21e8-ac38-4118-837e-acbba4d2eb09-metrics-tls podName:e9ee21e8-ac38-4118-837e-acbba4d2eb09 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:33.650043693 +0000 UTC m=+51.111594077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e9ee21e8-ac38-4118-837e-acbba4d2eb09-metrics-tls") pod "dns-default-94xck" (UID: "e9ee21e8-ac38-4118-837e-acbba4d2eb09") : secret "dns-default-metrics-tls" not found
Jul 22 03:08:25.650387 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:25.650000    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:25.650387 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:08:25.650093    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fb47518-b064-48c7-a860-7bfb8b710eaa-insights-runtime-extractor-tls podName:9fb47518-b064-48c7-a860-7bfb8b710eaa nodeName:}" failed. No retries permitted until 2026-07-22 03:08:33.650086954 +0000 UTC m=+51.111637339 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9fb47518-b064-48c7-a860-7bfb8b710eaa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sbs7p" (UID: "9fb47518-b064-48c7-a860-7bfb8b710eaa") : secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:25.650387 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:25.650358    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9fb47518-b064-48c7-a860-7bfb8b710eaa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:33.703792 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:33.703752    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9fb47518-b064-48c7-a860-7bfb8b710eaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:33.703792 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:33.703791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ee21e8-ac38-4118-837e-acbba4d2eb09-metrics-tls\") pod \"dns-default-94xck\" (UID: \"e9ee21e8-ac38-4118-837e-acbba4d2eb09\") " pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:33.707540 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:33.707511    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9fb47518-b064-48c7-a860-7bfb8b710eaa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sbs7p\" (UID: \"9fb47518-b064-48c7-a860-7bfb8b710eaa\") " pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:33.707669 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:33.707539    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e9ee21e8-ac38-4118-837e-acbba4d2eb09-metrics-tls\") pod \"dns-default-94xck\" (UID: \"e9ee21e8-ac38-4118-837e-acbba4d2eb09\") " pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:33.748933 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:33.748904    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sbs7p"
Jul 22 03:08:33.768061 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:33.768041    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:33.926274 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:33.926244    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sbs7p"]
Jul 22 03:08:33.949448 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:33.949424    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-94xck"]
Jul 22 03:08:33.952093 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:08:33.952065    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ee21e8_ac38_4118_837e_acbba4d2eb09.slice/crio-3089a87a2f526c97c7a0a70229cfa94f73413d5198cbe292b1b8f44ba02a1638 WatchSource:0}: Error finding container 3089a87a2f526c97c7a0a70229cfa94f73413d5198cbe292b1b8f44ba02a1638: Status 404 returned error can't find the container with id 3089a87a2f526c97c7a0a70229cfa94f73413d5198cbe292b1b8f44ba02a1638
Jul 22 03:08:34.435160 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:34.435120    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-94xck" event={"ID":"e9ee21e8-ac38-4118-837e-acbba4d2eb09","Type":"ContainerStarted","Data":"3089a87a2f526c97c7a0a70229cfa94f73413d5198cbe292b1b8f44ba02a1638"}
Jul 22 03:08:34.436292 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:34.436258    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sbs7p" event={"ID":"9fb47518-b064-48c7-a860-7bfb8b710eaa","Type":"ContainerStarted","Data":"ce460d8c9d42d6cae6f4478c47e315857922386c958e7b87839a4ac92e43141f"}
Jul 22 03:08:36.443524 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:36.443490    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-94xck" event={"ID":"e9ee21e8-ac38-4118-837e-acbba4d2eb09","Type":"ContainerStarted","Data":"d958ccb4a28c6f136b48b46144e4f043bc90ad089d2470bccabab4c6799715d9"}
Jul 22 03:08:36.443929 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:36.443543    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-94xck" event={"ID":"e9ee21e8-ac38-4118-837e-acbba4d2eb09","Type":"ContainerStarted","Data":"b38576e8bede82d034223146fb976fce381e2ef7e485065338d88544859002d9"}
Jul 22 03:08:36.443929 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:36.443588    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:36.462883 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:36.462835    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-94xck" podStartSLOduration=17.265809271 podStartE2EDuration="19.462813808s" totalImagesPullingTime="2.197004537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:36.461711402 +0000 UTC m=+53.923261834" watchObservedRunningTime="2026-07-22 03:08:36.462813808 +0000 UTC m=+53.924364214"
Jul 22 03:08:39.454458 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:39.454423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sbs7p" event={"ID":"9fb47518-b064-48c7-a860-7bfb8b710eaa","Type":"ContainerStarted","Data":"b5983aee56dcebb5e8cc1983542aa90cc9e1c783e47c44aea2c1061b6de18b43"}
Jul 22 03:08:42.380758 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:42.380729    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wl9bk"
Jul 22 03:08:42.940213 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:42.940181    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589b6769c8-rcv8j"]
Jul 22 03:08:42.964386 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:42.964362    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"]
Jul 22 03:08:42.964530 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:42.964508    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589b6769c8-rcv8j"
Jul 22 03:08:42.968842 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:42.968819    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 22 03:08:42.969015 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:42.968880    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 22 03:08:42.969015 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:42.968885    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jw7gn\""
Jul 22 03:08:42.969015 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:42.968998    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 03:08:42.969264 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:42.969092    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 22 03:08:42.986551 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:42.986522    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589b6769c8-rcv8j"]
Jul 22 03:08:42.986551 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:42.986535    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:42.986691 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:42.986581    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"]
Jul 22 03:08:42.989535 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:42.989519    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 22 03:08:42.989654 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:42.989581    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 22 03:08:42.989858 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:42.989842    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 22 03:08:42.990093 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:42.990078    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 22 03:08:43.072752 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.072713    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/48061af9-875e-4d6c-a88b-c4406bd48cbb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54c6cc4df8-54vtq\" (UID: \"48061af9-875e-4d6c-a88b-c4406bd48cbb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.072913 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.072764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qn7v\" (UniqueName: \"kubernetes.io/projected/4703344a-8d62-419e-b672-f658acd1994c-kube-api-access-7qn7v\") pod \"managed-serviceaccount-addon-agent-589b6769c8-rcv8j\" (UID: \"4703344a-8d62-419e-b672-f658acd1994c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589b6769c8-rcv8j"
Jul 22 03:08:43.072913 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.072845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/48061af9-875e-4d6c-a88b-c4406bd48cbb-ca\") pod \"cluster-proxy-proxy-agent-54c6cc4df8-54vtq\" (UID: \"48061af9-875e-4d6c-a88b-c4406bd48cbb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.072913 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.072871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/48061af9-875e-4d6c-a88b-c4406bd48cbb-hub\") pod \"cluster-proxy-proxy-agent-54c6cc4df8-54vtq\" (UID: \"48061af9-875e-4d6c-a88b-c4406bd48cbb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.072913 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.072909    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lxq2\" (UniqueName: \"kubernetes.io/projected/48061af9-875e-4d6c-a88b-c4406bd48cbb-kube-api-access-5lxq2\") pod \"cluster-proxy-proxy-agent-54c6cc4df8-54vtq\" (UID: \"48061af9-875e-4d6c-a88b-c4406bd48cbb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.073134 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.073000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48061af9-875e-4d6c-a88b-c4406bd48cbb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54c6cc4df8-54vtq\" (UID: \"48061af9-875e-4d6c-a88b-c4406bd48cbb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.073134 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.073036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/48061af9-875e-4d6c-a88b-c4406bd48cbb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54c6cc4df8-54vtq\" (UID: \"48061af9-875e-4d6c-a88b-c4406bd48cbb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.073134 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.073072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4703344a-8d62-419e-b672-f658acd1994c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-589b6769c8-rcv8j\" (UID: \"4703344a-8d62-419e-b672-f658acd1994c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589b6769c8-rcv8j"
Jul 22 03:08:43.173693 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.173660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48061af9-875e-4d6c-a88b-c4406bd48cbb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54c6cc4df8-54vtq\" (UID: \"48061af9-875e-4d6c-a88b-c4406bd48cbb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.173860 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.173695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/48061af9-875e-4d6c-a88b-c4406bd48cbb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54c6cc4df8-54vtq\" (UID: \"48061af9-875e-4d6c-a88b-c4406bd48cbb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.173860 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.173721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4703344a-8d62-419e-b672-f658acd1994c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-589b6769c8-rcv8j\" (UID: \"4703344a-8d62-419e-b672-f658acd1994c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589b6769c8-rcv8j"
Jul 22 03:08:43.173860 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.173748    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/48061af9-875e-4d6c-a88b-c4406bd48cbb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54c6cc4df8-54vtq\" (UID: \"48061af9-875e-4d6c-a88b-c4406bd48cbb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.173860 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.173843    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qn7v\" (UniqueName: \"kubernetes.io/projected/4703344a-8d62-419e-b672-f658acd1994c-kube-api-access-7qn7v\") pod \"managed-serviceaccount-addon-agent-589b6769c8-rcv8j\" (UID: \"4703344a-8d62-419e-b672-f658acd1994c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589b6769c8-rcv8j"
Jul 22 03:08:43.174085 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.173902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/48061af9-875e-4d6c-a88b-c4406bd48cbb-ca\") pod \"cluster-proxy-proxy-agent-54c6cc4df8-54vtq\" (UID: \"48061af9-875e-4d6c-a88b-c4406bd48cbb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.174085 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.173927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/48061af9-875e-4d6c-a88b-c4406bd48cbb-hub\") pod \"cluster-proxy-proxy-agent-54c6cc4df8-54vtq\" (UID: \"48061af9-875e-4d6c-a88b-c4406bd48cbb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.174085 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.173964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lxq2\" (UniqueName: \"kubernetes.io/projected/48061af9-875e-4d6c-a88b-c4406bd48cbb-kube-api-access-5lxq2\") pod \"cluster-proxy-proxy-agent-54c6cc4df8-54vtq\" (UID: \"48061af9-875e-4d6c-a88b-c4406bd48cbb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.174435 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.174407    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/48061af9-875e-4d6c-a88b-c4406bd48cbb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54c6cc4df8-54vtq\" (UID: \"48061af9-875e-4d6c-a88b-c4406bd48cbb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.176357 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.176330    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/48061af9-875e-4d6c-a88b-c4406bd48cbb-hub\") pod \"cluster-proxy-proxy-agent-54c6cc4df8-54vtq\" (UID: \"48061af9-875e-4d6c-a88b-c4406bd48cbb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.176446 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.176354    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/48061af9-875e-4d6c-a88b-c4406bd48cbb-ca\") pod \"cluster-proxy-proxy-agent-54c6cc4df8-54vtq\" (UID: \"48061af9-875e-4d6c-a88b-c4406bd48cbb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.176446 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.176385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48061af9-875e-4d6c-a88b-c4406bd48cbb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54c6cc4df8-54vtq\" (UID: \"48061af9-875e-4d6c-a88b-c4406bd48cbb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.176664 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.176643    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/48061af9-875e-4d6c-a88b-c4406bd48cbb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54c6cc4df8-54vtq\" (UID: \"48061af9-875e-4d6c-a88b-c4406bd48cbb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.176840 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.176826    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4703344a-8d62-419e-b672-f658acd1994c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-589b6769c8-rcv8j\" (UID: \"4703344a-8d62-419e-b672-f658acd1994c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589b6769c8-rcv8j"
Jul 22 03:08:43.190985 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.190936    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lxq2\" (UniqueName: \"kubernetes.io/projected/48061af9-875e-4d6c-a88b-c4406bd48cbb-kube-api-access-5lxq2\") pod \"cluster-proxy-proxy-agent-54c6cc4df8-54vtq\" (UID: \"48061af9-875e-4d6c-a88b-c4406bd48cbb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.191214 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.191194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qn7v\" (UniqueName: \"kubernetes.io/projected/4703344a-8d62-419e-b672-f658acd1994c-kube-api-access-7qn7v\") pod \"managed-serviceaccount-addon-agent-589b6769c8-rcv8j\" (UID: \"4703344a-8d62-419e-b672-f658acd1994c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589b6769c8-rcv8j"
Jul 22 03:08:43.290688 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.290664    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589b6769c8-rcv8j"
Jul 22 03:08:43.297836 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.297815    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"
Jul 22 03:08:43.590467 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.590437    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq"]
Jul 22 03:08:43.593499 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:08:43.593477    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48061af9_875e_4d6c_a88b_c4406bd48cbb.slice/crio-b950f8e00650939bf06005f3d8c0359d9f09628cde830385f5854a97b4545c79 WatchSource:0}: Error finding container b950f8e00650939bf06005f3d8c0359d9f09628cde830385f5854a97b4545c79: Status 404 returned error can't find the container with id b950f8e00650939bf06005f3d8c0359d9f09628cde830385f5854a97b4545c79
Jul 22 03:08:43.597585 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:43.597527    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589b6769c8-rcv8j"]
Jul 22 03:08:43.600534 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:08:43.600510    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4703344a_8d62_419e_b672_f658acd1994c.slice/crio-5197ed14d60762f31c06f6e9bb5edecaf4597573a7342138b3eef5d67b8806eb WatchSource:0}: Error finding container 5197ed14d60762f31c06f6e9bb5edecaf4597573a7342138b3eef5d67b8806eb: Status 404 returned error can't find the container with id 5197ed14d60762f31c06f6e9bb5edecaf4597573a7342138b3eef5d67b8806eb
Jul 22 03:08:44.472543 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:44.472507    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq" event={"ID":"48061af9-875e-4d6c-a88b-c4406bd48cbb","Type":"ContainerStarted","Data":"b950f8e00650939bf06005f3d8c0359d9f09628cde830385f5854a97b4545c79"}
Jul 22 03:08:44.473929 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:44.473899    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589b6769c8-rcv8j" event={"ID":"4703344a-8d62-419e-b672-f658acd1994c","Type":"ContainerStarted","Data":"5197ed14d60762f31c06f6e9bb5edecaf4597573a7342138b3eef5d67b8806eb"}
Jul 22 03:08:44.475868 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:44.475831    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sbs7p" event={"ID":"9fb47518-b064-48c7-a860-7bfb8b710eaa","Type":"ContainerStarted","Data":"9a1cec0e146d394957b0a5c8a571aac9c352fc3f4b0dbf8228e31b89dc8c3033"}
Jul 22 03:08:46.449068 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:46.449034    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-94xck"
Jul 22 03:08:48.820531 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:48.820111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret\") pod \"global-pull-secret-syncer-x8mph\" (UID: \"2e2a9ce4-415f-4f0e-b878-a19f08496cb9\") " pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:08:48.823201 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:48.823175    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 03:08:48.832754 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:48.832730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e2a9ce4-415f-4f0e-b878-a19f08496cb9-original-pull-secret\") pod \"global-pull-secret-syncer-x8mph\" (UID: \"2e2a9ce4-415f-4f0e-b878-a19f08496cb9\") " pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:08:48.877108 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:48.877076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x8mph"
Jul 22 03:08:48.921297 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:48.921261    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs\") pod \"network-metrics-daemon-pnq86\" (UID: \"8e82838b-2f39-4a24-9b24-455344248ad3\") " pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:08:48.921445 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:48.921323    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr7qz\" (UniqueName: \"kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz\") pod \"network-check-target-jhwrs\" (UID: \"14410091-686c-48cd-8c74-acacf64654a8\") " pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:08:48.924294 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:48.924267    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 03:08:48.924415 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:48.924267    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 03:08:48.934877 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:48.934851    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e82838b-2f39-4a24-9b24-455344248ad3-metrics-certs\") pod \"network-metrics-daemon-pnq86\" (UID: \"8e82838b-2f39-4a24-9b24-455344248ad3\") " pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:08:48.934982 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:48.934970    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 03:08:48.945395 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:48.945373    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr7qz\" (UniqueName: \"kubernetes.io/projected/14410091-686c-48cd-8c74-acacf64654a8-kube-api-access-pr7qz\") pod \"network-check-target-jhwrs\" (UID: \"14410091-686c-48cd-8c74-acacf64654a8\") " pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:08:49.054121 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:49.054052    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x8mph"]
Jul 22 03:08:49.056631 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:08:49.056604    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e2a9ce4_415f_4f0e_b878_a19f08496cb9.slice/crio-f22861d777270f3b1768ed9b6f89d870eac3bb268eaf6c4e2a05517f68905a61 WatchSource:0}: Error finding container f22861d777270f3b1768ed9b6f89d870eac3bb268eaf6c4e2a05517f68905a61: Status 404 returned error can't find the container with id f22861d777270f3b1768ed9b6f89d870eac3bb268eaf6c4e2a05517f68905a61
Jul 22 03:08:49.165408 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:49.165388    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4gddc\""
Jul 22 03:08:49.171769 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:49.171749    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pnq86"
Jul 22 03:08:49.171898 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:49.171881    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-glt2k\""
Jul 22 03:08:49.179727 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:49.179700    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:08:49.312026 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:49.311913    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pnq86"]
Jul 22 03:08:49.317901 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:08:49.317876    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e82838b_2f39_4a24_9b24_455344248ad3.slice/crio-5f21dae27442e3e187d677993657c2ecde6fdcc53724f270be5c22ed55dbdd5e WatchSource:0}: Error finding container 5f21dae27442e3e187d677993657c2ecde6fdcc53724f270be5c22ed55dbdd5e: Status 404 returned error can't find the container with id 5f21dae27442e3e187d677993657c2ecde6fdcc53724f270be5c22ed55dbdd5e
Jul 22 03:08:49.330461 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:49.330407    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jhwrs"]
Jul 22 03:08:49.333388 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:08:49.333367    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14410091_686c_48cd_8c74_acacf64654a8.slice/crio-2cdeac65a0f2968e2db428addb8d8c3894e623dc739598d477204d05dabbe45d WatchSource:0}: Error finding container 2cdeac65a0f2968e2db428addb8d8c3894e623dc739598d477204d05dabbe45d: Status 404 returned error can't find the container with id 2cdeac65a0f2968e2db428addb8d8c3894e623dc739598d477204d05dabbe45d
Jul 22 03:08:49.495009 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:49.494974    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sbs7p" event={"ID":"9fb47518-b064-48c7-a860-7bfb8b710eaa","Type":"ContainerStarted","Data":"2b4fb0d34c8dadd207bf8f3ef8ff363a94eac0f1230855abc1b7a262e32a81c9"}
Jul 22 03:08:49.496553 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:49.496530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x8mph" event={"ID":"2e2a9ce4-415f-4f0e-b878-a19f08496cb9","Type":"ContainerStarted","Data":"f22861d777270f3b1768ed9b6f89d870eac3bb268eaf6c4e2a05517f68905a61"}
Jul 22 03:08:49.498842 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:49.498817    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq" event={"ID":"48061af9-875e-4d6c-a88b-c4406bd48cbb","Type":"ContainerStarted","Data":"3b905c67bb289f732a1059b171243abf00b73b3d62b5ba8fc67a06f9aa504779"}
Jul 22 03:08:49.498956 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:49.498857    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq" event={"ID":"48061af9-875e-4d6c-a88b-c4406bd48cbb","Type":"ContainerStarted","Data":"c6d557dab4344e648947b329253c85031c3489b529b7cc4dfee6edc998cb65d6"}
Jul 22 03:08:49.498956 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:49.498874    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq" event={"ID":"48061af9-875e-4d6c-a88b-c4406bd48cbb","Type":"ContainerStarted","Data":"cbd8ba235155ff3a5652379a3b490a6b5e3dda8b05acc2321b487118050ca4b4"}
Jul 22 03:08:49.500142 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:49.500115    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jhwrs" event={"ID":"14410091-686c-48cd-8c74-acacf64654a8","Type":"ContainerStarted","Data":"2cdeac65a0f2968e2db428addb8d8c3894e623dc739598d477204d05dabbe45d"}
Jul 22 03:08:49.501527 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:49.501500    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pnq86" event={"ID":"8e82838b-2f39-4a24-9b24-455344248ad3","Type":"ContainerStarted","Data":"5f21dae27442e3e187d677993657c2ecde6fdcc53724f270be5c22ed55dbdd5e"}
Jul 22 03:08:49.578976 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:49.578925    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54c6cc4df8-54vtq" podStartSLOduration=2.178697491 podStartE2EDuration="7.578896849s" totalImagesPullingTime="5.400199358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:08:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:49.573776601 +0000 UTC m=+67.035327008" watchObservedRunningTime="2026-07-22 03:08:49.578896849 +0000 UTC m=+67.040447256"
Jul 22 03:08:49.579219 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:49.579197    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sbs7p" podStartSLOduration=17.710789721 podStartE2EDuration="32.579188425s" totalImagesPullingTime="14.868398704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:08:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:49.531017913 +0000 UTC m=+66.992568319" watchObservedRunningTime="2026-07-22 03:08:49.579188425 +0000 UTC m=+67.040738831"
Jul 22 03:08:51.513960 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:51.513912    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pnq86" event={"ID":"8e82838b-2f39-4a24-9b24-455344248ad3","Type":"ContainerStarted","Data":"d5ee17e048cdb2e2e156b2380f35cf3f170aeb55ee9fca9b7ca715554fc93039"}
Jul 22 03:08:51.514698 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:51.513973    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pnq86" event={"ID":"8e82838b-2f39-4a24-9b24-455344248ad3","Type":"ContainerStarted","Data":"e92b75ea8ed7dad07e1b7624a117aafaa5d714967c0d7f445d4f64cd5f7b1cb3"}
Jul 22 03:08:51.540930 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:51.540859    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pnq86" podStartSLOduration=67.018584195 podStartE2EDuration="1m8.540837136s" totalImagesPullingTime="1.522252941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:51.539347708 +0000 UTC m=+69.000898119" watchObservedRunningTime="2026-07-22 03:08:51.540837136 +0000 UTC m=+69.002387544"
Jul 22 03:08:54.525526 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:54.525488    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jhwrs" event={"ID":"14410091-686c-48cd-8c74-acacf64654a8","Type":"ContainerStarted","Data":"9db9752f42b0ddc90347b31d2ea0e8fa573417ebb3857e3c754b9fd2ae626e50"}
Jul 22 03:08:54.525962 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:54.525607    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:08:54.526890 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:54.526872    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x8mph" event={"ID":"2e2a9ce4-415f-4f0e-b878-a19f08496cb9","Type":"ContainerStarted","Data":"9cdda7af7f7767da90585c243a041393587b8e79d942339fdf1ddca379bb4f17"}
Jul 22 03:08:54.541760 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:54.541718    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jhwrs" podStartSLOduration=66.966926567 podStartE2EDuration="1m11.541704285s" totalImagesPullingTime="4.574777718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:54.541635356 +0000 UTC m=+72.003185779" watchObservedRunningTime="2026-07-22 03:08:54.541704285 +0000 UTC m=+72.003254694"
Jul 22 03:08:54.561077 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:54.561028    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x8mph" podStartSLOduration=66.706694692 podStartE2EDuration="1m11.561014469s" totalImagesPullingTime="4.854319777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:54.560411198 +0000 UTC m=+72.021961605" watchObservedRunningTime="2026-07-22 03:08:54.561014469 +0000 UTC m=+72.022564854"
Jul 22 03:08:56.265016 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.264984    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4gttm"]
Jul 22 03:08:56.267416 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.267395    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.271179 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.271150    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 03:08:56.271416 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.271190    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 03:08:56.271416 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.271221    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4pp55\""
Jul 22 03:08:56.271921 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.271908    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 03:08:56.271971 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.271950    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 03:08:56.272693 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.272672    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 03:08:56.272794 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.272784    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 03:08:56.373022 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.372986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e48eb12-33a7-4554-88b4-38bb5d76fe50-sys\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.373022 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.373018    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e48eb12-33a7-4554-88b4-38bb5d76fe50-node-exporter-accelerators-collector-config\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.373281 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.373041    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e48eb12-33a7-4554-88b4-38bb5d76fe50-metrics-client-ca\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.373281 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.373104    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e48eb12-33a7-4554-88b4-38bb5d76fe50-node-exporter-tls\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.373281 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.373132    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e48eb12-33a7-4554-88b4-38bb5d76fe50-node-exporter-wtmp\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.373281 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.373154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e48eb12-33a7-4554-88b4-38bb5d76fe50-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.373281 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.373176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e48eb12-33a7-4554-88b4-38bb5d76fe50-node-exporter-textfile\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.373281 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.373192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e48eb12-33a7-4554-88b4-38bb5d76fe50-root\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.373281 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.373216    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5j6j\" (UniqueName: \"kubernetes.io/projected/2e48eb12-33a7-4554-88b4-38bb5d76fe50-kube-api-access-z5j6j\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.474465 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.474411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e48eb12-33a7-4554-88b4-38bb5d76fe50-sys\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.474659 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.474464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e48eb12-33a7-4554-88b4-38bb5d76fe50-node-exporter-accelerators-collector-config\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.474659 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.474511    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e48eb12-33a7-4554-88b4-38bb5d76fe50-metrics-client-ca\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.474659 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.474530    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e48eb12-33a7-4554-88b4-38bb5d76fe50-sys\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.474659 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.474541    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e48eb12-33a7-4554-88b4-38bb5d76fe50-node-exporter-tls\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.474659 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.474629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e48eb12-33a7-4554-88b4-38bb5d76fe50-node-exporter-wtmp\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.474659 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.474659    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e48eb12-33a7-4554-88b4-38bb5d76fe50-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.474945 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.474685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e48eb12-33a7-4554-88b4-38bb5d76fe50-node-exporter-textfile\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.474945 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.474707    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e48eb12-33a7-4554-88b4-38bb5d76fe50-root\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.474945 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.474738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5j6j\" (UniqueName: \"kubernetes.io/projected/2e48eb12-33a7-4554-88b4-38bb5d76fe50-kube-api-access-z5j6j\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.474945 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.474813    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e48eb12-33a7-4554-88b4-38bb5d76fe50-root\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.474945 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.474826    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e48eb12-33a7-4554-88b4-38bb5d76fe50-node-exporter-wtmp\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.475173 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.475112    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e48eb12-33a7-4554-88b4-38bb5d76fe50-node-exporter-textfile\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.475173 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.475148    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e48eb12-33a7-4554-88b4-38bb5d76fe50-node-exporter-accelerators-collector-config\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.475237 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.475205    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e48eb12-33a7-4554-88b4-38bb5d76fe50-metrics-client-ca\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.477002 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.476980    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e48eb12-33a7-4554-88b4-38bb5d76fe50-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.477110 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.477029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e48eb12-33a7-4554-88b4-38bb5d76fe50-node-exporter-tls\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.483197 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.483172    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5j6j\" (UniqueName: \"kubernetes.io/projected/2e48eb12-33a7-4554-88b4-38bb5d76fe50-kube-api-access-z5j6j\") pod \"node-exporter-4gttm\" (UID: \"2e48eb12-33a7-4554-88b4-38bb5d76fe50\") " pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.576695 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:56.576631    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4gttm"
Jul 22 03:08:56.586046 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:08:56.586020    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e48eb12_33a7_4554_88b4_38bb5d76fe50.slice/crio-d375eaa14cc8f45f1d7385e605c9808a7ba105dc4952d5a2667f51699e110c7f WatchSource:0}: Error finding container d375eaa14cc8f45f1d7385e605c9808a7ba105dc4952d5a2667f51699e110c7f: Status 404 returned error can't find the container with id d375eaa14cc8f45f1d7385e605c9808a7ba105dc4952d5a2667f51699e110c7f
Jul 22 03:08:57.536718 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:57.536684    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4gttm" event={"ID":"2e48eb12-33a7-4554-88b4-38bb5d76fe50","Type":"ContainerStarted","Data":"8dccf99587be243e6194f691ba8e855085b531e765630c6363b81211a8a1f5e8"}
Jul 22 03:08:57.536991 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:57.536760    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4gttm" event={"ID":"2e48eb12-33a7-4554-88b4-38bb5d76fe50","Type":"ContainerStarted","Data":"d375eaa14cc8f45f1d7385e605c9808a7ba105dc4952d5a2667f51699e110c7f"}
Jul 22 03:08:58.543622 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:58.543587    2565 generic.go:356] "Generic (PLEG): container finished" podID="2e48eb12-33a7-4554-88b4-38bb5d76fe50" containerID="8dccf99587be243e6194f691ba8e855085b531e765630c6363b81211a8a1f5e8" exitCode=0
Jul 22 03:08:58.543993 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:58.543626    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4gttm" event={"ID":"2e48eb12-33a7-4554-88b4-38bb5d76fe50","Type":"ContainerDied","Data":"8dccf99587be243e6194f691ba8e855085b531e765630c6363b81211a8a1f5e8"}
Jul 22 03:08:59.259452 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.259423    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-86d8788ff9-mmvld"]
Jul 22 03:08:59.261725 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.261709    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.266910 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.266883    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 22 03:08:59.267045 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.266932    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 22 03:08:59.267045 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.267024    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 22 03:08:59.267204 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.267189    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-f9f4b8b73mfea\""
Jul 22 03:08:59.267912 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.267896    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-f4k4f\""
Jul 22 03:08:59.267995 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.267916    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 22 03:08:59.267995 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.267899    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 22 03:08:59.278124 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.278080    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86d8788ff9-mmvld"]
Jul 22 03:08:59.395885 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.395852    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19794c73-1e89-46e8-9144-e170d284c709-metrics-client-ca\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.395885 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.395887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19794c73-1e89-46e8-9144-e170d284c709-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.396105 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.395909    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/19794c73-1e89-46e8-9144-e170d284c709-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.396105 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.395925    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/19794c73-1e89-46e8-9144-e170d284c709-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.396105 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.396015    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/19794c73-1e89-46e8-9144-e170d284c709-secret-thanos-querier-tls\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.396105 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.396075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19794c73-1e89-46e8-9144-e170d284c709-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.396238 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.396106    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/19794c73-1e89-46e8-9144-e170d284c709-secret-grpc-tls\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.396238 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.396126    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzbfj\" (UniqueName: \"kubernetes.io/projected/19794c73-1e89-46e8-9144-e170d284c709-kube-api-access-xzbfj\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.496834 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.496784    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/19794c73-1e89-46e8-9144-e170d284c709-secret-thanos-querier-tls\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.497011 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.496869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19794c73-1e89-46e8-9144-e170d284c709-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.497011 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.496904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/19794c73-1e89-46e8-9144-e170d284c709-secret-grpc-tls\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.497011 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.496929    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzbfj\" (UniqueName: \"kubernetes.io/projected/19794c73-1e89-46e8-9144-e170d284c709-kube-api-access-xzbfj\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.497011 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.496958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19794c73-1e89-46e8-9144-e170d284c709-metrics-client-ca\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.497011 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.496986    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19794c73-1e89-46e8-9144-e170d284c709-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.497282 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.497013    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/19794c73-1e89-46e8-9144-e170d284c709-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.497282 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.497039    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/19794c73-1e89-46e8-9144-e170d284c709-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.497845 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.497807    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19794c73-1e89-46e8-9144-e170d284c709-metrics-client-ca\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.500017 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.499992    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/19794c73-1e89-46e8-9144-e170d284c709-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.500110 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.500070    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/19794c73-1e89-46e8-9144-e170d284c709-secret-grpc-tls\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.500179 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.500100    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19794c73-1e89-46e8-9144-e170d284c709-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.500179 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.500169    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19794c73-1e89-46e8-9144-e170d284c709-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.500286 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.500219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/19794c73-1e89-46e8-9144-e170d284c709-secret-thanos-querier-tls\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.500286 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.500231    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/19794c73-1e89-46e8-9144-e170d284c709-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.508518 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.508498    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzbfj\" (UniqueName: \"kubernetes.io/projected/19794c73-1e89-46e8-9144-e170d284c709-kube-api-access-xzbfj\") pod \"thanos-querier-86d8788ff9-mmvld\" (UID: \"19794c73-1e89-46e8-9144-e170d284c709\") " pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.548976 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.548905    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4gttm" event={"ID":"2e48eb12-33a7-4554-88b4-38bb5d76fe50","Type":"ContainerStarted","Data":"24553f8662882d0e19d772069bc14ac908d8040bf2ae786995f528c454fde2c0"}
Jul 22 03:08:59.548976 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.548956    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4gttm" event={"ID":"2e48eb12-33a7-4554-88b4-38bb5d76fe50","Type":"ContainerStarted","Data":"87185a778e9fab68860e7713b3debec1c997d6b4c49a94ed763fbbe6c5906347"}
Jul 22 03:08:59.570844 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.570821    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:08:59.572897 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.572851    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4gttm" podStartSLOduration=2.616532847 podStartE2EDuration="3.572836611s" totalImagesPullingTime="890.832269ms" totalInitContainerRuntime="65.471495ms" isStatefulPod=true podCreationTimestamp="2026-07-22 03:08:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:59.57194999 +0000 UTC m=+77.033500410" watchObservedRunningTime="2026-07-22 03:08:59.572836611 +0000 UTC m=+77.034387016"
Jul 22 03:08:59.714829 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:08:59.714799    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86d8788ff9-mmvld"]
Jul 22 03:08:59.717752 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:08:59.717723    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19794c73_1e89_46e8_9144_e170d284c709.slice/crio-db8260f5a351ec85b7f9de3beeca63bbf573bce6018841a59bca2109cb19d650 WatchSource:0}: Error finding container db8260f5a351ec85b7f9de3beeca63bbf573bce6018841a59bca2109cb19d650: Status 404 returned error can't find the container with id db8260f5a351ec85b7f9de3beeca63bbf573bce6018841a59bca2109cb19d650
Jul 22 03:09:00.554045 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:00.554013    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld" event={"ID":"19794c73-1e89-46e8-9144-e170d284c709","Type":"ContainerStarted","Data":"db8260f5a351ec85b7f9de3beeca63bbf573bce6018841a59bca2109cb19d650"}
Jul 22 03:09:02.501582 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.501525    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 03:09:02.505209 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.505187    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.508294 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.508275    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 03:09:02.508401 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.508276    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 03:09:02.508401 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.508322    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 03:09:02.508630 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.508613    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 03:09:02.508739 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.508628    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-f9xgk\""
Jul 22 03:09:02.508739 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.508616    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 03:09:02.508852 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.508837    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8iqvm9cf3jhat\""
Jul 22 03:09:02.511204 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.511186    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 03:09:02.512734 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.512718    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 03:09:02.513186 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.513173    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 03:09:02.513789 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.513772    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 03:09:02.514087 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.514073    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 03:09:02.514214 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.514199    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 03:09:02.514291 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.514278    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 03:09:02.514346 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.514278    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 03:09:02.514406 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.514394    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 03:09:02.516684 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.516668    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 03:09:02.529781 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.529757    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 03:09:02.563312 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.563288    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld" event={"ID":"19794c73-1e89-46e8-9144-e170d284c709","Type":"ContainerStarted","Data":"801fcf5fb9fdd090084c010db0b0e2947a3be60043490e1c66cc7f97074496f3"}
Jul 22 03:09:02.563401 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.563339    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld" event={"ID":"19794c73-1e89-46e8-9144-e170d284c709","Type":"ContainerStarted","Data":"e7670993e53d11100cad475aa6e62f607c8adb0fa529c9940592e3a9d0328029"}
Jul 22 03:09:02.563401 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.563366    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld" event={"ID":"19794c73-1e89-46e8-9144-e170d284c709","Type":"ContainerStarted","Data":"f1ba866e89c4bd6bedd6e786b1e3bc7eaf6cdd7f56fe31d589bd57916954928e"}
Jul 22 03:09:02.620068 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620152 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620152 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620089    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-web-config\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620152 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620105    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620152 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620146    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620295 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620295 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620208    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-config-out\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620295 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620295 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620295 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620456 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620295    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-config\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620456 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620313    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620456 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620370    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620456 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620390    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctrrt\" (UniqueName: \"kubernetes.io/projected/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-kube-api-access-ctrrt\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620456 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620456 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620450    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620672 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620672 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620672 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620516    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.620672 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.620535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.721677 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.721645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.721677 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.721679    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.721930 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.721699    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.721930 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.721717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.721930 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.721731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-web-config\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.721930 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.721852    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.721930 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.721895    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.721930 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.721919    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.722219 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.721947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-config-out\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.722219 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.721972    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.722219 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.722003    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.722219 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.722026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.722219 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.722053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-config\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.722219 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.722085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.722219 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.722127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.722219 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.722158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctrrt\" (UniqueName: \"kubernetes.io/projected/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-kube-api-access-ctrrt\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.722219 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.722194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.722677 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.722244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.722677 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.722267    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.722677 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.722657    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.723845 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.723194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.723845 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.723543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.723845 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.723771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.725371 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.725062    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.725789 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.725764    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.725889 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.725809    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.725962 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.725924    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.726221 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.726198    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-web-config\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.726298 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.726277    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.726636 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.726610    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.726754 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.726676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.726819 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.726752    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.726873 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.726834    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.727435 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.727406    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.727513 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.727435    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.727865 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.727848    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.727930 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.727900    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-config-out\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.728448 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.728432    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.728681 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.728665    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-config\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.731420 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.731401    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctrrt\" (UniqueName: \"kubernetes.io/projected/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-kube-api-access-ctrrt\") pod \"prometheus-k8s-0\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.814610 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.814521    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:02.959426 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:02.959388    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 03:09:02.962269 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:09:02.962242    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6554d8bf_0d93_4a49_b1e3_4bf114aeb881.slice/crio-8bbf48f12c893a977fb8aa0e9de160e876abd50e3092ad04d8b4281cee2f8159 WatchSource:0}: Error finding container 8bbf48f12c893a977fb8aa0e9de160e876abd50e3092ad04d8b4281cee2f8159: Status 404 returned error can't find the container with id 8bbf48f12c893a977fb8aa0e9de160e876abd50e3092ad04d8b4281cee2f8159
Jul 22 03:09:03.568945 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:03.568906    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6554d8bf-0d93-4a49-b1e3-4bf114aeb881","Type":"ContainerStarted","Data":"8bbf48f12c893a977fb8aa0e9de160e876abd50e3092ad04d8b4281cee2f8159"}
Jul 22 03:09:03.572166 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:03.572139    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld" event={"ID":"19794c73-1e89-46e8-9144-e170d284c709","Type":"ContainerStarted","Data":"00b60bf91803d4f42b08fede95806a7c43716e479f37cf13870bb7b621dba6ca"}
Jul 22 03:09:03.572290 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:03.572203    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld" event={"ID":"19794c73-1e89-46e8-9144-e170d284c709","Type":"ContainerStarted","Data":"bcdc7655dd780fea5fa30e26a92e1d3cd24868aa0fb28a7c9898ffdd18bce31f"}
Jul 22 03:09:03.572290 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:03.572246    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld" event={"ID":"19794c73-1e89-46e8-9144-e170d284c709","Type":"ContainerStarted","Data":"37bb0ef36be989cab497292d278494fec23c8bccafa63d703910e8ea8b011785"}
Jul 22 03:09:03.572363 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:03.572309    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:09:03.598267 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:03.598177    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld" podStartSLOduration=1.16012257 podStartE2EDuration="4.598156111s" totalImagesPullingTime="3.438033541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:08:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:09:03.596386043 +0000 UTC m=+81.057936449" watchObservedRunningTime="2026-07-22 03:09:03.598156111 +0000 UTC m=+81.059706518"
Jul 22 03:09:04.577282 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:04.577252    2565 generic.go:356] "Generic (PLEG): container finished" podID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerID="92268eff3dac2f15c34be2750640f5c3f03c39f6e0ad1cc2541a56452ea66648" exitCode=0
Jul 22 03:09:04.577695 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:04.577345    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6554d8bf-0d93-4a49-b1e3-4bf114aeb881","Type":"ContainerDied","Data":"92268eff3dac2f15c34be2750640f5c3f03c39f6e0ad1cc2541a56452ea66648"}
Jul 22 03:09:06.586918 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:06.586890    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589b6769c8-rcv8j" event={"ID":"4703344a-8d62-419e-b672-f658acd1994c","Type":"ContainerStarted","Data":"3c2b4d2692401ababc3166e1b4c4776aa2ca2ee49b8d546f435b1dddc6cdb541"}
Jul 22 03:09:07.612744 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:07.612696    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589b6769c8-rcv8j" podStartSLOduration=2.692964302 podStartE2EDuration="25.612679308s" totalImagesPullingTime="22.919715006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:08:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:09:07.610668941 +0000 UTC m=+85.072219347" watchObservedRunningTime="2026-07-22 03:09:07.612679308 +0000 UTC m=+85.074229715"
Jul 22 03:09:08.598249 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:08.598210    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6554d8bf-0d93-4a49-b1e3-4bf114aeb881","Type":"ContainerStarted","Data":"d956f1b8bca1f7de8a94df34e9e66db7e64536e154214bb97b404d52fbbec950"}
Jul 22 03:09:08.598397 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:08.598289    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6554d8bf-0d93-4a49-b1e3-4bf114aeb881","Type":"ContainerStarted","Data":"7817adc55c000f7991442b1ceb53afab84528eff96cb9f1736e60dc0d11b7dc9"}
Jul 22 03:09:08.598397 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:08.598329    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6554d8bf-0d93-4a49-b1e3-4bf114aeb881","Type":"ContainerStarted","Data":"1833118e2464702bb1508c1151ded41605ffaff39a1c1bdb16627604af46f12a"}
Jul 22 03:09:08.598397 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:08.598367    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6554d8bf-0d93-4a49-b1e3-4bf114aeb881","Type":"ContainerStarted","Data":"b855a95529b78fe8279d0c65e337408bfbc8f25e637b050391c024392c986fa7"}
Jul 22 03:09:08.598502 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:08.598409    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6554d8bf-0d93-4a49-b1e3-4bf114aeb881","Type":"ContainerStarted","Data":"466c51b9ff696b9b816a91caf09f256ebad0d1f13a729f46ca1df558ba28d4a4"}
Jul 22 03:09:08.598502 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:08.598444    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6554d8bf-0d93-4a49-b1e3-4bf114aeb881","Type":"ContainerStarted","Data":"01e4916d7f5e6b8eae2794e781877203a2885b418e93c452a0a5e02d6b591f18"}
Jul 22 03:09:08.641423 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:08.641367    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.4935617580000002 podStartE2EDuration="6.641345892s" totalImagesPullingTime="4.134347692s" totalInitContainerRuntime="13.436442ms" isStatefulPod=false podCreationTimestamp="2026-07-22 03:09:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:09:08.639375729 +0000 UTC m=+86.100926174" watchObservedRunningTime="2026-07-22 03:09:08.641345892 +0000 UTC m=+86.102896299"
Jul 22 03:09:09.583734 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:09.583707    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-86d8788ff9-mmvld"
Jul 22 03:09:12.814664 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:12.814633    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:09:25.532685 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:09:25.532655    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jhwrs"
Jul 22 03:10:02.814901 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:02.814866    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:02.834417 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:02.834386    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:03.811698 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:03.811672    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:20.844139 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:20.844100    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 03:10:20.844532 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:20.844440    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="prometheus" containerID="cri-o://01e4916d7f5e6b8eae2794e781877203a2885b418e93c452a0a5e02d6b591f18" gracePeriod=600
Jul 22 03:10:20.844532 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:20.844468    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="kube-rbac-proxy" containerID="cri-o://7817adc55c000f7991442b1ceb53afab84528eff96cb9f1736e60dc0d11b7dc9" gracePeriod=600
Jul 22 03:10:20.844706 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:20.844497    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d956f1b8bca1f7de8a94df34e9e66db7e64536e154214bb97b404d52fbbec950" gracePeriod=600
Jul 22 03:10:20.844706 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:20.844515    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="kube-rbac-proxy-web" containerID="cri-o://1833118e2464702bb1508c1151ded41605ffaff39a1c1bdb16627604af46f12a" gracePeriod=600
Jul 22 03:10:20.844706 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:20.844525    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="config-reloader" containerID="cri-o://466c51b9ff696b9b816a91caf09f256ebad0d1f13a729f46ca1df558ba28d4a4" gracePeriod=600
Jul 22 03:10:20.844706 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:20.844468    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="thanos-sidecar" containerID="cri-o://b855a95529b78fe8279d0c65e337408bfbc8f25e637b050391c024392c986fa7" gracePeriod=600
Jul 22 03:10:21.863807 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:21.863728    2565 generic.go:356] "Generic (PLEG): container finished" podID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerID="d956f1b8bca1f7de8a94df34e9e66db7e64536e154214bb97b404d52fbbec950" exitCode=0
Jul 22 03:10:21.863807 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:21.863753    2565 generic.go:356] "Generic (PLEG): container finished" podID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerID="7817adc55c000f7991442b1ceb53afab84528eff96cb9f1736e60dc0d11b7dc9" exitCode=0
Jul 22 03:10:21.863807 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:21.863759    2565 generic.go:356] "Generic (PLEG): container finished" podID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerID="b855a95529b78fe8279d0c65e337408bfbc8f25e637b050391c024392c986fa7" exitCode=0
Jul 22 03:10:21.863807 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:21.863767    2565 generic.go:356] "Generic (PLEG): container finished" podID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerID="466c51b9ff696b9b816a91caf09f256ebad0d1f13a729f46ca1df558ba28d4a4" exitCode=0
Jul 22 03:10:21.863807 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:21.863772    2565 generic.go:356] "Generic (PLEG): container finished" podID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerID="01e4916d7f5e6b8eae2794e781877203a2885b418e93c452a0a5e02d6b591f18" exitCode=0
Jul 22 03:10:21.863807 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:21.863799    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6554d8bf-0d93-4a49-b1e3-4bf114aeb881","Type":"ContainerDied","Data":"d956f1b8bca1f7de8a94df34e9e66db7e64536e154214bb97b404d52fbbec950"}
Jul 22 03:10:21.864284 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:21.863867    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6554d8bf-0d93-4a49-b1e3-4bf114aeb881","Type":"ContainerDied","Data":"7817adc55c000f7991442b1ceb53afab84528eff96cb9f1736e60dc0d11b7dc9"}
Jul 22 03:10:21.864284 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:21.863894    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6554d8bf-0d93-4a49-b1e3-4bf114aeb881","Type":"ContainerDied","Data":"b855a95529b78fe8279d0c65e337408bfbc8f25e637b050391c024392c986fa7"}
Jul 22 03:10:21.864284 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:21.863927    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6554d8bf-0d93-4a49-b1e3-4bf114aeb881","Type":"ContainerDied","Data":"466c51b9ff696b9b816a91caf09f256ebad0d1f13a729f46ca1df558ba28d4a4"}
Jul 22 03:10:21.864284 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:21.863955    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6554d8bf-0d93-4a49-b1e3-4bf114aeb881","Type":"ContainerDied","Data":"01e4916d7f5e6b8eae2794e781877203a2885b418e93c452a0a5e02d6b591f18"}
Jul 22 03:10:22.081704 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.081682    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:22.208024 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.207997    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-config\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.208176 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.208031    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-thanos-prometheus-http-client-file\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.208176 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.208050    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-configmap-serving-certs-ca-bundle\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.208176 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.208117    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-configmap-kubelet-serving-ca-bundle\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.208176 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.208160    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-rulefiles-2\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.208384 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.208195    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctrrt\" (UniqueName: \"kubernetes.io/projected/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-kube-api-access-ctrrt\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.208384 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.208221    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.208384 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.208259    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-prometheus-k8s-tls\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.208543 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.208459    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:10:22.208619 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.208589    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:10:22.208704 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.208671    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-trusted-ca-bundle\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.208780 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.208760    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-grpc-tls\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.208837 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.208790    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-kube-rbac-proxy\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.208837 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.208822    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-rulefiles-0\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.208938 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.208845    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-tls-assets\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.208938 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.208870    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-rulefiles-1\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.208938 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.208893    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:10:22.208938 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.208901    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-db\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.209142 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.209053    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.209142 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.209096    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-config-out\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.209142 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.209132    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-configmap-metrics-client-ca\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.209334 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.209134    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:10:22.209334 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.209208    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-web-config\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.209334 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.209247    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-metrics-client-certs\") pod \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\" (UID: \"6554d8bf-0d93-4a49-b1e3-4bf114aeb881\") "
Jul 22 03:10:22.209497 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.209462    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:10:22.209630 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.209611    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-configmap-metrics-client-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.209705 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.209636    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.209705 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.209650    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.209705 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.209664    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.209705 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.209678    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.210256 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.210184    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:10:22.211883 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.211496    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-config" (OuterVolumeSpecName: "config") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:10:22.211883 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.211640    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:10:22.211883 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.211663    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-kube-api-access-ctrrt" (OuterVolumeSpecName: "kube-api-access-ctrrt") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "kube-api-access-ctrrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:10:22.211883 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.211770    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:10:22.211883 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.211854    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:10:22.212293 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.212264    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:10:22.212376 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.212305    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:10:22.212608 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.212540    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:10:22.212608 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.212597    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:10:22.213000 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.212979    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:10:22.213875 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.213856    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-config-out" (OuterVolumeSpecName: "config-out") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:10:22.214065 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.214044    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:10:22.214065 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.214053    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:10:22.224380 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.224352    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-web-config" (OuterVolumeSpecName: "web-config") pod "6554d8bf-0d93-4a49-b1e3-4bf114aeb881" (UID: "6554d8bf-0d93-4a49-b1e3-4bf114aeb881"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:10:22.310877 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.310855    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-web-config\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.310877 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.310874    2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-metrics-client-certs\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.310990 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.310883    2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-config\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.310990 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.310892    2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.310990 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.310901    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctrrt\" (UniqueName: \"kubernetes.io/projected/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-kube-api-access-ctrrt\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.310990 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.310910    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.310990 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.310918    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.310990 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.310931    2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-grpc-tls\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.310990 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.310938    2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-kube-rbac-proxy\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.310990 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.310947    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.310990 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.310956    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-tls-assets\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.310990 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.310965    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.310990 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.310973    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-prometheus-k8s-db\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.310990 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.310981    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.310990 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.310989    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6554d8bf-0d93-4a49-b1e3-4bf114aeb881-config-out\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:10:22.870733 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.870702    2565 generic.go:356] "Generic (PLEG): container finished" podID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerID="1833118e2464702bb1508c1151ded41605ffaff39a1c1bdb16627604af46f12a" exitCode=0
Jul 22 03:10:22.871128 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.870757    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6554d8bf-0d93-4a49-b1e3-4bf114aeb881","Type":"ContainerDied","Data":"1833118e2464702bb1508c1151ded41605ffaff39a1c1bdb16627604af46f12a"}
Jul 22 03:10:22.871128 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.870779    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:22.871128 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.870810    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6554d8bf-0d93-4a49-b1e3-4bf114aeb881","Type":"ContainerDied","Data":"8bbf48f12c893a977fb8aa0e9de160e876abd50e3092ad04d8b4281cee2f8159"}
Jul 22 03:10:22.871128 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.870842    2565 scope.go:117] "RemoveContainer" containerID="d956f1b8bca1f7de8a94df34e9e66db7e64536e154214bb97b404d52fbbec950"
Jul 22 03:10:22.878517 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.878384    2565 scope.go:117] "RemoveContainer" containerID="7817adc55c000f7991442b1ceb53afab84528eff96cb9f1736e60dc0d11b7dc9"
Jul 22 03:10:22.886177 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.886161    2565 scope.go:117] "RemoveContainer" containerID="1833118e2464702bb1508c1151ded41605ffaff39a1c1bdb16627604af46f12a"
Jul 22 03:10:22.892126 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.892111    2565 scope.go:117] "RemoveContainer" containerID="b855a95529b78fe8279d0c65e337408bfbc8f25e637b050391c024392c986fa7"
Jul 22 03:10:22.897028 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.897007    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 03:10:22.898548 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.898524    2565 scope.go:117] "RemoveContainer" containerID="466c51b9ff696b9b816a91caf09f256ebad0d1f13a729f46ca1df558ba28d4a4"
Jul 22 03:10:22.904127 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.904104    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 03:10:22.905691 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.905676    2565 scope.go:117] "RemoveContainer" containerID="01e4916d7f5e6b8eae2794e781877203a2885b418e93c452a0a5e02d6b591f18"
Jul 22 03:10:22.912184 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.912166    2565 scope.go:117] "RemoveContainer" containerID="92268eff3dac2f15c34be2750640f5c3f03c39f6e0ad1cc2541a56452ea66648"
Jul 22 03:10:22.918186 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.918172    2565 scope.go:117] "RemoveContainer" containerID="d956f1b8bca1f7de8a94df34e9e66db7e64536e154214bb97b404d52fbbec950"
Jul 22 03:10:22.918439 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:10:22.918406    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d956f1b8bca1f7de8a94df34e9e66db7e64536e154214bb97b404d52fbbec950\": container with ID starting with d956f1b8bca1f7de8a94df34e9e66db7e64536e154214bb97b404d52fbbec950 not found: ID does not exist" containerID="d956f1b8bca1f7de8a94df34e9e66db7e64536e154214bb97b404d52fbbec950"
Jul 22 03:10:22.918489 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.918452    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d956f1b8bca1f7de8a94df34e9e66db7e64536e154214bb97b404d52fbbec950"} err="failed to get container status \"d956f1b8bca1f7de8a94df34e9e66db7e64536e154214bb97b404d52fbbec950\": rpc error: code = NotFound desc = could not find container \"d956f1b8bca1f7de8a94df34e9e66db7e64536e154214bb97b404d52fbbec950\": container with ID starting with d956f1b8bca1f7de8a94df34e9e66db7e64536e154214bb97b404d52fbbec950 not found: ID does not exist"
Jul 22 03:10:22.918489 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.918484    2565 scope.go:117] "RemoveContainer" containerID="7817adc55c000f7991442b1ceb53afab84528eff96cb9f1736e60dc0d11b7dc9"
Jul 22 03:10:22.918745 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:10:22.918727    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7817adc55c000f7991442b1ceb53afab84528eff96cb9f1736e60dc0d11b7dc9\": container with ID starting with 7817adc55c000f7991442b1ceb53afab84528eff96cb9f1736e60dc0d11b7dc9 not found: ID does not exist" containerID="7817adc55c000f7991442b1ceb53afab84528eff96cb9f1736e60dc0d11b7dc9"
Jul 22 03:10:22.918808 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.918750    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7817adc55c000f7991442b1ceb53afab84528eff96cb9f1736e60dc0d11b7dc9"} err="failed to get container status \"7817adc55c000f7991442b1ceb53afab84528eff96cb9f1736e60dc0d11b7dc9\": rpc error: code = NotFound desc = could not find container \"7817adc55c000f7991442b1ceb53afab84528eff96cb9f1736e60dc0d11b7dc9\": container with ID starting with 7817adc55c000f7991442b1ceb53afab84528eff96cb9f1736e60dc0d11b7dc9 not found: ID does not exist"
Jul 22 03:10:22.918808 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.918766    2565 scope.go:117] "RemoveContainer" containerID="1833118e2464702bb1508c1151ded41605ffaff39a1c1bdb16627604af46f12a"
Jul 22 03:10:22.918968 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:10:22.918953    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1833118e2464702bb1508c1151ded41605ffaff39a1c1bdb16627604af46f12a\": container with ID starting with 1833118e2464702bb1508c1151ded41605ffaff39a1c1bdb16627604af46f12a not found: ID does not exist" containerID="1833118e2464702bb1508c1151ded41605ffaff39a1c1bdb16627604af46f12a"
Jul 22 03:10:22.919008 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.918971    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1833118e2464702bb1508c1151ded41605ffaff39a1c1bdb16627604af46f12a"} err="failed to get container status \"1833118e2464702bb1508c1151ded41605ffaff39a1c1bdb16627604af46f12a\": rpc error: code = NotFound desc = could not find container \"1833118e2464702bb1508c1151ded41605ffaff39a1c1bdb16627604af46f12a\": container with ID starting with 1833118e2464702bb1508c1151ded41605ffaff39a1c1bdb16627604af46f12a not found: ID does not exist"
Jul 22 03:10:22.919008 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.918985    2565 scope.go:117] "RemoveContainer" containerID="b855a95529b78fe8279d0c65e337408bfbc8f25e637b050391c024392c986fa7"
Jul 22 03:10:22.919167 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:10:22.919154    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b855a95529b78fe8279d0c65e337408bfbc8f25e637b050391c024392c986fa7\": container with ID starting with b855a95529b78fe8279d0c65e337408bfbc8f25e637b050391c024392c986fa7 not found: ID does not exist" containerID="b855a95529b78fe8279d0c65e337408bfbc8f25e637b050391c024392c986fa7"
Jul 22 03:10:22.919204 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.919170    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b855a95529b78fe8279d0c65e337408bfbc8f25e637b050391c024392c986fa7"} err="failed to get container status \"b855a95529b78fe8279d0c65e337408bfbc8f25e637b050391c024392c986fa7\": rpc error: code = NotFound desc = could not find container \"b855a95529b78fe8279d0c65e337408bfbc8f25e637b050391c024392c986fa7\": container with ID starting with b855a95529b78fe8279d0c65e337408bfbc8f25e637b050391c024392c986fa7 not found: ID does not exist"
Jul 22 03:10:22.919204 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.919181    2565 scope.go:117] "RemoveContainer" containerID="466c51b9ff696b9b816a91caf09f256ebad0d1f13a729f46ca1df558ba28d4a4"
Jul 22 03:10:22.919424 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:10:22.919408    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"466c51b9ff696b9b816a91caf09f256ebad0d1f13a729f46ca1df558ba28d4a4\": container with ID starting with 466c51b9ff696b9b816a91caf09f256ebad0d1f13a729f46ca1df558ba28d4a4 not found: ID does not exist" containerID="466c51b9ff696b9b816a91caf09f256ebad0d1f13a729f46ca1df558ba28d4a4"
Jul 22 03:10:22.919468 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.919430    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"466c51b9ff696b9b816a91caf09f256ebad0d1f13a729f46ca1df558ba28d4a4"} err="failed to get container status \"466c51b9ff696b9b816a91caf09f256ebad0d1f13a729f46ca1df558ba28d4a4\": rpc error: code = NotFound desc = could not find container \"466c51b9ff696b9b816a91caf09f256ebad0d1f13a729f46ca1df558ba28d4a4\": container with ID starting with 466c51b9ff696b9b816a91caf09f256ebad0d1f13a729f46ca1df558ba28d4a4 not found: ID does not exist"
Jul 22 03:10:22.919468 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.919445    2565 scope.go:117] "RemoveContainer" containerID="01e4916d7f5e6b8eae2794e781877203a2885b418e93c452a0a5e02d6b591f18"
Jul 22 03:10:22.919651 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:10:22.919634    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01e4916d7f5e6b8eae2794e781877203a2885b418e93c452a0a5e02d6b591f18\": container with ID starting with 01e4916d7f5e6b8eae2794e781877203a2885b418e93c452a0a5e02d6b591f18 not found: ID does not exist" containerID="01e4916d7f5e6b8eae2794e781877203a2885b418e93c452a0a5e02d6b591f18"
Jul 22 03:10:22.919712 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.919654    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e4916d7f5e6b8eae2794e781877203a2885b418e93c452a0a5e02d6b591f18"} err="failed to get container status \"01e4916d7f5e6b8eae2794e781877203a2885b418e93c452a0a5e02d6b591f18\": rpc error: code = NotFound desc = could not find container \"01e4916d7f5e6b8eae2794e781877203a2885b418e93c452a0a5e02d6b591f18\": container with ID starting with 01e4916d7f5e6b8eae2794e781877203a2885b418e93c452a0a5e02d6b591f18 not found: ID does not exist"
Jul 22 03:10:22.919712 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.919665    2565 scope.go:117] "RemoveContainer" containerID="92268eff3dac2f15c34be2750640f5c3f03c39f6e0ad1cc2541a56452ea66648"
Jul 22 03:10:22.919872 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:10:22.919857    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92268eff3dac2f15c34be2750640f5c3f03c39f6e0ad1cc2541a56452ea66648\": container with ID starting with 92268eff3dac2f15c34be2750640f5c3f03c39f6e0ad1cc2541a56452ea66648 not found: ID does not exist" containerID="92268eff3dac2f15c34be2750640f5c3f03c39f6e0ad1cc2541a56452ea66648"
Jul 22 03:10:22.919910 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.919876    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92268eff3dac2f15c34be2750640f5c3f03c39f6e0ad1cc2541a56452ea66648"} err="failed to get container status \"92268eff3dac2f15c34be2750640f5c3f03c39f6e0ad1cc2541a56452ea66648\": rpc error: code = NotFound desc = could not find container \"92268eff3dac2f15c34be2750640f5c3f03c39f6e0ad1cc2541a56452ea66648\": container with ID starting with 92268eff3dac2f15c34be2750640f5c3f03c39f6e0ad1cc2541a56452ea66648 not found: ID does not exist"
Jul 22 03:10:22.931975 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.931955    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 03:10:22.932224 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932210    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="prometheus"
Jul 22 03:10:22.932297 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932228    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="prometheus"
Jul 22 03:10:22.932297 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932248    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="kube-rbac-proxy-web"
Jul 22 03:10:22.932297 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932257    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="kube-rbac-proxy-web"
Jul 22 03:10:22.932297 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932267    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="kube-rbac-proxy"
Jul 22 03:10:22.932297 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932276    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="kube-rbac-proxy"
Jul 22 03:10:22.932297 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932286    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="kube-rbac-proxy-thanos"
Jul 22 03:10:22.932297 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932295    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="kube-rbac-proxy-thanos"
Jul 22 03:10:22.932651 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932310    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="thanos-sidecar"
Jul 22 03:10:22.932651 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932318    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="thanos-sidecar"
Jul 22 03:10:22.932651 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932331    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="init-config-reloader"
Jul 22 03:10:22.932651 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932339    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="init-config-reloader"
Jul 22 03:10:22.932651 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932349    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="config-reloader"
Jul 22 03:10:22.932651 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932357    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="config-reloader"
Jul 22 03:10:22.932651 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932422    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="prometheus"
Jul 22 03:10:22.932651 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932433    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="thanos-sidecar"
Jul 22 03:10:22.932651 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932442    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="kube-rbac-proxy-web"
Jul 22 03:10:22.932651 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932452    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="config-reloader"
Jul 22 03:10:22.932651 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932461    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="kube-rbac-proxy"
Jul 22 03:10:22.932651 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.932473    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" containerName="kube-rbac-proxy-thanos"
Jul 22 03:10:22.936539 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.936522    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:22.939218 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.939198    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 03:10:22.939218 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.939209    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 03:10:22.939398 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.939212    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 03:10:22.939398 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.939255    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8iqvm9cf3jhat\""
Jul 22 03:10:22.939398 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.939303    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-f9xgk\""
Jul 22 03:10:22.939626 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.939485    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 03:10:22.939626 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.939552    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 03:10:22.939748 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.939667    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 03:10:22.939784 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.939759    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 03:10:22.939887 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.939798    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 03:10:22.941541 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.940400    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 03:10:22.941541 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.940492    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 03:10:22.941541 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.941292    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 03:10:22.942865 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.942013    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 03:10:22.942865 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.942423    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 03:10:22.947158 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.947139    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 03:10:22.949186 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.949160    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 03:10:22.955211 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:22.955192    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 03:10:23.017322 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017299    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017349    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017366    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017407 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017534 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017414    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-web-config\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017534 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017435    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017534 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017452    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017534 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017495    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-config\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017534 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017509    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017534 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017524    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017735 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017542    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-config-out\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017735 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017574    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017735 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017620    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017735 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017681    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017735 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017877 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017742    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017877 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017761    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zplwt\" (UniqueName: \"kubernetes.io/projected/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-kube-api-access-zplwt\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017877 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017778    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.017877 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.017793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.118815 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.118785    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.118921 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.118818    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.118921 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.118837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.118921 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.118856    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.118921 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.118882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zplwt\" (UniqueName: \"kubernetes.io/projected/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-kube-api-access-zplwt\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.118921 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.118911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.119175 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.118934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.119175 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.118963    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.119175 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.119031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.119175 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.119083    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.119175 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.119112    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.119175 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.119138    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.119175 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.119166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-web-config\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.119513 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.119194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.119513 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.119219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.119513 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.119264    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-config\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.119513 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.119287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.119513 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.119313    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.119513 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.119350    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-config-out\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.119513 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.119377    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.121358 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.120169    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.121358 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.120524    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.121358 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.120726    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.121358 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.121214    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.121358 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.121222    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.122052 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.121885    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.122304 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.122155    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.122304 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.122257    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.123707 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.123687    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.124148 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.124118    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.124228 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.124200    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.124410 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.124392    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.124579 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.124540    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-config\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.124652 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.124579    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-config-out\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.124754 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.124730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.124754 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.124741    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-web-config\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.124916 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.124842    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.125095 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.125072    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.125743 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.125722    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.126826 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.126810    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zplwt\" (UniqueName: \"kubernetes.io/projected/806cc9a9-a1a3-4af0-9c58-f712faf6cd40-kube-api-access-zplwt\") pod \"prometheus-k8s-0\" (UID: \"806cc9a9-a1a3-4af0-9c58-f712faf6cd40\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.242244 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.242215    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6554d8bf-0d93-4a49-b1e3-4bf114aeb881" path="/var/lib/kubelet/pods/6554d8bf-0d93-4a49-b1e3-4bf114aeb881/volumes"
Jul 22 03:10:23.248598 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.248576    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:10:23.388276 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.388257    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 03:10:23.390680 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:10:23.390656    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod806cc9a9_a1a3_4af0_9c58_f712faf6cd40.slice/crio-b5eba722831f30957691a563bcff4758330e580e6bd7489d94844e70a566c95a WatchSource:0}: Error finding container b5eba722831f30957691a563bcff4758330e580e6bd7489d94844e70a566c95a: Status 404 returned error can't find the container with id b5eba722831f30957691a563bcff4758330e580e6bd7489d94844e70a566c95a
Jul 22 03:10:23.876755 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.876718    2565 generic.go:356] "Generic (PLEG): container finished" podID="806cc9a9-a1a3-4af0-9c58-f712faf6cd40" containerID="5fd839ff082c3fd92851d6d0eb1856f5adcf0c4ef485e89840e9b5099619c24d" exitCode=0
Jul 22 03:10:23.877262 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.876795    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"806cc9a9-a1a3-4af0-9c58-f712faf6cd40","Type":"ContainerDied","Data":"5fd839ff082c3fd92851d6d0eb1856f5adcf0c4ef485e89840e9b5099619c24d"}
Jul 22 03:10:23.877262 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:23.876888    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"806cc9a9-a1a3-4af0-9c58-f712faf6cd40","Type":"ContainerStarted","Data":"b5eba722831f30957691a563bcff4758330e580e6bd7489d94844e70a566c95a"}
Jul 22 03:10:24.883872 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:24.883837    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"806cc9a9-a1a3-4af0-9c58-f712faf6cd40","Type":"ContainerStarted","Data":"8834a8489df1fc5b9730b36ea3ca5dbea77c1b6e6fc0bf95ad6ef6180569ba3b"}
Jul 22 03:10:24.884259 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:24.883936    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"806cc9a9-a1a3-4af0-9c58-f712faf6cd40","Type":"ContainerStarted","Data":"66e6811500e159fd02a01ee527379fe1c48600ef6788039d907556127433a427"}
Jul 22 03:10:24.884259 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:24.883967    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"806cc9a9-a1a3-4af0-9c58-f712faf6cd40","Type":"ContainerStarted","Data":"6e5b7cc060463dd717b140923ff2c6e0748b3298979968ac7c68a093baa665fd"}
Jul 22 03:10:24.884259 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:24.883991    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"806cc9a9-a1a3-4af0-9c58-f712faf6cd40","Type":"ContainerStarted","Data":"bba051e018b7a47f8d10a93df927142c83389ada259ef3bf61b2dc2893b5799f"}
Jul 22 03:10:24.884259 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:24.884024    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"806cc9a9-a1a3-4af0-9c58-f712faf6cd40","Type":"ContainerStarted","Data":"945327aa3bd9056b5d0292da8903a3aa9a4085f2a0d0953272fb3b54dbe6e666"}
Jul 22 03:10:24.884259 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:24.884049    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"806cc9a9-a1a3-4af0-9c58-f712faf6cd40","Type":"ContainerStarted","Data":"8b70d75f4f50bf97554525bba2b851d4e80c88ddb91e9393539f9ae57a1ce8c2"}
Jul 22 03:10:24.910310 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:24.910263    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.891578554 podStartE2EDuration="2.91025023s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.671676ms" isStatefulPod=false podCreationTimestamp="2026-07-22 03:10:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:10:24.909024204 +0000 UTC m=+162.370574610" watchObservedRunningTime="2026-07-22 03:10:24.91025023 +0000 UTC m=+162.371800635"
Jul 22 03:10:28.248957 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:10:28.248926    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:11:23.249143 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:11:23.249114    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:11:23.264203 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:11:23.264176    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:11:24.115168 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:11:24.115135    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 03:12:43.033839 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:12:43.033811    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 03:13:11.490973 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.490937    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"]
Jul 22 03:13:11.494186 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.494168    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:11.497206 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.497176    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 03:13:11.497306 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.497230    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 03:13:11.497306 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.497230    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 03:13:11.497404 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.497359    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 03:13:11.497469 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.497445    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mmj5l\""
Jul 22 03:13:11.512548 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.512525    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"]
Jul 22 03:13:11.604462 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.604442    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5vqk\" (UniqueName: \"kubernetes.io/projected/bc303a86-6296-4500-9684-e7d04e218390-kube-api-access-g5vqk\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-lfm7s\" (UID: \"bc303a86-6296-4500-9684-e7d04e218390\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:11.604584 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.604481    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bc303a86-6296-4500-9684-e7d04e218390-manifests\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-lfm7s\" (UID: \"bc303a86-6296-4500-9684-e7d04e218390\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:11.604584 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.604504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc303a86-6296-4500-9684-e7d04e218390-tmp\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-lfm7s\" (UID: \"bc303a86-6296-4500-9684-e7d04e218390\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:11.604662 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.604584    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc303a86-6296-4500-9684-e7d04e218390-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-lfm7s\" (UID: \"bc303a86-6296-4500-9684-e7d04e218390\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:11.604662 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.604615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc303a86-6296-4500-9684-e7d04e218390-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-lfm7s\" (UID: \"bc303a86-6296-4500-9684-e7d04e218390\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:11.705205 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.705174    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5vqk\" (UniqueName: \"kubernetes.io/projected/bc303a86-6296-4500-9684-e7d04e218390-kube-api-access-g5vqk\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-lfm7s\" (UID: \"bc303a86-6296-4500-9684-e7d04e218390\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:11.705306 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.705228    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bc303a86-6296-4500-9684-e7d04e218390-manifests\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-lfm7s\" (UID: \"bc303a86-6296-4500-9684-e7d04e218390\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:11.705306 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.705263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc303a86-6296-4500-9684-e7d04e218390-tmp\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-lfm7s\" (UID: \"bc303a86-6296-4500-9684-e7d04e218390\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:11.705306 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.705296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc303a86-6296-4500-9684-e7d04e218390-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-lfm7s\" (UID: \"bc303a86-6296-4500-9684-e7d04e218390\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:11.705465 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.705332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc303a86-6296-4500-9684-e7d04e218390-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-lfm7s\" (UID: \"bc303a86-6296-4500-9684-e7d04e218390\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:11.705727 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.705686    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bc303a86-6296-4500-9684-e7d04e218390-manifests\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-lfm7s\" (UID: \"bc303a86-6296-4500-9684-e7d04e218390\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:11.707758 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.707725    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc303a86-6296-4500-9684-e7d04e218390-tmp\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-lfm7s\" (UID: \"bc303a86-6296-4500-9684-e7d04e218390\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:11.707850 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.707765    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bc303a86-6296-4500-9684-e7d04e218390-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-lfm7s\" (UID: \"bc303a86-6296-4500-9684-e7d04e218390\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:11.707892 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.707852    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc303a86-6296-4500-9684-e7d04e218390-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-lfm7s\" (UID: \"bc303a86-6296-4500-9684-e7d04e218390\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:11.713047 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.713025    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5vqk\" (UniqueName: \"kubernetes.io/projected/bc303a86-6296-4500-9684-e7d04e218390-kube-api-access-g5vqk\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-lfm7s\" (UID: \"bc303a86-6296-4500-9684-e7d04e218390\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:11.804546 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.804493    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:11.939891 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.939850    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"]
Jul 22 03:13:11.942198 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:13:11.942171    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc303a86_6296_4500_9684_e7d04e218390.slice/crio-256c8a90c72470674fdcc81637d5eaed589f87a694c3f61b3eea28eef0a5c2ff WatchSource:0}: Error finding container 256c8a90c72470674fdcc81637d5eaed589f87a694c3f61b3eea28eef0a5c2ff: Status 404 returned error can't find the container with id 256c8a90c72470674fdcc81637d5eaed589f87a694c3f61b3eea28eef0a5c2ff
Jul 22 03:13:11.943890 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:11.943875    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:13:12.471774 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:12.471741    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s" event={"ID":"bc303a86-6296-4500-9684-e7d04e218390","Type":"ContainerStarted","Data":"256c8a90c72470674fdcc81637d5eaed589f87a694c3f61b3eea28eef0a5c2ff"}
Jul 22 03:13:15.485195 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:15.485161    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s" event={"ID":"bc303a86-6296-4500-9684-e7d04e218390","Type":"ContainerStarted","Data":"a70bd212a1baa0b77f3b075af06286ae7770c9c27a26a18876735e3db2377c31"}
Jul 22 03:13:16.490797 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:16.490758    2565 generic.go:356] "Generic (PLEG): container finished" podID="bc303a86-6296-4500-9684-e7d04e218390" containerID="a70bd212a1baa0b77f3b075af06286ae7770c9c27a26a18876735e3db2377c31" exitCode=0
Jul 22 03:13:16.491236 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:16.490852    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s" event={"ID":"bc303a86-6296-4500-9684-e7d04e218390","Type":"ContainerDied","Data":"a70bd212a1baa0b77f3b075af06286ae7770c9c27a26a18876735e3db2377c31"}
Jul 22 03:13:17.496168 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:17.496130    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s" event={"ID":"bc303a86-6296-4500-9684-e7d04e218390","Type":"ContainerStarted","Data":"09a0ad851642cfd0058690b10367b6c058de29bad8a20e72b9f98f5a7b8f3354"}
Jul 22 03:13:17.496661 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:17.496206    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:17.518921 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:17.518878    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s" podStartSLOduration=2.083396414 podStartE2EDuration="6.518861156s" totalImagesPullingTime="3.380798401s" totalInitContainerRuntime="1.054666341s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:13:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:13:17.516410071 +0000 UTC m=+334.977960482" watchObservedRunningTime="2026-07-22 03:13:17.518861156 +0000 UTC m=+334.980411562"
Jul 22 03:13:28.502386 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:28.502359    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-lfm7s"
Jul 22 03:13:38.637857 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.637790    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"]
Jul 22 03:13:38.640585 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.640550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"
Jul 22 03:13:38.644892 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.644870    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 03:13:38.645135 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.645115    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 03:13:38.645264 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.645160    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 22 03:13:38.645678 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.645663    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-p2dvb\""
Jul 22 03:13:38.645754 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.645663    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 22 03:13:38.645754 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.645737    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 22 03:13:38.661676 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.661656    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"]
Jul 22 03:13:38.705988 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.705966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9465c8c9-f3cb-472a-8bed-efdbf3d015e9-cert\") pod \"lws-controller-manager-8587dbf975-cx96x\" (UID: \"9465c8c9-f3cb-472a-8bed-efdbf3d015e9\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"
Jul 22 03:13:38.706064 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.705996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9465c8c9-f3cb-472a-8bed-efdbf3d015e9-manager-config\") pod \"lws-controller-manager-8587dbf975-cx96x\" (UID: \"9465c8c9-f3cb-472a-8bed-efdbf3d015e9\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"
Jul 22 03:13:38.706064 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.706013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h89bs\" (UniqueName: \"kubernetes.io/projected/9465c8c9-f3cb-472a-8bed-efdbf3d015e9-kube-api-access-h89bs\") pod \"lws-controller-manager-8587dbf975-cx96x\" (UID: \"9465c8c9-f3cb-472a-8bed-efdbf3d015e9\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"
Jul 22 03:13:38.706064 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.706037    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9465c8c9-f3cb-472a-8bed-efdbf3d015e9-metrics-cert\") pod \"lws-controller-manager-8587dbf975-cx96x\" (UID: \"9465c8c9-f3cb-472a-8bed-efdbf3d015e9\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"
Jul 22 03:13:38.807301 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.807278    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9465c8c9-f3cb-472a-8bed-efdbf3d015e9-manager-config\") pod \"lws-controller-manager-8587dbf975-cx96x\" (UID: \"9465c8c9-f3cb-472a-8bed-efdbf3d015e9\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"
Jul 22 03:13:38.807388 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.807303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h89bs\" (UniqueName: \"kubernetes.io/projected/9465c8c9-f3cb-472a-8bed-efdbf3d015e9-kube-api-access-h89bs\") pod \"lws-controller-manager-8587dbf975-cx96x\" (UID: \"9465c8c9-f3cb-472a-8bed-efdbf3d015e9\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"
Jul 22 03:13:38.807388 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.807329    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9465c8c9-f3cb-472a-8bed-efdbf3d015e9-metrics-cert\") pod \"lws-controller-manager-8587dbf975-cx96x\" (UID: \"9465c8c9-f3cb-472a-8bed-efdbf3d015e9\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"
Jul 22 03:13:38.807388 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.807373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9465c8c9-f3cb-472a-8bed-efdbf3d015e9-cert\") pod \"lws-controller-manager-8587dbf975-cx96x\" (UID: \"9465c8c9-f3cb-472a-8bed-efdbf3d015e9\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"
Jul 22 03:13:38.808008 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.807989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9465c8c9-f3cb-472a-8bed-efdbf3d015e9-manager-config\") pod \"lws-controller-manager-8587dbf975-cx96x\" (UID: \"9465c8c9-f3cb-472a-8bed-efdbf3d015e9\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"
Jul 22 03:13:38.809737 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.809718    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9465c8c9-f3cb-472a-8bed-efdbf3d015e9-cert\") pod \"lws-controller-manager-8587dbf975-cx96x\" (UID: \"9465c8c9-f3cb-472a-8bed-efdbf3d015e9\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"
Jul 22 03:13:38.809842 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.809825    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9465c8c9-f3cb-472a-8bed-efdbf3d015e9-metrics-cert\") pod \"lws-controller-manager-8587dbf975-cx96x\" (UID: \"9465c8c9-f3cb-472a-8bed-efdbf3d015e9\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"
Jul 22 03:13:38.817898 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.817876    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h89bs\" (UniqueName: \"kubernetes.io/projected/9465c8c9-f3cb-472a-8bed-efdbf3d015e9-kube-api-access-h89bs\") pod \"lws-controller-manager-8587dbf975-cx96x\" (UID: \"9465c8c9-f3cb-472a-8bed-efdbf3d015e9\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"
Jul 22 03:13:38.949977 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:38.949954    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"
Jul 22 03:13:39.100177 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:39.100146    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"]
Jul 22 03:13:39.104205 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:13:39.104179    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9465c8c9_f3cb_472a_8bed_efdbf3d015e9.slice/crio-54d6640734161add9157bcc90de3f63f6b40074442c7b7e8e711540eb9774f16 WatchSource:0}: Error finding container 54d6640734161add9157bcc90de3f63f6b40074442c7b7e8e711540eb9774f16: Status 404 returned error can't find the container with id 54d6640734161add9157bcc90de3f63f6b40074442c7b7e8e711540eb9774f16
Jul 22 03:13:39.580771 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:39.580729    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x" event={"ID":"9465c8c9-f3cb-472a-8bed-efdbf3d015e9","Type":"ContainerStarted","Data":"54d6640734161add9157bcc90de3f63f6b40074442c7b7e8e711540eb9774f16"}
Jul 22 03:13:39.943867 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:39.943789    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"]
Jul 22 03:13:39.947294 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:39.947271    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:39.950489 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:39.950395    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 22 03:13:39.950489 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:39.950402    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 22 03:13:39.950683 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:39.950498    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 03:13:39.950683 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:39.950402    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 22 03:13:39.950683 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:39.950464    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2778r\""
Jul 22 03:13:39.951081 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:39.950914    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 22 03:13:39.951081 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:39.951015    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 03:13:39.959294 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:39.959272    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"]
Jul 22 03:13:40.014927 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.014838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/de4725a9-b593-4a58-bb55-43a80c6f6878-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.014927 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.014876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de4725a9-b593-4a58-bb55-43a80c6f6878-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.014927 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.014913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/de4725a9-b593-4a58-bb55-43a80c6f6878-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.015171 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.014938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/de4725a9-b593-4a58-bb55-43a80c6f6878-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.015171 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.014965    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/de4725a9-b593-4a58-bb55-43a80c6f6878-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.015171 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.014987    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/de4725a9-b593-4a58-bb55-43a80c6f6878-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.015171 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.015012    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t42qk\" (UniqueName: \"kubernetes.io/projected/de4725a9-b593-4a58-bb55-43a80c6f6878-kube-api-access-t42qk\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.116109 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.116076    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/de4725a9-b593-4a58-bb55-43a80c6f6878-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.116255 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.116117    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de4725a9-b593-4a58-bb55-43a80c6f6878-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.116255 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.116152    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/de4725a9-b593-4a58-bb55-43a80c6f6878-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.116386 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.116297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/de4725a9-b593-4a58-bb55-43a80c6f6878-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.116386 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.116331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/de4725a9-b593-4a58-bb55-43a80c6f6878-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.116386 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.116356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/de4725a9-b593-4a58-bb55-43a80c6f6878-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.116545 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.116408    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t42qk\" (UniqueName: \"kubernetes.io/projected/de4725a9-b593-4a58-bb55-43a80c6f6878-kube-api-access-t42qk\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.117089 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.117061    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/de4725a9-b593-4a58-bb55-43a80c6f6878-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.119193 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.119158    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/de4725a9-b593-4a58-bb55-43a80c6f6878-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.119692 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.119652    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/de4725a9-b593-4a58-bb55-43a80c6f6878-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.119859 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.119839    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/de4725a9-b593-4a58-bb55-43a80c6f6878-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.120177 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.120142    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/de4725a9-b593-4a58-bb55-43a80c6f6878-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.136339 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.136307    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t42qk\" (UniqueName: \"kubernetes.io/projected/de4725a9-b593-4a58-bb55-43a80c6f6878-kube-api-access-t42qk\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.136745 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.136723    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de4725a9-b593-4a58-bb55-43a80c6f6878-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-g7q49\" (UID: \"de4725a9-b593-4a58-bb55-43a80c6f6878\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.262448 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.262318    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:40.458437 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.458401    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"]
Jul 22 03:13:40.461649 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:13:40.461622    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4725a9_b593_4a58_bb55_43a80c6f6878.slice/crio-dca2a29ccbb38e1fb423f08fbbf3b1ad9b47522a476a670c8622760665656e10 WatchSource:0}: Error finding container dca2a29ccbb38e1fb423f08fbbf3b1ad9b47522a476a670c8622760665656e10: Status 404 returned error can't find the container with id dca2a29ccbb38e1fb423f08fbbf3b1ad9b47522a476a670c8622760665656e10
Jul 22 03:13:40.586388 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:40.586314    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49" event={"ID":"de4725a9-b593-4a58-bb55-43a80c6f6878","Type":"ContainerStarted","Data":"dca2a29ccbb38e1fb423f08fbbf3b1ad9b47522a476a670c8622760665656e10"}
Jul 22 03:13:42.596923 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:42.596882    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x" event={"ID":"9465c8c9-f3cb-472a-8bed-efdbf3d015e9","Type":"ContainerStarted","Data":"c8cbce3dee8baba274e7a92b61080137584ecf90ccd0783a6b734da90fa0a947"}
Jul 22 03:13:42.597368 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:42.597028    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"
Jul 22 03:13:42.638039 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:42.637989    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x" podStartSLOduration=2.169520979 podStartE2EDuration="4.637973069s" totalImagesPullingTime="2.46845209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:13:42.635463117 +0000 UTC m=+360.097013522" watchObservedRunningTime="2026-07-22 03:13:42.637973069 +0000 UTC m=+360.099523476"
Jul 22 03:13:43.426539 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:43.426504    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 22 03:13:43.426636 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:43.426599    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 22 03:13:43.602219 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:43.602181    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49" event={"ID":"de4725a9-b593-4a58-bb55-43a80c6f6878","Type":"ContainerStarted","Data":"0d21aba4854887d84d3068cb43a960dd3aa02e5c784048776aba55695cf0b1aa"}
Jul 22 03:13:43.602640 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:43.602318    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:43.637473 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:43.637423    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49" podStartSLOduration=1.67508165 podStartE2EDuration="4.637408437s" totalImagesPullingTime="2.962326787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:13:43.634250456 +0000 UTC m=+361.095800863" watchObservedRunningTime="2026-07-22 03:13:43.637408437 +0000 UTC m=+361.098958843"
Jul 22 03:13:44.608398 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:44.608370    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-g7q49"
Jul 22 03:13:53.604988 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:13:53.604956    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8587dbf975-cx96x"
Jul 22 03:16:09.466300 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:09.466262    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c85fb"]
Jul 22 03:16:09.469496 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:09.469474    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c85fb"
Jul 22 03:16:09.472076 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:09.472052    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 03:16:09.472228 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:09.472211    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 22 03:16:09.473139 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:09.473120    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 03:16:09.473192 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:09.473139    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2pb9b\""
Jul 22 03:16:09.477285 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:09.477265    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c85fb"]
Jul 22 03:16:09.552578 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:09.543808    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b317c327-4dcb-43e8-baa5-57f252fe7397-config-file\") pod \"limitador-limitador-64c94fd64f-c85fb\" (UID: \"b317c327-4dcb-43e8-baa5-57f252fe7397\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c85fb"
Jul 22 03:16:09.552578 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:09.543940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lmq6\" (UniqueName: \"kubernetes.io/projected/b317c327-4dcb-43e8-baa5-57f252fe7397-kube-api-access-2lmq6\") pod \"limitador-limitador-64c94fd64f-c85fb\" (UID: \"b317c327-4dcb-43e8-baa5-57f252fe7397\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c85fb"
Jul 22 03:16:09.563029 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:09.560741    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c85fb"]
Jul 22 03:16:09.644940 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:09.644906    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lmq6\" (UniqueName: \"kubernetes.io/projected/b317c327-4dcb-43e8-baa5-57f252fe7397-kube-api-access-2lmq6\") pod \"limitador-limitador-64c94fd64f-c85fb\" (UID: \"b317c327-4dcb-43e8-baa5-57f252fe7397\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c85fb"
Jul 22 03:16:09.645098 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:09.644963    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b317c327-4dcb-43e8-baa5-57f252fe7397-config-file\") pod \"limitador-limitador-64c94fd64f-c85fb\" (UID: \"b317c327-4dcb-43e8-baa5-57f252fe7397\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c85fb"
Jul 22 03:16:09.645513 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:09.645495    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b317c327-4dcb-43e8-baa5-57f252fe7397-config-file\") pod \"limitador-limitador-64c94fd64f-c85fb\" (UID: \"b317c327-4dcb-43e8-baa5-57f252fe7397\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c85fb"
Jul 22 03:16:09.654200 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:09.654171    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lmq6\" (UniqueName: \"kubernetes.io/projected/b317c327-4dcb-43e8-baa5-57f252fe7397-kube-api-access-2lmq6\") pod \"limitador-limitador-64c94fd64f-c85fb\" (UID: \"b317c327-4dcb-43e8-baa5-57f252fe7397\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-c85fb"
Jul 22 03:16:09.779909 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:09.779843    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c85fb"
Jul 22 03:16:09.907801 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:09.907774    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c85fb"]
Jul 22 03:16:09.911136 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:16:09.911102    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb317c327_4dcb_43e8_baa5_57f252fe7397.slice/crio-e6f6c1550a90debd04b9aebbdfff086dfac52d1e94579f7d7d92468e910609a2 WatchSource:0}: Error finding container e6f6c1550a90debd04b9aebbdfff086dfac52d1e94579f7d7d92468e910609a2: Status 404 returned error can't find the container with id e6f6c1550a90debd04b9aebbdfff086dfac52d1e94579f7d7d92468e910609a2
Jul 22 03:16:10.143496 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:10.143434    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c85fb" event={"ID":"b317c327-4dcb-43e8-baa5-57f252fe7397","Type":"ContainerStarted","Data":"e6f6c1550a90debd04b9aebbdfff086dfac52d1e94579f7d7d92468e910609a2"}
Jul 22 03:16:13.157674 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:13.157611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c85fb" event={"ID":"b317c327-4dcb-43e8-baa5-57f252fe7397","Type":"ContainerStarted","Data":"127e14b4d461dbc744b9a364b57937aed5e49d114aacc530a0ece33031299504"}
Jul 22 03:16:13.157979 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:13.157688    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-c85fb"
Jul 22 03:16:13.174632 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:13.174585    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-c85fb" podStartSLOduration=1.25366859 podStartE2EDuration="4.174571179s" totalImagesPullingTime="2.920902589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:16:13.172527573 +0000 UTC m=+510.634077980" watchObservedRunningTime="2026-07-22 03:16:13.174571179 +0000 UTC m=+510.636121579"
Jul 22 03:16:24.162289 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:24.162264    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-c85fb"
Jul 22 03:16:24.436342 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:24.436313    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c85fb"]
Jul 22 03:16:24.436508 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:24.436487    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-c85fb" podUID="b317c327-4dcb-43e8-baa5-57f252fe7397" containerName="limitador" containerID="cri-o://127e14b4d461dbc744b9a364b57937aed5e49d114aacc530a0ece33031299504" gracePeriod=30
Jul 22 03:16:25.203798 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.203761    2565 generic.go:356] "Generic (PLEG): container finished" podID="b317c327-4dcb-43e8-baa5-57f252fe7397" containerID="127e14b4d461dbc744b9a364b57937aed5e49d114aacc530a0ece33031299504" exitCode=0
Jul 22 03:16:25.204171 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.203838    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c85fb" event={"ID":"b317c327-4dcb-43e8-baa5-57f252fe7397","Type":"ContainerDied","Data":"127e14b4d461dbc744b9a364b57937aed5e49d114aacc530a0ece33031299504"}
Jul 22 03:16:25.377428 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.377400    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c85fb"
Jul 22 03:16:25.464022 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.463963    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lmq6\" (UniqueName: \"kubernetes.io/projected/b317c327-4dcb-43e8-baa5-57f252fe7397-kube-api-access-2lmq6\") pod \"b317c327-4dcb-43e8-baa5-57f252fe7397\" (UID: \"b317c327-4dcb-43e8-baa5-57f252fe7397\") "
Jul 22 03:16:25.464022 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.464004    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b317c327-4dcb-43e8-baa5-57f252fe7397-config-file\") pod \"b317c327-4dcb-43e8-baa5-57f252fe7397\" (UID: \"b317c327-4dcb-43e8-baa5-57f252fe7397\") "
Jul 22 03:16:25.464339 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.464316    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b317c327-4dcb-43e8-baa5-57f252fe7397-config-file" (OuterVolumeSpecName: "config-file") pod "b317c327-4dcb-43e8-baa5-57f252fe7397" (UID: "b317c327-4dcb-43e8-baa5-57f252fe7397"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:16:25.466113 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.466085    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b317c327-4dcb-43e8-baa5-57f252fe7397-kube-api-access-2lmq6" (OuterVolumeSpecName: "kube-api-access-2lmq6") pod "b317c327-4dcb-43e8-baa5-57f252fe7397" (UID: "b317c327-4dcb-43e8-baa5-57f252fe7397"). InnerVolumeSpecName "kube-api-access-2lmq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:16:25.564906 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.564883    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lmq6\" (UniqueName: \"kubernetes.io/projected/b317c327-4dcb-43e8-baa5-57f252fe7397-kube-api-access-2lmq6\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:16:25.564906 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.564905    2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b317c327-4dcb-43e8-baa5-57f252fe7397-config-file\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:16:25.910486 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.910406    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-l99wf"]
Jul 22 03:16:25.910813 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.910794    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b317c327-4dcb-43e8-baa5-57f252fe7397" containerName="limitador"
Jul 22 03:16:25.910895 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.910816    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b317c327-4dcb-43e8-baa5-57f252fe7397" containerName="limitador"
Jul 22 03:16:25.910895 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.910889    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b317c327-4dcb-43e8-baa5-57f252fe7397" containerName="limitador"
Jul 22 03:16:25.913687 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.913666    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l99wf"
Jul 22 03:16:25.916159 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.916133    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:16:25.916159 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.916146    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 22 03:16:25.916331 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.916241    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 03:16:25.917114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.917099    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-tjpbx\""
Jul 22 03:16:25.923705 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:25.923687    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-l99wf"]
Jul 22 03:16:26.068401 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:26.068375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/333a9c13-1025-4ced-bc1a-a7079dd4fd21-data\") pod \"postgres-69fb4594cf-l99wf\" (UID: \"333a9c13-1025-4ced-bc1a-a7079dd4fd21\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l99wf"
Jul 22 03:16:26.068516 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:26.068420    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqn7v\" (UniqueName: \"kubernetes.io/projected/333a9c13-1025-4ced-bc1a-a7079dd4fd21-kube-api-access-hqn7v\") pod \"postgres-69fb4594cf-l99wf\" (UID: \"333a9c13-1025-4ced-bc1a-a7079dd4fd21\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l99wf"
Jul 22 03:16:26.169523 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:26.169465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/333a9c13-1025-4ced-bc1a-a7079dd4fd21-data\") pod \"postgres-69fb4594cf-l99wf\" (UID: \"333a9c13-1025-4ced-bc1a-a7079dd4fd21\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l99wf"
Jul 22 03:16:26.169523 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:26.169500    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqn7v\" (UniqueName: \"kubernetes.io/projected/333a9c13-1025-4ced-bc1a-a7079dd4fd21-kube-api-access-hqn7v\") pod \"postgres-69fb4594cf-l99wf\" (UID: \"333a9c13-1025-4ced-bc1a-a7079dd4fd21\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l99wf"
Jul 22 03:16:26.169938 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:26.169919    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/333a9c13-1025-4ced-bc1a-a7079dd4fd21-data\") pod \"postgres-69fb4594cf-l99wf\" (UID: \"333a9c13-1025-4ced-bc1a-a7079dd4fd21\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l99wf"
Jul 22 03:16:26.178385 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:26.178358    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqn7v\" (UniqueName: \"kubernetes.io/projected/333a9c13-1025-4ced-bc1a-a7079dd4fd21-kube-api-access-hqn7v\") pod \"postgres-69fb4594cf-l99wf\" (UID: \"333a9c13-1025-4ced-bc1a-a7079dd4fd21\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l99wf"
Jul 22 03:16:26.209368 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:26.209342    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-c85fb" event={"ID":"b317c327-4dcb-43e8-baa5-57f252fe7397","Type":"ContainerDied","Data":"e6f6c1550a90debd04b9aebbdfff086dfac52d1e94579f7d7d92468e910609a2"}
Jul 22 03:16:26.209368 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:26.209357    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-c85fb"
Jul 22 03:16:26.209759 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:26.209398    2565 scope.go:117] "RemoveContainer" containerID="127e14b4d461dbc744b9a364b57937aed5e49d114aacc530a0ece33031299504"
Jul 22 03:16:26.225049 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:26.225033    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l99wf"
Jul 22 03:16:26.230361 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:26.230339    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c85fb"]
Jul 22 03:16:26.240684 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:26.240661    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-c85fb"]
Jul 22 03:16:26.351211 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:26.351172    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-l99wf"]
Jul 22 03:16:26.353923 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:16:26.353896    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod333a9c13_1025_4ced_bc1a_a7079dd4fd21.slice/crio-8d2805195259ed604a6ed7d8e4795aea181123f800447373e9d6aa96bedafde7 WatchSource:0}: Error finding container 8d2805195259ed604a6ed7d8e4795aea181123f800447373e9d6aa96bedafde7: Status 404 returned error can't find the container with id 8d2805195259ed604a6ed7d8e4795aea181123f800447373e9d6aa96bedafde7
Jul 22 03:16:27.217145 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:27.217106    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l99wf" event={"ID":"333a9c13-1025-4ced-bc1a-a7079dd4fd21","Type":"ContainerStarted","Data":"8d2805195259ed604a6ed7d8e4795aea181123f800447373e9d6aa96bedafde7"}
Jul 22 03:16:27.245485 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:27.245152    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b317c327-4dcb-43e8-baa5-57f252fe7397" path="/var/lib/kubelet/pods/b317c327-4dcb-43e8-baa5-57f252fe7397/volumes"
Jul 22 03:16:31.236685 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:31.236656    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l99wf" event={"ID":"333a9c13-1025-4ced-bc1a-a7079dd4fd21","Type":"ContainerStarted","Data":"736b2d7cbd5c9dd1336b8da4be79e213f4d20264138bcc5a76f5fec421d6913c"}
Jul 22 03:16:31.237004 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:31.236718    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l99wf"
Jul 22 03:16:31.255686 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:31.255644    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l99wf" podStartSLOduration=1.464181681 podStartE2EDuration="6.255629517s" totalImagesPullingTime="4.791447836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:16:31.254799596 +0000 UTC m=+528.716350002" watchObservedRunningTime="2026-07-22 03:16:31.255629517 +0000 UTC m=+528.717179923"
Jul 22 03:16:37.278747 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:37.278678    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l99wf"
Jul 22 03:16:44.350577 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.350522    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f7cff76d7-7pvv4"]
Jul 22 03:16:44.373208 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.373180    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f7cff76d7-7pvv4"]
Jul 22 03:16:44.373354 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.373297    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7cff76d7-7pvv4"
Jul 22 03:16:44.375710 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.375677    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 03:16:44.375833 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.375679    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 03:16:44.375833 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.375713    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tqvg2\""
Jul 22 03:16:44.417951 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.417917    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26aea9ae-07e7-4643-9bad-d90cd667488f-webhook-cert\") pod \"maas-controller-f7cff76d7-7pvv4\" (UID: \"26aea9ae-07e7-4643-9bad-d90cd667488f\") " pod="opendatahub/maas-controller-f7cff76d7-7pvv4"
Jul 22 03:16:44.418107 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.417964    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwvvm\" (UniqueName: \"kubernetes.io/projected/26aea9ae-07e7-4643-9bad-d90cd667488f-kube-api-access-pwvvm\") pod \"maas-controller-f7cff76d7-7pvv4\" (UID: \"26aea9ae-07e7-4643-9bad-d90cd667488f\") " pod="opendatahub/maas-controller-f7cff76d7-7pvv4"
Jul 22 03:16:44.518711 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.518678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26aea9ae-07e7-4643-9bad-d90cd667488f-webhook-cert\") pod \"maas-controller-f7cff76d7-7pvv4\" (UID: \"26aea9ae-07e7-4643-9bad-d90cd667488f\") " pod="opendatahub/maas-controller-f7cff76d7-7pvv4"
Jul 22 03:16:44.518711 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.518717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwvvm\" (UniqueName: \"kubernetes.io/projected/26aea9ae-07e7-4643-9bad-d90cd667488f-kube-api-access-pwvvm\") pod \"maas-controller-f7cff76d7-7pvv4\" (UID: \"26aea9ae-07e7-4643-9bad-d90cd667488f\") " pod="opendatahub/maas-controller-f7cff76d7-7pvv4"
Jul 22 03:16:44.518905 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:16:44.518819    2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 22 03:16:44.518905 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:16:44.518879    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26aea9ae-07e7-4643-9bad-d90cd667488f-webhook-cert podName:26aea9ae-07e7-4643-9bad-d90cd667488f nodeName:}" failed. No retries permitted until 2026-07-22 03:16:45.018862871 +0000 UTC m=+542.480413255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/26aea9ae-07e7-4643-9bad-d90cd667488f-webhook-cert") pod "maas-controller-f7cff76d7-7pvv4" (UID: "26aea9ae-07e7-4643-9bad-d90cd667488f") : secret "maas-controller-webhook-cert" not found
Jul 22 03:16:44.531449 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.531420    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwvvm\" (UniqueName: \"kubernetes.io/projected/26aea9ae-07e7-4643-9bad-d90cd667488f-kube-api-access-pwvvm\") pod \"maas-controller-f7cff76d7-7pvv4\" (UID: \"26aea9ae-07e7-4643-9bad-d90cd667488f\") " pod="opendatahub/maas-controller-f7cff76d7-7pvv4"
Jul 22 03:16:44.576933 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.576903    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c66fb4cb9-m9c7q"]
Jul 22 03:16:44.579215 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.579190    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c66fb4cb9-m9c7q"
Jul 22 03:16:44.594581 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.594534    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c66fb4cb9-m9c7q"]
Jul 22 03:16:44.620002 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.619939    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0-webhook-cert\") pod \"maas-controller-5c66fb4cb9-m9c7q\" (UID: \"eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0\") " pod="opendatahub/maas-controller-5c66fb4cb9-m9c7q"
Jul 22 03:16:44.620002 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.619973    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf542\" (UniqueName: \"kubernetes.io/projected/eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0-kube-api-access-kf542\") pod \"maas-controller-5c66fb4cb9-m9c7q\" (UID: \"eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0\") " pod="opendatahub/maas-controller-5c66fb4cb9-m9c7q"
Jul 22 03:16:44.721146 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.721115    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0-webhook-cert\") pod \"maas-controller-5c66fb4cb9-m9c7q\" (UID: \"eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0\") " pod="opendatahub/maas-controller-5c66fb4cb9-m9c7q"
Jul 22 03:16:44.721262 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.721151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf542\" (UniqueName: \"kubernetes.io/projected/eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0-kube-api-access-kf542\") pod \"maas-controller-5c66fb4cb9-m9c7q\" (UID: \"eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0\") " pod="opendatahub/maas-controller-5c66fb4cb9-m9c7q"
Jul 22 03:16:44.723465 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.723437    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0-webhook-cert\") pod \"maas-controller-5c66fb4cb9-m9c7q\" (UID: \"eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0\") " pod="opendatahub/maas-controller-5c66fb4cb9-m9c7q"
Jul 22 03:16:44.730496 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.730475    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf542\" (UniqueName: \"kubernetes.io/projected/eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0-kube-api-access-kf542\") pod \"maas-controller-5c66fb4cb9-m9c7q\" (UID: \"eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0\") " pod="opendatahub/maas-controller-5c66fb4cb9-m9c7q"
Jul 22 03:16:44.890205 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:44.890128    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c66fb4cb9-m9c7q"
Jul 22 03:16:45.015958 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:45.015919    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c66fb4cb9-m9c7q"]
Jul 22 03:16:45.018620 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:16:45.018590    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa8cc74_c3f8_4c2a_bce3_3cf894616cb0.slice/crio-016ce0ecc4779b7a64080e5deb1979c248d21a9c9f14e0313b53cca70bce7916 WatchSource:0}: Error finding container 016ce0ecc4779b7a64080e5deb1979c248d21a9c9f14e0313b53cca70bce7916: Status 404 returned error can't find the container with id 016ce0ecc4779b7a64080e5deb1979c248d21a9c9f14e0313b53cca70bce7916
Jul 22 03:16:45.023706 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:45.023683    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26aea9ae-07e7-4643-9bad-d90cd667488f-webhook-cert\") pod \"maas-controller-f7cff76d7-7pvv4\" (UID: \"26aea9ae-07e7-4643-9bad-d90cd667488f\") " pod="opendatahub/maas-controller-f7cff76d7-7pvv4"
Jul 22 03:16:45.025893 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:45.025871    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26aea9ae-07e7-4643-9bad-d90cd667488f-webhook-cert\") pod \"maas-controller-f7cff76d7-7pvv4\" (UID: \"26aea9ae-07e7-4643-9bad-d90cd667488f\") " pod="opendatahub/maas-controller-f7cff76d7-7pvv4"
Jul 22 03:16:45.284428 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:45.284399    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7cff76d7-7pvv4"
Jul 22 03:16:45.290850 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:45.290823    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c66fb4cb9-m9c7q" event={"ID":"eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0","Type":"ContainerStarted","Data":"016ce0ecc4779b7a64080e5deb1979c248d21a9c9f14e0313b53cca70bce7916"}
Jul 22 03:16:45.406798 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:45.406776    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f7cff76d7-7pvv4"]
Jul 22 03:16:45.409103 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:16:45.409073    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26aea9ae_07e7_4643_9bad_d90cd667488f.slice/crio-e3ae41c98fd27e0baa94fe77408e2c21595e2cd27c295977b5d278fc988d3b0d WatchSource:0}: Error finding container e3ae41c98fd27e0baa94fe77408e2c21595e2cd27c295977b5d278fc988d3b0d: Status 404 returned error can't find the container with id e3ae41c98fd27e0baa94fe77408e2c21595e2cd27c295977b5d278fc988d3b0d
Jul 22 03:16:46.297367 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:46.297330    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7cff76d7-7pvv4" event={"ID":"26aea9ae-07e7-4643-9bad-d90cd667488f","Type":"ContainerStarted","Data":"e3ae41c98fd27e0baa94fe77408e2c21595e2cd27c295977b5d278fc988d3b0d"}
Jul 22 03:16:48.306633 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:48.306592    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c66fb4cb9-m9c7q" event={"ID":"eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0","Type":"ContainerStarted","Data":"3b9ea35d5871bb184f42d57bffe045844a491ef37993221114e0a4376ab7ed7f"}
Jul 22 03:16:48.307041 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:48.306743    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c66fb4cb9-m9c7q"
Jul 22 03:16:48.308059 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:48.308038    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7cff76d7-7pvv4" event={"ID":"26aea9ae-07e7-4643-9bad-d90cd667488f","Type":"ContainerStarted","Data":"37a14099d34d8497fbc9a2f13dcdcfca5a7dd8c74594e9ee03e077640c9fa88a"}
Jul 22 03:16:48.308174 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:48.308159    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f7cff76d7-7pvv4"
Jul 22 03:16:48.327642 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:48.327601    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c66fb4cb9-m9c7q" podStartSLOduration=1.76816159 podStartE2EDuration="4.327582737s" totalImagesPullingTime="2.559421147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:16:48.326708687 +0000 UTC m=+545.788259095" watchObservedRunningTime="2026-07-22 03:16:48.327582737 +0000 UTC m=+545.789133141"
Jul 22 03:16:48.344094 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:48.344043    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f7cff76d7-7pvv4" podStartSLOduration=2.16685683 podStartE2EDuration="4.344025769s" totalImagesPullingTime="2.177168939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:16:48.343436219 +0000 UTC m=+545.804986699" watchObservedRunningTime="2026-07-22 03:16:48.344025769 +0000 UTC m=+545.805576176"
Jul 22 03:16:59.314226 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:59.314199    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c66fb4cb9-m9c7q"
Jul 22 03:16:59.314698 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:59.314266    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f7cff76d7-7pvv4"
Jul 22 03:16:59.376634 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:59.376605    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f7cff76d7-7pvv4"]
Jul 22 03:16:59.376831 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:59.376809    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-f7cff76d7-7pvv4" podUID="26aea9ae-07e7-4643-9bad-d90cd667488f" containerName="manager" containerID="cri-o://37a14099d34d8497fbc9a2f13dcdcfca5a7dd8c74594e9ee03e077640c9fa88a" gracePeriod=30
Jul 22 03:16:59.617242 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:59.617218    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7cff76d7-7pvv4"
Jul 22 03:16:59.648235 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:59.648212    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26aea9ae-07e7-4643-9bad-d90cd667488f-webhook-cert\") pod \"26aea9ae-07e7-4643-9bad-d90cd667488f\" (UID: \"26aea9ae-07e7-4643-9bad-d90cd667488f\") "
Jul 22 03:16:59.648356 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:59.648244    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwvvm\" (UniqueName: \"kubernetes.io/projected/26aea9ae-07e7-4643-9bad-d90cd667488f-kube-api-access-pwvvm\") pod \"26aea9ae-07e7-4643-9bad-d90cd667488f\" (UID: \"26aea9ae-07e7-4643-9bad-d90cd667488f\") "
Jul 22 03:16:59.650344 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:59.650313    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26aea9ae-07e7-4643-9bad-d90cd667488f-kube-api-access-pwvvm" (OuterVolumeSpecName: "kube-api-access-pwvvm") pod "26aea9ae-07e7-4643-9bad-d90cd667488f" (UID: "26aea9ae-07e7-4643-9bad-d90cd667488f"). InnerVolumeSpecName "kube-api-access-pwvvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:16:59.650478 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:59.650423    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26aea9ae-07e7-4643-9bad-d90cd667488f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "26aea9ae-07e7-4643-9bad-d90cd667488f" (UID: "26aea9ae-07e7-4643-9bad-d90cd667488f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:16:59.749750 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:59.749710    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26aea9ae-07e7-4643-9bad-d90cd667488f-webhook-cert\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:16:59.749750 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:16:59.749749    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwvvm\" (UniqueName: \"kubernetes.io/projected/26aea9ae-07e7-4643-9bad-d90cd667488f-kube-api-access-pwvvm\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:17:00.354017 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:00.353981    2565 generic.go:356] "Generic (PLEG): container finished" podID="26aea9ae-07e7-4643-9bad-d90cd667488f" containerID="37a14099d34d8497fbc9a2f13dcdcfca5a7dd8c74594e9ee03e077640c9fa88a" exitCode=0
Jul 22 03:17:00.354453 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:00.354027    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7cff76d7-7pvv4"
Jul 22 03:17:00.354453 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:00.354034    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7cff76d7-7pvv4" event={"ID":"26aea9ae-07e7-4643-9bad-d90cd667488f","Type":"ContainerDied","Data":"37a14099d34d8497fbc9a2f13dcdcfca5a7dd8c74594e9ee03e077640c9fa88a"}
Jul 22 03:17:00.354453 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:00.354085    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7cff76d7-7pvv4" event={"ID":"26aea9ae-07e7-4643-9bad-d90cd667488f","Type":"ContainerDied","Data":"e3ae41c98fd27e0baa94fe77408e2c21595e2cd27c295977b5d278fc988d3b0d"}
Jul 22 03:17:00.354453 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:00.354111    2565 scope.go:117] "RemoveContainer" containerID="37a14099d34d8497fbc9a2f13dcdcfca5a7dd8c74594e9ee03e077640c9fa88a"
Jul 22 03:17:00.364419 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:00.364400    2565 scope.go:117] "RemoveContainer" containerID="37a14099d34d8497fbc9a2f13dcdcfca5a7dd8c74594e9ee03e077640c9fa88a"
Jul 22 03:17:00.364709 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:17:00.364686    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37a14099d34d8497fbc9a2f13dcdcfca5a7dd8c74594e9ee03e077640c9fa88a\": container with ID starting with 37a14099d34d8497fbc9a2f13dcdcfca5a7dd8c74594e9ee03e077640c9fa88a not found: ID does not exist" containerID="37a14099d34d8497fbc9a2f13dcdcfca5a7dd8c74594e9ee03e077640c9fa88a"
Jul 22 03:17:00.364757 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:00.364719    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37a14099d34d8497fbc9a2f13dcdcfca5a7dd8c74594e9ee03e077640c9fa88a"} err="failed to get container status \"37a14099d34d8497fbc9a2f13dcdcfca5a7dd8c74594e9ee03e077640c9fa88a\": rpc error: code = NotFound desc = could not find container \"37a14099d34d8497fbc9a2f13dcdcfca5a7dd8c74594e9ee03e077640c9fa88a\": container with ID starting with 37a14099d34d8497fbc9a2f13dcdcfca5a7dd8c74594e9ee03e077640c9fa88a not found: ID does not exist"
Jul 22 03:17:00.377618 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:00.377598    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f7cff76d7-7pvv4"]
Jul 22 03:17:00.386931 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:00.386911    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f7cff76d7-7pvv4"]
Jul 22 03:17:01.243472 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:01.243427    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26aea9ae-07e7-4643-9bad-d90cd667488f" path="/var/lib/kubelet/pods/26aea9ae-07e7-4643-9bad-d90cd667488f/volumes"
Jul 22 03:17:20.885786 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:20.885752    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-67964b4c9-xqj56"]
Jul 22 03:17:20.886234 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:20.886045    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26aea9ae-07e7-4643-9bad-d90cd667488f" containerName="manager"
Jul 22 03:17:20.886234 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:20.886056    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="26aea9ae-07e7-4643-9bad-d90cd667488f" containerName="manager"
Jul 22 03:17:20.886234 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:20.886115    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="26aea9ae-07e7-4643-9bad-d90cd667488f" containerName="manager"
Jul 22 03:17:20.890666 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:20.890645    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67964b4c9-xqj56"
Jul 22 03:17:20.893000 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:20.892981    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 22 03:17:20.893065 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:20.893025    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g7wfm\""
Jul 22 03:17:20.900109 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:20.900083    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67964b4c9-xqj56"]
Jul 22 03:17:21.029025 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.028994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8ef4cfe-2175-4a5a-8e67-ef1bd3756903-maas-api-tls\") pod \"maas-api-67964b4c9-xqj56\" (UID: \"d8ef4cfe-2175-4a5a-8e67-ef1bd3756903\") " pod="odh-ai-gateway-infra/maas-api-67964b4c9-xqj56"
Jul 22 03:17:21.029167 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.029060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8ef4cfe-2175-4a5a-8e67-ef1bd3756903-openshift-service-ca\") pod \"maas-api-67964b4c9-xqj56\" (UID: \"d8ef4cfe-2175-4a5a-8e67-ef1bd3756903\") " pod="odh-ai-gateway-infra/maas-api-67964b4c9-xqj56"
Jul 22 03:17:21.029167 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.029093    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pkzf\" (UniqueName: \"kubernetes.io/projected/d8ef4cfe-2175-4a5a-8e67-ef1bd3756903-kube-api-access-5pkzf\") pod \"maas-api-67964b4c9-xqj56\" (UID: \"d8ef4cfe-2175-4a5a-8e67-ef1bd3756903\") " pod="odh-ai-gateway-infra/maas-api-67964b4c9-xqj56"
Jul 22 03:17:21.129622 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.129589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8ef4cfe-2175-4a5a-8e67-ef1bd3756903-openshift-service-ca\") pod \"maas-api-67964b4c9-xqj56\" (UID: \"d8ef4cfe-2175-4a5a-8e67-ef1bd3756903\") " pod="odh-ai-gateway-infra/maas-api-67964b4c9-xqj56"
Jul 22 03:17:21.129622 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.129622    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pkzf\" (UniqueName: \"kubernetes.io/projected/d8ef4cfe-2175-4a5a-8e67-ef1bd3756903-kube-api-access-5pkzf\") pod \"maas-api-67964b4c9-xqj56\" (UID: \"d8ef4cfe-2175-4a5a-8e67-ef1bd3756903\") " pod="odh-ai-gateway-infra/maas-api-67964b4c9-xqj56"
Jul 22 03:17:21.129762 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.129664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8ef4cfe-2175-4a5a-8e67-ef1bd3756903-maas-api-tls\") pod \"maas-api-67964b4c9-xqj56\" (UID: \"d8ef4cfe-2175-4a5a-8e67-ef1bd3756903\") " pod="odh-ai-gateway-infra/maas-api-67964b4c9-xqj56"
Jul 22 03:17:21.129802 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:17:21.129766    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 22 03:17:21.129835 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:17:21.129828    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ef4cfe-2175-4a5a-8e67-ef1bd3756903-maas-api-tls podName:d8ef4cfe-2175-4a5a-8e67-ef1bd3756903 nodeName:}" failed. No retries permitted until 2026-07-22 03:17:21.629812256 +0000 UTC m=+579.091362640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d8ef4cfe-2175-4a5a-8e67-ef1bd3756903-maas-api-tls") pod "maas-api-67964b4c9-xqj56" (UID: "d8ef4cfe-2175-4a5a-8e67-ef1bd3756903") : secret "maas-api-serving-cert" not found
Jul 22 03:17:21.130222 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.130204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8ef4cfe-2175-4a5a-8e67-ef1bd3756903-openshift-service-ca\") pod \"maas-api-67964b4c9-xqj56\" (UID: \"d8ef4cfe-2175-4a5a-8e67-ef1bd3756903\") " pod="odh-ai-gateway-infra/maas-api-67964b4c9-xqj56"
Jul 22 03:17:21.141295 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.141234    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pkzf\" (UniqueName: \"kubernetes.io/projected/d8ef4cfe-2175-4a5a-8e67-ef1bd3756903-kube-api-access-5pkzf\") pod \"maas-api-67964b4c9-xqj56\" (UID: \"d8ef4cfe-2175-4a5a-8e67-ef1bd3756903\") " pod="odh-ai-gateway-infra/maas-api-67964b4c9-xqj56"
Jul 22 03:17:21.426202 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.426171    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-nskb8"]
Jul 22 03:17:21.429018 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.428998    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-nskb8"
Jul 22 03:17:21.431514 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.431493    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-cdxp2\""
Jul 22 03:17:21.431621 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.431518    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 22 03:17:21.439911 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.439888    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-nskb8"]
Jul 22 03:17:21.533758 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.533728    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tgh8\" (UniqueName: \"kubernetes.io/projected/528ac324-9b2e-4d49-a177-10deebd04583-kube-api-access-5tgh8\") pod \"payload-pre-processing-7677b774bb-nskb8\" (UID: \"528ac324-9b2e-4d49-a177-10deebd04583\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-nskb8"
Jul 22 03:17:21.533867 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.533787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/528ac324-9b2e-4d49-a177-10deebd04583-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-nskb8\" (UID: \"528ac324-9b2e-4d49-a177-10deebd04583\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-nskb8"
Jul 22 03:17:21.634679 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.634643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/528ac324-9b2e-4d49-a177-10deebd04583-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-nskb8\" (UID: \"528ac324-9b2e-4d49-a177-10deebd04583\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-nskb8"
Jul 22 03:17:21.634860 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.634705    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8ef4cfe-2175-4a5a-8e67-ef1bd3756903-maas-api-tls\") pod \"maas-api-67964b4c9-xqj56\" (UID: \"d8ef4cfe-2175-4a5a-8e67-ef1bd3756903\") " pod="odh-ai-gateway-infra/maas-api-67964b4c9-xqj56"
Jul 22 03:17:21.634860 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.634760    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tgh8\" (UniqueName: \"kubernetes.io/projected/528ac324-9b2e-4d49-a177-10deebd04583-kube-api-access-5tgh8\") pod \"payload-pre-processing-7677b774bb-nskb8\" (UID: \"528ac324-9b2e-4d49-a177-10deebd04583\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-nskb8"
Jul 22 03:17:21.635488 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.635464    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/528ac324-9b2e-4d49-a177-10deebd04583-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-nskb8\" (UID: \"528ac324-9b2e-4d49-a177-10deebd04583\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-nskb8"
Jul 22 03:17:21.637394 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.637364    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8ef4cfe-2175-4a5a-8e67-ef1bd3756903-maas-api-tls\") pod \"maas-api-67964b4c9-xqj56\" (UID: \"d8ef4cfe-2175-4a5a-8e67-ef1bd3756903\") " pod="odh-ai-gateway-infra/maas-api-67964b4c9-xqj56"
Jul 22 03:17:21.642965 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.642940    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tgh8\" (UniqueName: \"kubernetes.io/projected/528ac324-9b2e-4d49-a177-10deebd04583-kube-api-access-5tgh8\") pod \"payload-pre-processing-7677b774bb-nskb8\" (UID: \"528ac324-9b2e-4d49-a177-10deebd04583\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-nskb8"
Jul 22 03:17:21.739928 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.739855    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-nskb8"
Jul 22 03:17:21.801432 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.801400    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67964b4c9-xqj56"
Jul 22 03:17:21.870352 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.870325    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-nskb8"]
Jul 22 03:17:21.872862 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:17:21.872831    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528ac324_9b2e_4d49_a177_10deebd04583.slice/crio-e0beb7ef5b3474dc29087ea06a5204dbe8a1d7fcda74242782a556da963518a2 WatchSource:0}: Error finding container e0beb7ef5b3474dc29087ea06a5204dbe8a1d7fcda74242782a556da963518a2: Status 404 returned error can't find the container with id e0beb7ef5b3474dc29087ea06a5204dbe8a1d7fcda74242782a556da963518a2
Jul 22 03:17:21.936461 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:21.936433    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67964b4c9-xqj56"]
Jul 22 03:17:21.938843 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:17:21.938815    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ef4cfe_2175_4a5a_8e67_ef1bd3756903.slice/crio-d39863cbf520218476f44845b764f65a35924b3e9d174b44b4c318b03b9365e9 WatchSource:0}: Error finding container d39863cbf520218476f44845b764f65a35924b3e9d174b44b4c318b03b9365e9: Status 404 returned error can't find the container with id d39863cbf520218476f44845b764f65a35924b3e9d174b44b4c318b03b9365e9
Jul 22 03:17:22.436929 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:22.436873    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-nskb8" event={"ID":"528ac324-9b2e-4d49-a177-10deebd04583","Type":"ContainerStarted","Data":"e0beb7ef5b3474dc29087ea06a5204dbe8a1d7fcda74242782a556da963518a2"}
Jul 22 03:17:22.438411 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:22.438380    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67964b4c9-xqj56" event={"ID":"d8ef4cfe-2175-4a5a-8e67-ef1bd3756903","Type":"ContainerStarted","Data":"d39863cbf520218476f44845b764f65a35924b3e9d174b44b4c318b03b9365e9"}
Jul 22 03:17:25.453509 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:25.453470    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-nskb8" event={"ID":"528ac324-9b2e-4d49-a177-10deebd04583","Type":"ContainerStarted","Data":"17a0ea143e53d101f85e13390be645f81ee28925906ceda0ad25d1658db8bf73"}
Jul 22 03:17:25.454013 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:25.453590    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-nskb8"
Jul 22 03:17:25.455071 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:25.455049    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67964b4c9-xqj56" event={"ID":"d8ef4cfe-2175-4a5a-8e67-ef1bd3756903","Type":"ContainerStarted","Data":"0b31f0db0ef0fbb68d227fb1252e750d11852a0bef15537180221826687b1708"}
Jul 22 03:17:25.455174 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:25.455098    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-67964b4c9-xqj56"
Jul 22 03:17:25.471187 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:25.471139    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-nskb8" podStartSLOduration=1.956527836 podStartE2EDuration="4.47112448s" totalImagesPullingTime="2.514596644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:17:25.470131288 +0000 UTC m=+582.931681694" watchObservedRunningTime="2026-07-22 03:17:25.47112448 +0000 UTC m=+582.932674885"
Jul 22 03:17:25.485318 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:25.485270    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-67964b4c9-xqj56" podStartSLOduration=3.037619454 podStartE2EDuration="5.485251947s" totalImagesPullingTime="2.447632493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:17:25.485123352 +0000 UTC m=+582.946673741" watchObservedRunningTime="2026-07-22 03:17:25.485251947 +0000 UTC m=+582.946802348"
Jul 22 03:17:31.464738 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:31.464712    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-67964b4c9-xqj56"
Jul 22 03:17:36.461349 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:36.461320    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-nskb8"
Jul 22 03:17:38.140837 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.140805    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"]
Jul 22 03:17:38.143995 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.143978    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.146550 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.146526    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 03:17:38.147345 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.147329    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 03:17:38.147660 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.147644    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9dh47\""
Jul 22 03:17:38.147726 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.147653    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 22 03:17:38.152375 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.152355    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"]
Jul 22 03:17:38.169320 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.169297    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9319a121-cb27-443a-98eb-009901193d26-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt\" (UID: \"9319a121-cb27-443a-98eb-009901193d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.169415 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.169324    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9319a121-cb27-443a-98eb-009901193d26-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt\" (UID: \"9319a121-cb27-443a-98eb-009901193d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.169415 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.169348    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdrfz\" (UniqueName: \"kubernetes.io/projected/9319a121-cb27-443a-98eb-009901193d26-kube-api-access-vdrfz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt\" (UID: \"9319a121-cb27-443a-98eb-009901193d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.169415 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.169368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9319a121-cb27-443a-98eb-009901193d26-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt\" (UID: \"9319a121-cb27-443a-98eb-009901193d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.169415 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.169386    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9319a121-cb27-443a-98eb-009901193d26-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt\" (UID: \"9319a121-cb27-443a-98eb-009901193d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.169551 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.169451    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9319a121-cb27-443a-98eb-009901193d26-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt\" (UID: \"9319a121-cb27-443a-98eb-009901193d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.269733 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.269710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9319a121-cb27-443a-98eb-009901193d26-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt\" (UID: \"9319a121-cb27-443a-98eb-009901193d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.269870 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.269753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9319a121-cb27-443a-98eb-009901193d26-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt\" (UID: \"9319a121-cb27-443a-98eb-009901193d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.269976 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.269950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9319a121-cb27-443a-98eb-009901193d26-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt\" (UID: \"9319a121-cb27-443a-98eb-009901193d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.270138 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.270112    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9319a121-cb27-443a-98eb-009901193d26-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt\" (UID: \"9319a121-cb27-443a-98eb-009901193d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.270242 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.270050    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9319a121-cb27-443a-98eb-009901193d26-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt\" (UID: \"9319a121-cb27-443a-98eb-009901193d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.270242 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.270143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9319a121-cb27-443a-98eb-009901193d26-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt\" (UID: \"9319a121-cb27-443a-98eb-009901193d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.270242 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.270200    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdrfz\" (UniqueName: \"kubernetes.io/projected/9319a121-cb27-443a-98eb-009901193d26-kube-api-access-vdrfz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt\" (UID: \"9319a121-cb27-443a-98eb-009901193d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.270242 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.270235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9319a121-cb27-443a-98eb-009901193d26-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt\" (UID: \"9319a121-cb27-443a-98eb-009901193d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.270588 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.270549    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9319a121-cb27-443a-98eb-009901193d26-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt\" (UID: \"9319a121-cb27-443a-98eb-009901193d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.272053 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.272032    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9319a121-cb27-443a-98eb-009901193d26-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt\" (UID: \"9319a121-cb27-443a-98eb-009901193d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.272518 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.272499    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9319a121-cb27-443a-98eb-009901193d26-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt\" (UID: \"9319a121-cb27-443a-98eb-009901193d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.277701 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.277681    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdrfz\" (UniqueName: \"kubernetes.io/projected/9319a121-cb27-443a-98eb-009901193d26-kube-api-access-vdrfz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt\" (UID: \"9319a121-cb27-443a-98eb-009901193d26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.455002 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.454955    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:38.581147 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:38.581114    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"]
Jul 22 03:17:38.583616 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:17:38.583588    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9319a121_cb27_443a_98eb_009901193d26.slice/crio-17abe5c24f61fc235587dab87f9e6970183f58bdf006d25af129f2d1df6340b6 WatchSource:0}: Error finding container 17abe5c24f61fc235587dab87f9e6970183f58bdf006d25af129f2d1df6340b6: Status 404 returned error can't find the container with id 17abe5c24f61fc235587dab87f9e6970183f58bdf006d25af129f2d1df6340b6
Jul 22 03:17:39.514933 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:39.514895    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt" event={"ID":"9319a121-cb27-443a-98eb-009901193d26","Type":"ContainerStarted","Data":"17abe5c24f61fc235587dab87f9e6970183f58bdf006d25af129f2d1df6340b6"}
Jul 22 03:17:40.520492 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:40.520457    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt" event={"ID":"9319a121-cb27-443a-98eb-009901193d26","Type":"ContainerStarted","Data":"08557b872676c2bb072f44df0852a2ad2bf167dfea73af97345c89187a162307"}
Jul 22 03:17:40.538301 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:40.538257    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt" podStartSLOduration=1.534131514 podStartE2EDuration="2.538243995s" totalImagesPullingTime="1.004112481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:17:40.536466163 +0000 UTC m=+597.998016570" watchObservedRunningTime="2026-07-22 03:17:40.538243995 +0000 UTC m=+597.999794400"
Jul 22 03:17:48.455470 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:48.455441    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:48.455920 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:48.455536    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:48.467508 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:48.467488    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:17:48.565026 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:17:48.565005    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt"
Jul 22 03:18:20.628912 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.628877    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"]
Jul 22 03:18:20.634924 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.634908    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.637343 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.637320    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 22 03:18:20.640931 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.640907    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"]
Jul 22 03:18:20.816894 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.816857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2a92ce0-7ee6-4c16-9488-141c72218f4f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9\" (UID: \"a2a92ce0-7ee6-4c16-9488-141c72218f4f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.816894 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.816898    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2a92ce0-7ee6-4c16-9488-141c72218f4f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9\" (UID: \"a2a92ce0-7ee6-4c16-9488-141c72218f4f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.817185 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.816981    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2a92ce0-7ee6-4c16-9488-141c72218f4f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9\" (UID: \"a2a92ce0-7ee6-4c16-9488-141c72218f4f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.817185 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.817071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2a92ce0-7ee6-4c16-9488-141c72218f4f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9\" (UID: \"a2a92ce0-7ee6-4c16-9488-141c72218f4f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.817185 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.817119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj72q\" (UniqueName: \"kubernetes.io/projected/a2a92ce0-7ee6-4c16-9488-141c72218f4f-kube-api-access-vj72q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9\" (UID: \"a2a92ce0-7ee6-4c16-9488-141c72218f4f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.817339 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.817243    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2a92ce0-7ee6-4c16-9488-141c72218f4f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9\" (UID: \"a2a92ce0-7ee6-4c16-9488-141c72218f4f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.918415 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.918312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2a92ce0-7ee6-4c16-9488-141c72218f4f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9\" (UID: \"a2a92ce0-7ee6-4c16-9488-141c72218f4f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.918415 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.918365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2a92ce0-7ee6-4c16-9488-141c72218f4f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9\" (UID: \"a2a92ce0-7ee6-4c16-9488-141c72218f4f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.918415 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.918392    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj72q\" (UniqueName: \"kubernetes.io/projected/a2a92ce0-7ee6-4c16-9488-141c72218f4f-kube-api-access-vj72q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9\" (UID: \"a2a92ce0-7ee6-4c16-9488-141c72218f4f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.918764 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.918447    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2a92ce0-7ee6-4c16-9488-141c72218f4f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9\" (UID: \"a2a92ce0-7ee6-4c16-9488-141c72218f4f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.918764 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.918495    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2a92ce0-7ee6-4c16-9488-141c72218f4f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9\" (UID: \"a2a92ce0-7ee6-4c16-9488-141c72218f4f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.918764 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.918524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2a92ce0-7ee6-4c16-9488-141c72218f4f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9\" (UID: \"a2a92ce0-7ee6-4c16-9488-141c72218f4f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.918925 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.918858    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2a92ce0-7ee6-4c16-9488-141c72218f4f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9\" (UID: \"a2a92ce0-7ee6-4c16-9488-141c72218f4f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.918925 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.918901    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2a92ce0-7ee6-4c16-9488-141c72218f4f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9\" (UID: \"a2a92ce0-7ee6-4c16-9488-141c72218f4f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.919017 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.918941    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2a92ce0-7ee6-4c16-9488-141c72218f4f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9\" (UID: \"a2a92ce0-7ee6-4c16-9488-141c72218f4f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.920801 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.920776    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2a92ce0-7ee6-4c16-9488-141c72218f4f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9\" (UID: \"a2a92ce0-7ee6-4c16-9488-141c72218f4f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.921019 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.921000    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2a92ce0-7ee6-4c16-9488-141c72218f4f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9\" (UID: \"a2a92ce0-7ee6-4c16-9488-141c72218f4f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.926306 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.926287    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj72q\" (UniqueName: \"kubernetes.io/projected/a2a92ce0-7ee6-4c16-9488-141c72218f4f-kube-api-access-vj72q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9\" (UID: \"a2a92ce0-7ee6-4c16-9488-141c72218f4f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:20.946363 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:20.946337    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:21.080214 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:21.080186    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"]
Jul 22 03:18:21.082687 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:18:21.082661    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a92ce0_7ee6_4c16_9488_141c72218f4f.slice/crio-1c108a04fc91f5c2c3b4e3c3cdd989a9586f6e8a9e663228978836941afcfe2d WatchSource:0}: Error finding container 1c108a04fc91f5c2c3b4e3c3cdd989a9586f6e8a9e663228978836941afcfe2d: Status 404 returned error can't find the container with id 1c108a04fc91f5c2c3b4e3c3cdd989a9586f6e8a9e663228978836941afcfe2d
Jul 22 03:18:21.084089 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:21.084072    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:18:21.694984 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:21.694949    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9" event={"ID":"a2a92ce0-7ee6-4c16-9488-141c72218f4f","Type":"ContainerStarted","Data":"5303de65001e014b33de02d895817f698d67134f6fbc9bf67b4572fb9f359a47"}
Jul 22 03:18:21.695388 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:21.695007    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9" event={"ID":"a2a92ce0-7ee6-4c16-9488-141c72218f4f","Type":"ContainerStarted","Data":"1c108a04fc91f5c2c3b4e3c3cdd989a9586f6e8a9e663228978836941afcfe2d"}
Jul 22 03:18:21.711122 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:21.711067    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9" podStartSLOduration=1.521123134 podStartE2EDuration="1.71104671s" totalImagesPullingTime="189.923576ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:18:21.709679206 +0000 UTC m=+639.171229612" watchObservedRunningTime="2026-07-22 03:18:21.71104671 +0000 UTC m=+639.172597118"
Jul 22 03:18:30.947582 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:30.947523    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:30.947972 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:30.947626    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:30.959851 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:30.959812    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:18:31.747287 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:18:31.747258    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9"
Jul 22 03:20:45.412681 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:45.412648    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c66fb4cb9-m9c7q"]
Jul 22 03:20:45.413176 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:45.412840    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5c66fb4cb9-m9c7q" podUID="eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0" containerName="manager" containerID="cri-o://3b9ea35d5871bb184f42d57bffe045844a491ef37993221114e0a4376ab7ed7f" gracePeriod=30
Jul 22 03:20:45.661679 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:45.661656    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c66fb4cb9-m9c7q"
Jul 22 03:20:45.677158 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:45.677139    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kf542\" (UniqueName: \"kubernetes.io/projected/eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0-kube-api-access-kf542\") pod \"eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0\" (UID: \"eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0\") "
Jul 22 03:20:45.677241 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:45.677202    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0-webhook-cert\") pod \"eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0\" (UID: \"eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0\") "
Jul 22 03:20:45.679004 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:45.678978    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0-kube-api-access-kf542" (OuterVolumeSpecName: "kube-api-access-kf542") pod "eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0" (UID: "eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0"). InnerVolumeSpecName "kube-api-access-kf542". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:20:45.679098 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:45.679043    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0" (UID: "eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:20:45.778066 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:45.778036    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0-webhook-cert\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:20:45.778066 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:45.778061    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf542\" (UniqueName: \"kubernetes.io/projected/eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0-kube-api-access-kf542\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:20:46.315546 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:46.315510    2565 generic.go:356] "Generic (PLEG): container finished" podID="eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0" containerID="3b9ea35d5871bb184f42d57bffe045844a491ef37993221114e0a4376ab7ed7f" exitCode=0
Jul 22 03:20:46.315725 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:46.315551    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c66fb4cb9-m9c7q"
Jul 22 03:20:46.315725 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:46.315580    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c66fb4cb9-m9c7q" event={"ID":"eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0","Type":"ContainerDied","Data":"3b9ea35d5871bb184f42d57bffe045844a491ef37993221114e0a4376ab7ed7f"}
Jul 22 03:20:46.315725 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:46.315627    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c66fb4cb9-m9c7q" event={"ID":"eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0","Type":"ContainerDied","Data":"016ce0ecc4779b7a64080e5deb1979c248d21a9c9f14e0313b53cca70bce7916"}
Jul 22 03:20:46.315725 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:46.315648    2565 scope.go:117] "RemoveContainer" containerID="3b9ea35d5871bb184f42d57bffe045844a491ef37993221114e0a4376ab7ed7f"
Jul 22 03:20:46.324424 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:46.324404    2565 scope.go:117] "RemoveContainer" containerID="3b9ea35d5871bb184f42d57bffe045844a491ef37993221114e0a4376ab7ed7f"
Jul 22 03:20:46.324699 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:20:46.324680    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b9ea35d5871bb184f42d57bffe045844a491ef37993221114e0a4376ab7ed7f\": container with ID starting with 3b9ea35d5871bb184f42d57bffe045844a491ef37993221114e0a4376ab7ed7f not found: ID does not exist" containerID="3b9ea35d5871bb184f42d57bffe045844a491ef37993221114e0a4376ab7ed7f"
Jul 22 03:20:46.324772 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:46.324707    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b9ea35d5871bb184f42d57bffe045844a491ef37993221114e0a4376ab7ed7f"} err="failed to get container status \"3b9ea35d5871bb184f42d57bffe045844a491ef37993221114e0a4376ab7ed7f\": rpc error: code = NotFound desc = could not find container \"3b9ea35d5871bb184f42d57bffe045844a491ef37993221114e0a4376ab7ed7f\": container with ID starting with 3b9ea35d5871bb184f42d57bffe045844a491ef37993221114e0a4376ab7ed7f not found: ID does not exist"
Jul 22 03:20:46.338839 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:46.338816    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c66fb4cb9-m9c7q"]
Jul 22 03:20:46.343295 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:46.343275    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c66fb4cb9-m9c7q"]
Jul 22 03:20:47.244148 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:20:47.244117    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0" path="/var/lib/kubelet/pods/eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0/volumes"
Jul 22 03:21:47.191163 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:47.191135    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c66fb4cb9-m9zgm"]
Jul 22 03:21:47.191531 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:47.191433    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0" containerName="manager"
Jul 22 03:21:47.191531 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:47.191444    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0" containerName="manager"
Jul 22 03:21:47.191531 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:47.191498    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaa8cc74-c3f8-4c2a-bce3-3cf894616cb0" containerName="manager"
Jul 22 03:21:47.198202 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:47.198179    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c66fb4cb9-m9zgm"
Jul 22 03:21:47.211020 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:47.210994    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tqvg2\""
Jul 22 03:21:47.211020 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:47.211013    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 03:21:47.211172 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:47.211021    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 03:21:47.221272 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:47.221253    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c66fb4cb9-m9zgm"]
Jul 22 03:21:47.323279 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:47.323248    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5afbc72d-f323-4b29-b4c9-3ce011ea4ac5-webhook-cert\") pod \"maas-controller-5c66fb4cb9-m9zgm\" (UID: \"5afbc72d-f323-4b29-b4c9-3ce011ea4ac5\") " pod="opendatahub/maas-controller-5c66fb4cb9-m9zgm"
Jul 22 03:21:47.323424 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:47.323293    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbg42\" (UniqueName: \"kubernetes.io/projected/5afbc72d-f323-4b29-b4c9-3ce011ea4ac5-kube-api-access-tbg42\") pod \"maas-controller-5c66fb4cb9-m9zgm\" (UID: \"5afbc72d-f323-4b29-b4c9-3ce011ea4ac5\") " pod="opendatahub/maas-controller-5c66fb4cb9-m9zgm"
Jul 22 03:21:47.424694 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:47.424661    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5afbc72d-f323-4b29-b4c9-3ce011ea4ac5-webhook-cert\") pod \"maas-controller-5c66fb4cb9-m9zgm\" (UID: \"5afbc72d-f323-4b29-b4c9-3ce011ea4ac5\") " pod="opendatahub/maas-controller-5c66fb4cb9-m9zgm"
Jul 22 03:21:47.424824 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:47.424710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbg42\" (UniqueName: \"kubernetes.io/projected/5afbc72d-f323-4b29-b4c9-3ce011ea4ac5-kube-api-access-tbg42\") pod \"maas-controller-5c66fb4cb9-m9zgm\" (UID: \"5afbc72d-f323-4b29-b4c9-3ce011ea4ac5\") " pod="opendatahub/maas-controller-5c66fb4cb9-m9zgm"
Jul 22 03:21:47.426872 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:47.426851    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5afbc72d-f323-4b29-b4c9-3ce011ea4ac5-webhook-cert\") pod \"maas-controller-5c66fb4cb9-m9zgm\" (UID: \"5afbc72d-f323-4b29-b4c9-3ce011ea4ac5\") " pod="opendatahub/maas-controller-5c66fb4cb9-m9zgm"
Jul 22 03:21:47.436916 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:47.436884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbg42\" (UniqueName: \"kubernetes.io/projected/5afbc72d-f323-4b29-b4c9-3ce011ea4ac5-kube-api-access-tbg42\") pod \"maas-controller-5c66fb4cb9-m9zgm\" (UID: \"5afbc72d-f323-4b29-b4c9-3ce011ea4ac5\") " pod="opendatahub/maas-controller-5c66fb4cb9-m9zgm"
Jul 22 03:21:47.507952 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:47.507882    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c66fb4cb9-m9zgm"
Jul 22 03:21:47.670701 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:47.670661    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c66fb4cb9-m9zgm"]
Jul 22 03:21:47.673743 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:21:47.673709    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5afbc72d_f323_4b29_b4c9_3ce011ea4ac5.slice/crio-505034590cdc82f52ff5910ba7c525f5ebc19357d61909e24b508e3338690cd4 WatchSource:0}: Error finding container 505034590cdc82f52ff5910ba7c525f5ebc19357d61909e24b508e3338690cd4: Status 404 returned error can't find the container with id 505034590cdc82f52ff5910ba7c525f5ebc19357d61909e24b508e3338690cd4
Jul 22 03:21:48.575160 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:48.575124    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c66fb4cb9-m9zgm" event={"ID":"5afbc72d-f323-4b29-b4c9-3ce011ea4ac5","Type":"ContainerStarted","Data":"dad72b8716ebff9d02a8ec182271a17b61778feca3a60b05f06a8b61f548e436"}
Jul 22 03:21:48.575523 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:48.575179    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c66fb4cb9-m9zgm" event={"ID":"5afbc72d-f323-4b29-b4c9-3ce011ea4ac5","Type":"ContainerStarted","Data":"505034590cdc82f52ff5910ba7c525f5ebc19357d61909e24b508e3338690cd4"}
Jul 22 03:21:48.575523 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:48.575226    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c66fb4cb9-m9zgm"
Jul 22 03:21:48.604429 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:48.604386    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c66fb4cb9-m9zgm" podStartSLOduration=1.205442942 podStartE2EDuration="1.604370151s" totalImagesPullingTime="398.927209ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:21:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:21:48.603132344 +0000 UTC m=+846.064682749" watchObservedRunningTime="2026-07-22 03:21:48.604370151 +0000 UTC m=+846.065920556"
Jul 22 03:21:59.582512 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:21:59.582483    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c66fb4cb9-m9zgm"
Jul 22 03:22:04.231027 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:04.230997    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c66fb4cb9-m9zgm"]
Jul 22 03:22:04.231405 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:04.231190    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5c66fb4cb9-m9zgm" podUID="5afbc72d-f323-4b29-b4c9-3ce011ea4ac5" containerName="manager" containerID="cri-o://dad72b8716ebff9d02a8ec182271a17b61778feca3a60b05f06a8b61f548e436" gracePeriod=30
Jul 22 03:22:04.481242 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:04.481185    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c66fb4cb9-m9zgm"
Jul 22 03:22:04.648931 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:04.648902    2565 generic.go:356] "Generic (PLEG): container finished" podID="5afbc72d-f323-4b29-b4c9-3ce011ea4ac5" containerID="dad72b8716ebff9d02a8ec182271a17b61778feca3a60b05f06a8b61f548e436" exitCode=0
Jul 22 03:22:04.649084 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:04.648940    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c66fb4cb9-m9zgm"
Jul 22 03:22:04.649084 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:04.648989    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c66fb4cb9-m9zgm" event={"ID":"5afbc72d-f323-4b29-b4c9-3ce011ea4ac5","Type":"ContainerDied","Data":"dad72b8716ebff9d02a8ec182271a17b61778feca3a60b05f06a8b61f548e436"}
Jul 22 03:22:04.649084 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:04.649038    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c66fb4cb9-m9zgm" event={"ID":"5afbc72d-f323-4b29-b4c9-3ce011ea4ac5","Type":"ContainerDied","Data":"505034590cdc82f52ff5910ba7c525f5ebc19357d61909e24b508e3338690cd4"}
Jul 22 03:22:04.649084 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:04.649070    2565 scope.go:117] "RemoveContainer" containerID="dad72b8716ebff9d02a8ec182271a17b61778feca3a60b05f06a8b61f548e436"
Jul 22 03:22:04.656538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:04.656523    2565 scope.go:117] "RemoveContainer" containerID="dad72b8716ebff9d02a8ec182271a17b61778feca3a60b05f06a8b61f548e436"
Jul 22 03:22:04.656836 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:22:04.656820    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dad72b8716ebff9d02a8ec182271a17b61778feca3a60b05f06a8b61f548e436\": container with ID starting with dad72b8716ebff9d02a8ec182271a17b61778feca3a60b05f06a8b61f548e436 not found: ID does not exist" containerID="dad72b8716ebff9d02a8ec182271a17b61778feca3a60b05f06a8b61f548e436"
Jul 22 03:22:04.656875 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:04.656847    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad72b8716ebff9d02a8ec182271a17b61778feca3a60b05f06a8b61f548e436"} err="failed to get container status \"dad72b8716ebff9d02a8ec182271a17b61778feca3a60b05f06a8b61f548e436\": rpc error: code = NotFound desc = could not find container \"dad72b8716ebff9d02a8ec182271a17b61778feca3a60b05f06a8b61f548e436\": container with ID starting with dad72b8716ebff9d02a8ec182271a17b61778feca3a60b05f06a8b61f548e436 not found: ID does not exist"
Jul 22 03:22:04.656957 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:04.656895    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5afbc72d-f323-4b29-b4c9-3ce011ea4ac5-webhook-cert\") pod \"5afbc72d-f323-4b29-b4c9-3ce011ea4ac5\" (UID: \"5afbc72d-f323-4b29-b4c9-3ce011ea4ac5\") "
Jul 22 03:22:04.656957 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:04.656945    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbg42\" (UniqueName: \"kubernetes.io/projected/5afbc72d-f323-4b29-b4c9-3ce011ea4ac5-kube-api-access-tbg42\") pod \"5afbc72d-f323-4b29-b4c9-3ce011ea4ac5\" (UID: \"5afbc72d-f323-4b29-b4c9-3ce011ea4ac5\") "
Jul 22 03:22:04.658731 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:04.658710    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5afbc72d-f323-4b29-b4c9-3ce011ea4ac5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5afbc72d-f323-4b29-b4c9-3ce011ea4ac5" (UID: "5afbc72d-f323-4b29-b4c9-3ce011ea4ac5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:22:04.658879 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:04.658861    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5afbc72d-f323-4b29-b4c9-3ce011ea4ac5-kube-api-access-tbg42" (OuterVolumeSpecName: "kube-api-access-tbg42") pod "5afbc72d-f323-4b29-b4c9-3ce011ea4ac5" (UID: "5afbc72d-f323-4b29-b4c9-3ce011ea4ac5"). InnerVolumeSpecName "kube-api-access-tbg42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:22:04.757475 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:04.757411    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5afbc72d-f323-4b29-b4c9-3ce011ea4ac5-webhook-cert\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:22:04.757475 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:04.757438    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbg42\" (UniqueName: \"kubernetes.io/projected/5afbc72d-f323-4b29-b4c9-3ce011ea4ac5-kube-api-access-tbg42\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:22:04.971714 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:04.971690    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c66fb4cb9-m9zgm"]
Jul 22 03:22:04.976074 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:04.976052    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c66fb4cb9-m9zgm"]
Jul 22 03:22:05.243518 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:05.243491    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5afbc72d-f323-4b29-b4c9-3ce011ea4ac5" path="/var/lib/kubelet/pods/5afbc72d-f323-4b29-b4c9-3ce011ea4ac5/volumes"
Jul 22 03:22:05.786369 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:05.786341    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c66fb4cb9-h7rs8"]
Jul 22 03:22:05.786672 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:05.786659    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5afbc72d-f323-4b29-b4c9-3ce011ea4ac5" containerName="manager"
Jul 22 03:22:05.786722 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:05.786673    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5afbc72d-f323-4b29-b4c9-3ce011ea4ac5" containerName="manager"
Jul 22 03:22:05.786760 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:05.786726    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5afbc72d-f323-4b29-b4c9-3ce011ea4ac5" containerName="manager"
Jul 22 03:22:05.791018 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:05.791002    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c66fb4cb9-h7rs8"
Jul 22 03:22:05.795686 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:05.795660    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tqvg2\""
Jul 22 03:22:05.795807 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:05.795697    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 03:22:05.795807 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:05.795697    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 03:22:05.803453 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:05.803430    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c66fb4cb9-h7rs8"]
Jul 22 03:22:05.966635 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:05.966607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcqqz\" (UniqueName: \"kubernetes.io/projected/09a07d8e-7b24-4ac6-b7d4-51a6d1f5a484-kube-api-access-pcqqz\") pod \"maas-controller-5c66fb4cb9-h7rs8\" (UID: \"09a07d8e-7b24-4ac6-b7d4-51a6d1f5a484\") " pod="opendatahub/maas-controller-5c66fb4cb9-h7rs8"
Jul 22 03:22:05.966758 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:05.966642    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09a07d8e-7b24-4ac6-b7d4-51a6d1f5a484-webhook-cert\") pod \"maas-controller-5c66fb4cb9-h7rs8\" (UID: \"09a07d8e-7b24-4ac6-b7d4-51a6d1f5a484\") " pod="opendatahub/maas-controller-5c66fb4cb9-h7rs8"
Jul 22 03:22:06.067740 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:06.067677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcqqz\" (UniqueName: \"kubernetes.io/projected/09a07d8e-7b24-4ac6-b7d4-51a6d1f5a484-kube-api-access-pcqqz\") pod \"maas-controller-5c66fb4cb9-h7rs8\" (UID: \"09a07d8e-7b24-4ac6-b7d4-51a6d1f5a484\") " pod="opendatahub/maas-controller-5c66fb4cb9-h7rs8"
Jul 22 03:22:06.067740 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:06.067712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09a07d8e-7b24-4ac6-b7d4-51a6d1f5a484-webhook-cert\") pod \"maas-controller-5c66fb4cb9-h7rs8\" (UID: \"09a07d8e-7b24-4ac6-b7d4-51a6d1f5a484\") " pod="opendatahub/maas-controller-5c66fb4cb9-h7rs8"
Jul 22 03:22:06.070243 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:06.070222    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09a07d8e-7b24-4ac6-b7d4-51a6d1f5a484-webhook-cert\") pod \"maas-controller-5c66fb4cb9-h7rs8\" (UID: \"09a07d8e-7b24-4ac6-b7d4-51a6d1f5a484\") " pod="opendatahub/maas-controller-5c66fb4cb9-h7rs8"
Jul 22 03:22:06.076748 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:06.076724    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcqqz\" (UniqueName: \"kubernetes.io/projected/09a07d8e-7b24-4ac6-b7d4-51a6d1f5a484-kube-api-access-pcqqz\") pod \"maas-controller-5c66fb4cb9-h7rs8\" (UID: \"09a07d8e-7b24-4ac6-b7d4-51a6d1f5a484\") " pod="opendatahub/maas-controller-5c66fb4cb9-h7rs8"
Jul 22 03:22:06.101370 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:06.101346    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c66fb4cb9-h7rs8"
Jul 22 03:22:06.227988 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:06.227965    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c66fb4cb9-h7rs8"]
Jul 22 03:22:06.229809 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:22:06.229776    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09a07d8e_7b24_4ac6_b7d4_51a6d1f5a484.slice/crio-b062233045192dda164c3254c706932a0b98d766f94a5c2b24662922b81436fc WatchSource:0}: Error finding container b062233045192dda164c3254c706932a0b98d766f94a5c2b24662922b81436fc: Status 404 returned error can't find the container with id b062233045192dda164c3254c706932a0b98d766f94a5c2b24662922b81436fc
Jul 22 03:22:06.659016 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:06.658990    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c66fb4cb9-h7rs8" event={"ID":"09a07d8e-7b24-4ac6-b7d4-51a6d1f5a484","Type":"ContainerStarted","Data":"b062233045192dda164c3254c706932a0b98d766f94a5c2b24662922b81436fc"}
Jul 22 03:22:07.664764 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:07.664726    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c66fb4cb9-h7rs8" event={"ID":"09a07d8e-7b24-4ac6-b7d4-51a6d1f5a484","Type":"ContainerStarted","Data":"91fd4309e30f8552a7a3949dd240cfb51d0cc4fbfaf6df6f650a14b1f515e6f1"}
Jul 22 03:22:07.665136 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:07.664790    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c66fb4cb9-h7rs8"
Jul 22 03:22:07.686544 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:07.686497    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c66fb4cb9-h7rs8" podStartSLOduration=2.310521325 podStartE2EDuration="2.686481402s" totalImagesPullingTime="375.960077ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:22:07.685294565 +0000 UTC m=+865.146844964" watchObservedRunningTime="2026-07-22 03:22:07.686481402 +0000 UTC m=+865.148031857"
Jul 22 03:22:18.672397 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:22:18.672366    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c66fb4cb9-h7rs8"
Jul 22 03:30:00.142103 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:30:00.142071    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744850-ss9fr"]
Jul 22 03:30:00.145550 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:30:00.145535    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744850-ss9fr"
Jul 22 03:30:00.148165 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:30:00.148130    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xvl7w\""
Jul 22 03:30:00.154371 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:30:00.154355    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744850-ss9fr"
Jul 22 03:30:00.162610 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:30:00.162586    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744850-ss9fr"]
Jul 22 03:30:00.279371 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:30:00.279348    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744850-ss9fr"]
Jul 22 03:30:00.281851 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:30:00.281820    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3afa2802_9a87_4da9_a747_e5009c47597c.slice/crio-d856d56ed7985f7b40c6cb86c614e9bd86a102bf213383d6cb7360fcf314bd2e WatchSource:0}: Error finding container d856d56ed7985f7b40c6cb86c614e9bd86a102bf213383d6cb7360fcf314bd2e: Status 404 returned error can't find the container with id d856d56ed7985f7b40c6cb86c614e9bd86a102bf213383d6cb7360fcf314bd2e
Jul 22 03:30:00.283611 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:30:00.283593    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:30:00.627232 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:30:00.627190    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744850-ss9fr" event={"ID":"3afa2802-9a87-4da9-a747-e5009c47597c","Type":"ContainerStarted","Data":"d856d56ed7985f7b40c6cb86c614e9bd86a102bf213383d6cb7360fcf314bd2e"}
Jul 22 03:30:03.642471 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:30:03.642433    2565 generic.go:356] "Generic (PLEG): container finished" podID="3afa2802-9a87-4da9-a747-e5009c47597c" containerID="3ad71f9895d3ee5159823b6279057408f75b2d63e8ed2e9e81d0e99b5757eec0" exitCode=0
Jul 22 03:30:03.642888 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:30:03.642514    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744850-ss9fr" event={"ID":"3afa2802-9a87-4da9-a747-e5009c47597c","Type":"ContainerDied","Data":"3ad71f9895d3ee5159823b6279057408f75b2d63e8ed2e9e81d0e99b5757eec0"}
Jul 22 03:30:04.771831 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:30:04.771804    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744850-ss9fr"
Jul 22 03:30:05.651863 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:30:05.651794    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744850-ss9fr"
Jul 22 03:30:05.651863 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:30:05.651801    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744850-ss9fr" event={"ID":"3afa2802-9a87-4da9-a747-e5009c47597c","Type":"ContainerDied","Data":"d856d56ed7985f7b40c6cb86c614e9bd86a102bf213383d6cb7360fcf314bd2e"}
Jul 22 03:30:05.651863 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:30:05.651840    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d856d56ed7985f7b40c6cb86c614e9bd86a102bf213383d6cb7360fcf314bd2e"
Jul 22 03:35:16.999788 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:16.999758    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"]
Jul 22 03:35:17.002615 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:17.000108    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3afa2802-9a87-4da9-a747-e5009c47597c" containerName="cleanup"
Jul 22 03:35:17.002615 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:17.000119    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3afa2802-9a87-4da9-a747-e5009c47597c" containerName="cleanup"
Jul 22 03:35:17.002615 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:17.000169    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3afa2802-9a87-4da9-a747-e5009c47597c" containerName="cleanup"
Jul 22 03:35:17.003821 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:17.003804    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"
Jul 22 03:35:17.007694 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:17.007671    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-6abd7a28-serving-cert\""
Jul 22 03:35:17.025126 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:17.025093    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"]
Jul 22 03:35:17.063340 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:17.063305    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmkv4\" (UniqueName: \"kubernetes.io/projected/652a1f01-5015-4668-ad04-28a253f3aa44-kube-api-access-nmkv4\") pod \"maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm\" (UID: \"652a1f01-5015-4668-ad04-28a253f3aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"
Jul 22 03:35:17.063340 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:17.063340    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/652a1f01-5015-4668-ad04-28a253f3aa44-openshift-service-ca\") pod \"maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm\" (UID: \"652a1f01-5015-4668-ad04-28a253f3aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"
Jul 22 03:35:17.063615 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:17.063373    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/652a1f01-5015-4668-ad04-28a253f3aa44-maas-api-tls\") pod \"maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm\" (UID: \"652a1f01-5015-4668-ad04-28a253f3aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"
Jul 22 03:35:17.163867 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:17.163836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmkv4\" (UniqueName: \"kubernetes.io/projected/652a1f01-5015-4668-ad04-28a253f3aa44-kube-api-access-nmkv4\") pod \"maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm\" (UID: \"652a1f01-5015-4668-ad04-28a253f3aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"
Jul 22 03:35:17.163867 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:17.163869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/652a1f01-5015-4668-ad04-28a253f3aa44-openshift-service-ca\") pod \"maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm\" (UID: \"652a1f01-5015-4668-ad04-28a253f3aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"
Jul 22 03:35:17.164123 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:17.163893    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/652a1f01-5015-4668-ad04-28a253f3aa44-maas-api-tls\") pod \"maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm\" (UID: \"652a1f01-5015-4668-ad04-28a253f3aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"
Jul 22 03:35:17.164123 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:35:17.164081    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-serving-cert: secret "maas-api-e2e-ait-6abd7a28-serving-cert" not found
Jul 22 03:35:17.164251 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:35:17.164158    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/652a1f01-5015-4668-ad04-28a253f3aa44-maas-api-tls podName:652a1f01-5015-4668-ad04-28a253f3aa44 nodeName:}" failed. No retries permitted until 2026-07-22 03:35:17.664134318 +0000 UTC m=+1655.125684701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/652a1f01-5015-4668-ad04-28a253f3aa44-maas-api-tls") pod "maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm" (UID: "652a1f01-5015-4668-ad04-28a253f3aa44") : secret "maas-api-e2e-ait-6abd7a28-serving-cert" not found
Jul 22 03:35:17.164602 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:17.164553    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/652a1f01-5015-4668-ad04-28a253f3aa44-openshift-service-ca\") pod \"maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm\" (UID: \"652a1f01-5015-4668-ad04-28a253f3aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"
Jul 22 03:35:17.176149 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:17.176121    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmkv4\" (UniqueName: \"kubernetes.io/projected/652a1f01-5015-4668-ad04-28a253f3aa44-kube-api-access-nmkv4\") pod \"maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm\" (UID: \"652a1f01-5015-4668-ad04-28a253f3aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"
Jul 22 03:35:17.669107 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:17.669072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/652a1f01-5015-4668-ad04-28a253f3aa44-maas-api-tls\") pod \"maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm\" (UID: \"652a1f01-5015-4668-ad04-28a253f3aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"
Jul 22 03:35:17.671851 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:17.671814    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/652a1f01-5015-4668-ad04-28a253f3aa44-maas-api-tls\") pod \"maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm\" (UID: \"652a1f01-5015-4668-ad04-28a253f3aa44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"
Jul 22 03:35:17.913948 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:17.913909    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"
Jul 22 03:35:18.056112 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:18.056085    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"]
Jul 22 03:35:18.058643 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:35:18.058610    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod652a1f01_5015_4668_ad04_28a253f3aa44.slice/crio-77c037485719d676c7ff92f72bab51a236276843d17b5d18832f000871d1cf7d WatchSource:0}: Error finding container 77c037485719d676c7ff92f72bab51a236276843d17b5d18832f000871d1cf7d: Status 404 returned error can't find the container with id 77c037485719d676c7ff92f72bab51a236276843d17b5d18832f000871d1cf7d
Jul 22 03:35:18.060472 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:18.060450    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:35:18.964546 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:18.964511    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm" event={"ID":"652a1f01-5015-4668-ad04-28a253f3aa44","Type":"ContainerStarted","Data":"525568ff0d00ccb032420c71ef57f4ea85b554e260e484af4c45b56d3b891cbe"}
Jul 22 03:35:18.964713 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:18.964584    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm" event={"ID":"652a1f01-5015-4668-ad04-28a253f3aa44","Type":"ContainerStarted","Data":"77c037485719d676c7ff92f72bab51a236276843d17b5d18832f000871d1cf7d"}
Jul 22 03:35:18.964713 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:18.964642    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"
Jul 22 03:35:18.985705 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:18.985656    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm" podStartSLOduration=2.492574426 podStartE2EDuration="2.985641762s" totalImagesPullingTime="493.067336ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:35:18.984217381 +0000 UTC m=+1656.445767785" watchObservedRunningTime="2026-07-22 03:35:18.985641762 +0000 UTC m=+1656.447192176"
Jul 22 03:35:24.974301 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:24.974269    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"
Jul 22 03:35:52.864235 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:52.864204    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"]
Jul 22 03:35:52.864756 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:52.864404    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm" podUID="652a1f01-5015-4668-ad04-28a253f3aa44" containerName="maas-api" containerID="cri-o://525568ff0d00ccb032420c71ef57f4ea85b554e260e484af4c45b56d3b891cbe" gracePeriod=30
Jul 22 03:35:53.101933 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.101912    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"
Jul 22 03:35:53.118227 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.118174    2565 generic.go:356] "Generic (PLEG): container finished" podID="652a1f01-5015-4668-ad04-28a253f3aa44" containerID="525568ff0d00ccb032420c71ef57f4ea85b554e260e484af4c45b56d3b891cbe" exitCode=0
Jul 22 03:35:53.118227 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.118205    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"
Jul 22 03:35:53.118390 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.118265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm" event={"ID":"652a1f01-5015-4668-ad04-28a253f3aa44","Type":"ContainerDied","Data":"525568ff0d00ccb032420c71ef57f4ea85b554e260e484af4c45b56d3b891cbe"}
Jul 22 03:35:53.118390 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.118325    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm" event={"ID":"652a1f01-5015-4668-ad04-28a253f3aa44","Type":"ContainerDied","Data":"77c037485719d676c7ff92f72bab51a236276843d17b5d18832f000871d1cf7d"}
Jul 22 03:35:53.118390 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.118357    2565 scope.go:117] "RemoveContainer" containerID="525568ff0d00ccb032420c71ef57f4ea85b554e260e484af4c45b56d3b891cbe"
Jul 22 03:35:53.128418 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.128400    2565 scope.go:117] "RemoveContainer" containerID="525568ff0d00ccb032420c71ef57f4ea85b554e260e484af4c45b56d3b891cbe"
Jul 22 03:35:53.128701 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:35:53.128681    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"525568ff0d00ccb032420c71ef57f4ea85b554e260e484af4c45b56d3b891cbe\": container with ID starting with 525568ff0d00ccb032420c71ef57f4ea85b554e260e484af4c45b56d3b891cbe not found: ID does not exist" containerID="525568ff0d00ccb032420c71ef57f4ea85b554e260e484af4c45b56d3b891cbe"
Jul 22 03:35:53.128761 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.128714    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"525568ff0d00ccb032420c71ef57f4ea85b554e260e484af4c45b56d3b891cbe"} err="failed to get container status \"525568ff0d00ccb032420c71ef57f4ea85b554e260e484af4c45b56d3b891cbe\": rpc error: code = NotFound desc = could not find container \"525568ff0d00ccb032420c71ef57f4ea85b554e260e484af4c45b56d3b891cbe\": container with ID starting with 525568ff0d00ccb032420c71ef57f4ea85b554e260e484af4c45b56d3b891cbe not found: ID does not exist"
Jul 22 03:35:53.248976 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.248957    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/652a1f01-5015-4668-ad04-28a253f3aa44-maas-api-tls\") pod \"652a1f01-5015-4668-ad04-28a253f3aa44\" (UID: \"652a1f01-5015-4668-ad04-28a253f3aa44\") "
Jul 22 03:35:53.249106 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.248994    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/652a1f01-5015-4668-ad04-28a253f3aa44-openshift-service-ca\") pod \"652a1f01-5015-4668-ad04-28a253f3aa44\" (UID: \"652a1f01-5015-4668-ad04-28a253f3aa44\") "
Jul 22 03:35:53.249106 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.249078    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmkv4\" (UniqueName: \"kubernetes.io/projected/652a1f01-5015-4668-ad04-28a253f3aa44-kube-api-access-nmkv4\") pod \"652a1f01-5015-4668-ad04-28a253f3aa44\" (UID: \"652a1f01-5015-4668-ad04-28a253f3aa44\") "
Jul 22 03:35:53.249406 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.249380    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/652a1f01-5015-4668-ad04-28a253f3aa44-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "652a1f01-5015-4668-ad04-28a253f3aa44" (UID: "652a1f01-5015-4668-ad04-28a253f3aa44"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:35:53.251054 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.251022    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/652a1f01-5015-4668-ad04-28a253f3aa44-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "652a1f01-5015-4668-ad04-28a253f3aa44" (UID: "652a1f01-5015-4668-ad04-28a253f3aa44"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:35:53.251134 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.251076    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/652a1f01-5015-4668-ad04-28a253f3aa44-kube-api-access-nmkv4" (OuterVolumeSpecName: "kube-api-access-nmkv4") pod "652a1f01-5015-4668-ad04-28a253f3aa44" (UID: "652a1f01-5015-4668-ad04-28a253f3aa44"). InnerVolumeSpecName "kube-api-access-nmkv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:35:53.350680 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.350652    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/652a1f01-5015-4668-ad04-28a253f3aa44-openshift-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:35:53.350680 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.350677    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmkv4\" (UniqueName: \"kubernetes.io/projected/652a1f01-5015-4668-ad04-28a253f3aa44-kube-api-access-nmkv4\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:35:53.350820 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.350690    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/652a1f01-5015-4668-ad04-28a253f3aa44-maas-api-tls\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:35:53.441350 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.441327    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"]
Jul 22 03:35:53.446662 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:53.446643    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6abd7a28-74d49f54f7-kwgnm"]
Jul 22 03:35:55.243792 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:35:55.243760    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="652a1f01-5015-4668-ad04-28a253f3aa44" path="/var/lib/kubelet/pods/652a1f01-5015-4668-ad04-28a253f3aa44/volumes"
Jul 22 03:36:01.505335 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:01.505298    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"]
Jul 22 03:36:01.506244 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:01.506219    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="652a1f01-5015-4668-ad04-28a253f3aa44" containerName="maas-api"
Jul 22 03:36:01.506244 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:01.506244    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="652a1f01-5015-4668-ad04-28a253f3aa44" containerName="maas-api"
Jul 22 03:36:01.506401 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:01.506348    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="652a1f01-5015-4668-ad04-28a253f3aa44" containerName="maas-api"
Jul 22 03:36:01.510999 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:01.510981    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"
Jul 22 03:36:01.513599 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:01.513578    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-462b7b96-serving-cert\""
Jul 22 03:36:01.522938 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:01.522915    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"]
Jul 22 03:36:01.622758 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:01.622730    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d544d052-2777-4175-a03f-c349cc34dae5-maas-api-tls\") pod \"maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56\" (UID: \"d544d052-2777-4175-a03f-c349cc34dae5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"
Jul 22 03:36:01.622913 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:01.622774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d544d052-2777-4175-a03f-c349cc34dae5-openshift-service-ca\") pod \"maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56\" (UID: \"d544d052-2777-4175-a03f-c349cc34dae5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"
Jul 22 03:36:01.622913 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:01.622826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv4vq\" (UniqueName: \"kubernetes.io/projected/d544d052-2777-4175-a03f-c349cc34dae5-kube-api-access-zv4vq\") pod \"maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56\" (UID: \"d544d052-2777-4175-a03f-c349cc34dae5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"
Jul 22 03:36:01.723409 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:01.723372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d544d052-2777-4175-a03f-c349cc34dae5-maas-api-tls\") pod \"maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56\" (UID: \"d544d052-2777-4175-a03f-c349cc34dae5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"
Jul 22 03:36:01.723596 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:01.723431    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d544d052-2777-4175-a03f-c349cc34dae5-openshift-service-ca\") pod \"maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56\" (UID: \"d544d052-2777-4175-a03f-c349cc34dae5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"
Jul 22 03:36:01.723596 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:01.723484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv4vq\" (UniqueName: \"kubernetes.io/projected/d544d052-2777-4175-a03f-c349cc34dae5-kube-api-access-zv4vq\") pod \"maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56\" (UID: \"d544d052-2777-4175-a03f-c349cc34dae5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"
Jul 22 03:36:01.724098 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:01.724079    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d544d052-2777-4175-a03f-c349cc34dae5-openshift-service-ca\") pod \"maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56\" (UID: \"d544d052-2777-4175-a03f-c349cc34dae5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"
Jul 22 03:36:01.725759 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:01.725743    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d544d052-2777-4175-a03f-c349cc34dae5-maas-api-tls\") pod \"maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56\" (UID: \"d544d052-2777-4175-a03f-c349cc34dae5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"
Jul 22 03:36:01.732183 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:01.732164    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv4vq\" (UniqueName: \"kubernetes.io/projected/d544d052-2777-4175-a03f-c349cc34dae5-kube-api-access-zv4vq\") pod \"maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56\" (UID: \"d544d052-2777-4175-a03f-c349cc34dae5\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"
Jul 22 03:36:01.820947 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:01.820883    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"
Jul 22 03:36:01.951443 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:01.951412    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"]
Jul 22 03:36:01.955974 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:36:01.955940    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd544d052_2777_4175_a03f_c349cc34dae5.slice/crio-1642d882108224e73bbc4678fe683765d88d46899eb6759a113eb9ac0393a1a6 WatchSource:0}: Error finding container 1642d882108224e73bbc4678fe683765d88d46899eb6759a113eb9ac0393a1a6: Status 404 returned error can't find the container with id 1642d882108224e73bbc4678fe683765d88d46899eb6759a113eb9ac0393a1a6
Jul 22 03:36:02.159700 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:02.159622    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56" event={"ID":"d544d052-2777-4175-a03f-c349cc34dae5","Type":"ContainerStarted","Data":"1642d882108224e73bbc4678fe683765d88d46899eb6759a113eb9ac0393a1a6"}
Jul 22 03:36:03.165653 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:03.165619    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56" event={"ID":"d544d052-2777-4175-a03f-c349cc34dae5","Type":"ContainerStarted","Data":"8c1ba73902d0666cf0a7d8f852917dcf21222087f864e1d406e16484c6792970"}
Jul 22 03:36:03.166018 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:03.165786    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"
Jul 22 03:36:03.185784 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:03.185739    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56" podStartSLOduration=1.727817055 podStartE2EDuration="2.185724372s" totalImagesPullingTime="457.907317ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:36:03.183923593 +0000 UTC m=+1700.645473999" watchObservedRunningTime="2026-07-22 03:36:03.185724372 +0000 UTC m=+1700.647274776"
Jul 22 03:36:09.176409 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:09.176339    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"
Jul 22 03:36:26.272177 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:26.272144    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm"]
Jul 22 03:36:26.275425 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:26.275402    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm"
Jul 22 03:36:26.278237 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:26.278215    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xvl7w\""
Jul 22 03:36:26.291207 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:26.291183    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm"]
Jul 22 03:36:26.433485 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:26.433447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/543b6a4a-387a-40c1-aad9-da64145819d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm\" (UID: \"543b6a4a-387a-40c1-aad9-da64145819d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm"
Jul 22 03:36:26.534618 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:26.534536    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/543b6a4a-387a-40c1-aad9-da64145819d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm\" (UID: \"543b6a4a-387a-40c1-aad9-da64145819d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm"
Jul 22 03:36:26.535129 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:26.535110    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/543b6a4a-387a-40c1-aad9-da64145819d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm\" (UID: \"543b6a4a-387a-40c1-aad9-da64145819d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm"
Jul 22 03:36:26.585621 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:26.585595    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm"
Jul 22 03:36:26.717341 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:26.717310    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm"]
Jul 22 03:36:26.720498 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:36:26.720463    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543b6a4a_387a_40c1_aad9_da64145819d1.slice/crio-63a97a50cafe8c7cc140abf60764a9a3c5b979acdcaa3bc057592f167b0f677a WatchSource:0}: Error finding container 63a97a50cafe8c7cc140abf60764a9a3c5b979acdcaa3bc057592f167b0f677a: Status 404 returned error can't find the container with id 63a97a50cafe8c7cc140abf60764a9a3c5b979acdcaa3bc057592f167b0f677a
Jul 22 03:36:27.270888 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:27.270813    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm" event={"ID":"543b6a4a-387a-40c1-aad9-da64145819d1","Type":"ContainerStarted","Data":"d992e5b12bb5dcfe20b66864c4d23fb9b754a4e2286b5eaee90b6913a221803c"}
Jul 22 03:36:27.270888 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:27.270864    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm" event={"ID":"543b6a4a-387a-40c1-aad9-da64145819d1","Type":"ContainerStarted","Data":"63a97a50cafe8c7cc140abf60764a9a3c5b979acdcaa3bc057592f167b0f677a"}
Jul 22 03:36:27.288950 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:27.288905    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm" podStartSLOduration=1.288891393 podStartE2EDuration="1.288891393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:36:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:36:27.287929214 +0000 UTC m=+1724.749479619" watchObservedRunningTime="2026-07-22 03:36:27.288891393 +0000 UTC m=+1724.750441797"
Jul 22 03:36:28.275789 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:28.275755    2565 generic.go:356] "Generic (PLEG): container finished" podID="543b6a4a-387a-40c1-aad9-da64145819d1" containerID="d992e5b12bb5dcfe20b66864c4d23fb9b754a4e2286b5eaee90b6913a221803c" exitCode=0
Jul 22 03:36:28.275947 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:28.275830    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm" event={"ID":"543b6a4a-387a-40c1-aad9-da64145819d1","Type":"ContainerDied","Data":"d992e5b12bb5dcfe20b66864c4d23fb9b754a4e2286b5eaee90b6913a221803c"}
Jul 22 03:36:29.398767 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:29.398743    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm"
Jul 22 03:36:29.563742 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:29.563646    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/543b6a4a-387a-40c1-aad9-da64145819d1-maas-api-service-ca\") pod \"543b6a4a-387a-40c1-aad9-da64145819d1\" (UID: \"543b6a4a-387a-40c1-aad9-da64145819d1\") "
Jul 22 03:36:29.564037 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:29.564015    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/543b6a4a-387a-40c1-aad9-da64145819d1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "543b6a4a-387a-40c1-aad9-da64145819d1" (UID: "543b6a4a-387a-40c1-aad9-da64145819d1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:36:29.665188 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:29.665157    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/543b6a4a-387a-40c1-aad9-da64145819d1-maas-api-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:36:30.285418 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:30.285377    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm"
Jul 22 03:36:30.285418 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:30.285404    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm" event={"ID":"543b6a4a-387a-40c1-aad9-da64145819d1","Type":"ContainerDied","Data":"63a97a50cafe8c7cc140abf60764a9a3c5b979acdcaa3bc057592f167b0f677a"}
Jul 22 03:36:30.285664 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:30.285455    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63a97a50cafe8c7cc140abf60764a9a3c5b979acdcaa3bc057592f167b0f677a"
Jul 22 03:36:36.721287 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:36.721258    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"]
Jul 22 03:36:36.721770 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:36.721482    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56" podUID="d544d052-2777-4175-a03f-c349cc34dae5" containerName="maas-api" containerID="cri-o://8c1ba73902d0666cf0a7d8f852917dcf21222087f864e1d406e16484c6792970" gracePeriod=30
Jul 22 03:36:36.973203 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:36.973150    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"
Jul 22 03:36:37.127318 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:37.127288    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d544d052-2777-4175-a03f-c349cc34dae5-maas-api-tls\") pod \"d544d052-2777-4175-a03f-c349cc34dae5\" (UID: \"d544d052-2777-4175-a03f-c349cc34dae5\") "
Jul 22 03:36:37.127467 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:37.127333    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv4vq\" (UniqueName: \"kubernetes.io/projected/d544d052-2777-4175-a03f-c349cc34dae5-kube-api-access-zv4vq\") pod \"d544d052-2777-4175-a03f-c349cc34dae5\" (UID: \"d544d052-2777-4175-a03f-c349cc34dae5\") "
Jul 22 03:36:37.127467 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:37.127412    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d544d052-2777-4175-a03f-c349cc34dae5-openshift-service-ca\") pod \"d544d052-2777-4175-a03f-c349cc34dae5\" (UID: \"d544d052-2777-4175-a03f-c349cc34dae5\") "
Jul 22 03:36:37.127826 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:37.127792    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d544d052-2777-4175-a03f-c349cc34dae5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d544d052-2777-4175-a03f-c349cc34dae5" (UID: "d544d052-2777-4175-a03f-c349cc34dae5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:36:37.129336 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:37.129307    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d544d052-2777-4175-a03f-c349cc34dae5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d544d052-2777-4175-a03f-c349cc34dae5" (UID: "d544d052-2777-4175-a03f-c349cc34dae5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:36:37.129336 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:37.129307    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d544d052-2777-4175-a03f-c349cc34dae5-kube-api-access-zv4vq" (OuterVolumeSpecName: "kube-api-access-zv4vq") pod "d544d052-2777-4175-a03f-c349cc34dae5" (UID: "d544d052-2777-4175-a03f-c349cc34dae5"). InnerVolumeSpecName "kube-api-access-zv4vq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:36:37.228835 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:37.228779    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d544d052-2777-4175-a03f-c349cc34dae5-openshift-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:36:37.228835 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:37.228801    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d544d052-2777-4175-a03f-c349cc34dae5-maas-api-tls\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:36:37.228835 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:37.228811    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv4vq\" (UniqueName: \"kubernetes.io/projected/d544d052-2777-4175-a03f-c349cc34dae5-kube-api-access-zv4vq\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:36:37.314994 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:37.314961    2565 generic.go:356] "Generic (PLEG): container finished" podID="d544d052-2777-4175-a03f-c349cc34dae5" containerID="8c1ba73902d0666cf0a7d8f852917dcf21222087f864e1d406e16484c6792970" exitCode=0
Jul 22 03:36:37.315100 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:37.315005    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"
Jul 22 03:36:37.315100 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:37.315017    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56" event={"ID":"d544d052-2777-4175-a03f-c349cc34dae5","Type":"ContainerDied","Data":"8c1ba73902d0666cf0a7d8f852917dcf21222087f864e1d406e16484c6792970"}
Jul 22 03:36:37.315100 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:37.315069    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56" event={"ID":"d544d052-2777-4175-a03f-c349cc34dae5","Type":"ContainerDied","Data":"1642d882108224e73bbc4678fe683765d88d46899eb6759a113eb9ac0393a1a6"}
Jul 22 03:36:37.315199 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:37.315098    2565 scope.go:117] "RemoveContainer" containerID="8c1ba73902d0666cf0a7d8f852917dcf21222087f864e1d406e16484c6792970"
Jul 22 03:36:37.322775 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:37.322757    2565 scope.go:117] "RemoveContainer" containerID="8c1ba73902d0666cf0a7d8f852917dcf21222087f864e1d406e16484c6792970"
Jul 22 03:36:37.323015 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:36:37.322996    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c1ba73902d0666cf0a7d8f852917dcf21222087f864e1d406e16484c6792970\": container with ID starting with 8c1ba73902d0666cf0a7d8f852917dcf21222087f864e1d406e16484c6792970 not found: ID does not exist" containerID="8c1ba73902d0666cf0a7d8f852917dcf21222087f864e1d406e16484c6792970"
Jul 22 03:36:37.323075 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:37.323023    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c1ba73902d0666cf0a7d8f852917dcf21222087f864e1d406e16484c6792970"} err="failed to get container status \"8c1ba73902d0666cf0a7d8f852917dcf21222087f864e1d406e16484c6792970\": rpc error: code = NotFound desc = could not find container \"8c1ba73902d0666cf0a7d8f852917dcf21222087f864e1d406e16484c6792970\": container with ID starting with 8c1ba73902d0666cf0a7d8f852917dcf21222087f864e1d406e16484c6792970 not found: ID does not exist"
Jul 22 03:36:37.333697 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:37.333671    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"]
Jul 22 03:36:37.339598 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:37.338856    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-462b7b96-5fffcdbd7-42w56"]
Jul 22 03:36:39.243401 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:39.243361    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d544d052-2777-4175-a03f-c349cc34dae5" path="/var/lib/kubelet/pods/d544d052-2777-4175-a03f-c349cc34dae5/volumes"
Jul 22 03:36:41.343696 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:41.343659    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm"]
Jul 22 03:36:41.345326 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:41.345302    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-462b7b96-47tfm"]
Jul 22 03:36:43.243367 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:43.243329    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="543b6a4a-387a-40c1-aad9-da64145819d1" path="/var/lib/kubelet/pods/543b6a4a-387a-40c1-aad9-da64145819d1/volumes"
Jul 22 03:36:44.574491 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.574459    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"]
Jul 22 03:36:44.574924 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.574849    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d544d052-2777-4175-a03f-c349cc34dae5" containerName="maas-api"
Jul 22 03:36:44.574924 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.574864    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d544d052-2777-4175-a03f-c349cc34dae5" containerName="maas-api"
Jul 22 03:36:44.574924 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.574880    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="543b6a4a-387a-40c1-aad9-da64145819d1" containerName="revoke-keys"
Jul 22 03:36:44.574924 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.574888    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="543b6a4a-387a-40c1-aad9-da64145819d1" containerName="revoke-keys"
Jul 22 03:36:44.575093 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.574964    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="543b6a4a-387a-40c1-aad9-da64145819d1" containerName="revoke-keys"
Jul 22 03:36:44.575093 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.574979    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d544d052-2777-4175-a03f-c349cc34dae5" containerName="maas-api"
Jul 22 03:36:44.579222 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.579205    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"
Jul 22 03:36:44.582134 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.582116    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8cd3c6d0-serving-cert\""
Jul 22 03:36:44.589012 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.588991    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"]
Jul 22 03:36:44.687180 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.687155    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjktp\" (UniqueName: \"kubernetes.io/projected/060b21ef-8c2c-491c-bd63-24970310b72d-kube-api-access-sjktp\") pod \"maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp\" (UID: \"060b21ef-8c2c-491c-bd63-24970310b72d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"
Jul 22 03:36:44.687301 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.687187    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/060b21ef-8c2c-491c-bd63-24970310b72d-openshift-service-ca\") pod \"maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp\" (UID: \"060b21ef-8c2c-491c-bd63-24970310b72d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"
Jul 22 03:36:44.687301 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.687207    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/060b21ef-8c2c-491c-bd63-24970310b72d-maas-api-tls\") pod \"maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp\" (UID: \"060b21ef-8c2c-491c-bd63-24970310b72d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"
Jul 22 03:36:44.788399 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.788374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjktp\" (UniqueName: \"kubernetes.io/projected/060b21ef-8c2c-491c-bd63-24970310b72d-kube-api-access-sjktp\") pod \"maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp\" (UID: \"060b21ef-8c2c-491c-bd63-24970310b72d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"
Jul 22 03:36:44.788536 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.788402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/060b21ef-8c2c-491c-bd63-24970310b72d-openshift-service-ca\") pod \"maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp\" (UID: \"060b21ef-8c2c-491c-bd63-24970310b72d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"
Jul 22 03:36:44.788536 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.788425    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/060b21ef-8c2c-491c-bd63-24970310b72d-maas-api-tls\") pod \"maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp\" (UID: \"060b21ef-8c2c-491c-bd63-24970310b72d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"
Jul 22 03:36:44.788991 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.788971    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/060b21ef-8c2c-491c-bd63-24970310b72d-openshift-service-ca\") pod \"maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp\" (UID: \"060b21ef-8c2c-491c-bd63-24970310b72d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"
Jul 22 03:36:44.790870 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.790852    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/060b21ef-8c2c-491c-bd63-24970310b72d-maas-api-tls\") pod \"maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp\" (UID: \"060b21ef-8c2c-491c-bd63-24970310b72d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"
Jul 22 03:36:44.802823 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.802805    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjktp\" (UniqueName: \"kubernetes.io/projected/060b21ef-8c2c-491c-bd63-24970310b72d-kube-api-access-sjktp\") pod \"maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp\" (UID: \"060b21ef-8c2c-491c-bd63-24970310b72d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"
Jul 22 03:36:44.890905 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:44.890855    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"
Jul 22 03:36:45.028872 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:45.028760    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"]
Jul 22 03:36:45.031442 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:36:45.031419    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod060b21ef_8c2c_491c_bd63_24970310b72d.slice/crio-dbe8e9c2b70ccf5f9f1fa4d346ab25e1d9dac2b5483e20f3cab35b5a0525a061 WatchSource:0}: Error finding container dbe8e9c2b70ccf5f9f1fa4d346ab25e1d9dac2b5483e20f3cab35b5a0525a061: Status 404 returned error can't find the container with id dbe8e9c2b70ccf5f9f1fa4d346ab25e1d9dac2b5483e20f3cab35b5a0525a061
Jul 22 03:36:45.350828 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:45.350794    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp" event={"ID":"060b21ef-8c2c-491c-bd63-24970310b72d","Type":"ContainerStarted","Data":"dbe8e9c2b70ccf5f9f1fa4d346ab25e1d9dac2b5483e20f3cab35b5a0525a061"}
Jul 22 03:36:46.356430 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:46.356388    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp" event={"ID":"060b21ef-8c2c-491c-bd63-24970310b72d","Type":"ContainerStarted","Data":"8c48f48d3fbff83086466025ed53139ed59727c8e75f8454c7c25d57ff3ad707"}
Jul 22 03:36:46.356914 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:46.356498    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"
Jul 22 03:36:46.376312 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:46.376265    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp" podStartSLOduration=1.782138131 podStartE2EDuration="2.376250604s" totalImagesPullingTime="594.112473ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:36:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:36:46.375757685 +0000 UTC m=+1743.837308426" watchObservedRunningTime="2026-07-22 03:36:46.376250604 +0000 UTC m=+1743.837801009"
Jul 22 03:36:52.365070 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:36:52.365024    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"
Jul 22 03:37:10.277549 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:10.277515    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8cd3c6d0-f6mjb"]
Jul 22 03:37:10.281039 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:10.281013    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8cd3c6d0-f6mjb"
Jul 22 03:37:10.283659 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:10.283635    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xvl7w\""
Jul 22 03:37:10.291809 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:10.291785    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8cd3c6d0-f6mjb"]
Jul 22 03:37:10.382193 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:10.382167    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8153ba0-9780-44c8-92a9-d96814e0604b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8cd3c6d0-f6mjb\" (UID: \"c8153ba0-9780-44c8-92a9-d96814e0604b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8cd3c6d0-f6mjb"
Jul 22 03:37:10.483334 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:10.483306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8153ba0-9780-44c8-92a9-d96814e0604b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8cd3c6d0-f6mjb\" (UID: \"c8153ba0-9780-44c8-92a9-d96814e0604b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8cd3c6d0-f6mjb"
Jul 22 03:37:10.483881 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:10.483864    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8153ba0-9780-44c8-92a9-d96814e0604b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8cd3c6d0-f6mjb\" (UID: \"c8153ba0-9780-44c8-92a9-d96814e0604b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8cd3c6d0-f6mjb"
Jul 22 03:37:10.591648 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:10.591592    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8cd3c6d0-f6mjb"
Jul 22 03:37:10.717049 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:10.717005    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8cd3c6d0-f6mjb"]
Jul 22 03:37:10.719315 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:37:10.719287    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8153ba0_9780_44c8_92a9_d96814e0604b.slice/crio-3df70b615045f758251e190aa8c3f16f29feb29bedec84d004d4e5bae6ff4197 WatchSource:0}: Error finding container 3df70b615045f758251e190aa8c3f16f29feb29bedec84d004d4e5bae6ff4197: Status 404 returned error can't find the container with id 3df70b615045f758251e190aa8c3f16f29feb29bedec84d004d4e5bae6ff4197
Jul 22 03:37:11.465767 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:11.465738    2565 generic.go:356] "Generic (PLEG): container finished" podID="c8153ba0-9780-44c8-92a9-d96814e0604b" containerID="36a7ece41217ab4aaa8c89404700f2d5d6cd9e2160ce702dd46b4d73c7d63649" exitCode=0
Jul 22 03:37:11.466095 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:11.465815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8cd3c6d0-f6mjb" event={"ID":"c8153ba0-9780-44c8-92a9-d96814e0604b","Type":"ContainerDied","Data":"36a7ece41217ab4aaa8c89404700f2d5d6cd9e2160ce702dd46b4d73c7d63649"}
Jul 22 03:37:11.466095 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:11.465861    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8cd3c6d0-f6mjb" event={"ID":"c8153ba0-9780-44c8-92a9-d96814e0604b","Type":"ContainerStarted","Data":"3df70b615045f758251e190aa8c3f16f29feb29bedec84d004d4e5bae6ff4197"}
Jul 22 03:37:12.598331 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:12.598310    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8cd3c6d0-f6mjb"
Jul 22 03:37:12.701565 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:12.701541    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8153ba0-9780-44c8-92a9-d96814e0604b-maas-api-service-ca\") pod \"c8153ba0-9780-44c8-92a9-d96814e0604b\" (UID: \"c8153ba0-9780-44c8-92a9-d96814e0604b\") "
Jul 22 03:37:12.701852 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:12.701833    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8153ba0-9780-44c8-92a9-d96814e0604b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c8153ba0-9780-44c8-92a9-d96814e0604b" (UID: "c8153ba0-9780-44c8-92a9-d96814e0604b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:37:12.802817 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:12.802765    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8153ba0-9780-44c8-92a9-d96814e0604b-maas-api-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:37:13.476147 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:13.476121    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8cd3c6d0-f6mjb"
Jul 22 03:37:13.476284 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:13.476121    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8cd3c6d0-f6mjb" event={"ID":"c8153ba0-9780-44c8-92a9-d96814e0604b","Type":"ContainerDied","Data":"3df70b615045f758251e190aa8c3f16f29feb29bedec84d004d4e5bae6ff4197"}
Jul 22 03:37:13.476284 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:13.476247    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3df70b615045f758251e190aa8c3f16f29feb29bedec84d004d4e5bae6ff4197"
Jul 22 03:37:20.833167 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:20.833126    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"]
Jul 22 03:37:20.833604 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:20.833355    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp" podUID="060b21ef-8c2c-491c-bd63-24970310b72d" containerName="maas-api" containerID="cri-o://8c48f48d3fbff83086466025ed53139ed59727c8e75f8454c7c25d57ff3ad707" gracePeriod=30
Jul 22 03:37:21.070468 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.070439    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"
Jul 22 03:37:21.170413 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.170344    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjktp\" (UniqueName: \"kubernetes.io/projected/060b21ef-8c2c-491c-bd63-24970310b72d-kube-api-access-sjktp\") pod \"060b21ef-8c2c-491c-bd63-24970310b72d\" (UID: \"060b21ef-8c2c-491c-bd63-24970310b72d\") "
Jul 22 03:37:21.170413 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.170383    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/060b21ef-8c2c-491c-bd63-24970310b72d-maas-api-tls\") pod \"060b21ef-8c2c-491c-bd63-24970310b72d\" (UID: \"060b21ef-8c2c-491c-bd63-24970310b72d\") "
Jul 22 03:37:21.170649 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.170451    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/060b21ef-8c2c-491c-bd63-24970310b72d-openshift-service-ca\") pod \"060b21ef-8c2c-491c-bd63-24970310b72d\" (UID: \"060b21ef-8c2c-491c-bd63-24970310b72d\") "
Jul 22 03:37:21.170828 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.170803    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/060b21ef-8c2c-491c-bd63-24970310b72d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "060b21ef-8c2c-491c-bd63-24970310b72d" (UID: "060b21ef-8c2c-491c-bd63-24970310b72d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:37:21.172410 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.172388    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/060b21ef-8c2c-491c-bd63-24970310b72d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "060b21ef-8c2c-491c-bd63-24970310b72d" (UID: "060b21ef-8c2c-491c-bd63-24970310b72d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:37:21.172410 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.172397    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/060b21ef-8c2c-491c-bd63-24970310b72d-kube-api-access-sjktp" (OuterVolumeSpecName: "kube-api-access-sjktp") pod "060b21ef-8c2c-491c-bd63-24970310b72d" (UID: "060b21ef-8c2c-491c-bd63-24970310b72d"). InnerVolumeSpecName "kube-api-access-sjktp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:37:21.271028 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.271006    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjktp\" (UniqueName: \"kubernetes.io/projected/060b21ef-8c2c-491c-bd63-24970310b72d-kube-api-access-sjktp\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:37:21.271028 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.271026    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/060b21ef-8c2c-491c-bd63-24970310b72d-maas-api-tls\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:37:21.271153 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.271035    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/060b21ef-8c2c-491c-bd63-24970310b72d-openshift-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:37:21.511724 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.511690    2565 generic.go:356] "Generic (PLEG): container finished" podID="060b21ef-8c2c-491c-bd63-24970310b72d" containerID="8c48f48d3fbff83086466025ed53139ed59727c8e75f8454c7c25d57ff3ad707" exitCode=0
Jul 22 03:37:21.511841 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.511746    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp" event={"ID":"060b21ef-8c2c-491c-bd63-24970310b72d","Type":"ContainerDied","Data":"8c48f48d3fbff83086466025ed53139ed59727c8e75f8454c7c25d57ff3ad707"}
Jul 22 03:37:21.511841 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.511751    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"
Jul 22 03:37:21.511841 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.511792    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp" event={"ID":"060b21ef-8c2c-491c-bd63-24970310b72d","Type":"ContainerDied","Data":"dbe8e9c2b70ccf5f9f1fa4d346ab25e1d9dac2b5483e20f3cab35b5a0525a061"}
Jul 22 03:37:21.511841 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.511814    2565 scope.go:117] "RemoveContainer" containerID="8c48f48d3fbff83086466025ed53139ed59727c8e75f8454c7c25d57ff3ad707"
Jul 22 03:37:21.519907 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.519889    2565 scope.go:117] "RemoveContainer" containerID="8c48f48d3fbff83086466025ed53139ed59727c8e75f8454c7c25d57ff3ad707"
Jul 22 03:37:21.520149 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:37:21.520132    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c48f48d3fbff83086466025ed53139ed59727c8e75f8454c7c25d57ff3ad707\": container with ID starting with 8c48f48d3fbff83086466025ed53139ed59727c8e75f8454c7c25d57ff3ad707 not found: ID does not exist" containerID="8c48f48d3fbff83086466025ed53139ed59727c8e75f8454c7c25d57ff3ad707"
Jul 22 03:37:21.520188 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.520159    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c48f48d3fbff83086466025ed53139ed59727c8e75f8454c7c25d57ff3ad707"} err="failed to get container status \"8c48f48d3fbff83086466025ed53139ed59727c8e75f8454c7c25d57ff3ad707\": rpc error: code = NotFound desc = could not find container \"8c48f48d3fbff83086466025ed53139ed59727c8e75f8454c7c25d57ff3ad707\": container with ID starting with 8c48f48d3fbff83086466025ed53139ed59727c8e75f8454c7c25d57ff3ad707 not found: ID does not exist"
Jul 22 03:37:21.531273 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.531250    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"]
Jul 22 03:37:21.536727 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:21.536708    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8cd3c6d0-674f55ff57-4gzbp"]
Jul 22 03:37:23.244101 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:23.244051    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="060b21ef-8c2c-491c-bd63-24970310b72d" path="/var/lib/kubelet/pods/060b21ef-8c2c-491c-bd63-24970310b72d/volumes"
Jul 22 03:37:25.352988 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:25.352920    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8cd3c6d0-f6mjb"]
Jul 22 03:37:25.355963 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:25.355929    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8cd3c6d0-f6mjb"]
Jul 22 03:37:27.243688 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:27.243655    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8153ba0-9780-44c8-92a9-d96814e0604b" path="/var/lib/kubelet/pods/c8153ba0-9780-44c8-92a9-d96814e0604b/volumes"
Jul 22 03:37:29.887659 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:29.887631    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"]
Jul 22 03:37:29.888004 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:29.887934    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="060b21ef-8c2c-491c-bd63-24970310b72d" containerName="maas-api"
Jul 22 03:37:29.888004 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:29.887945    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="060b21ef-8c2c-491c-bd63-24970310b72d" containerName="maas-api"
Jul 22 03:37:29.888004 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:29.887957    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8153ba0-9780-44c8-92a9-d96814e0604b" containerName="revoke-keys"
Jul 22 03:37:29.888004 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:29.887962    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8153ba0-9780-44c8-92a9-d96814e0604b" containerName="revoke-keys"
Jul 22 03:37:29.888125 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:29.888013    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="060b21ef-8c2c-491c-bd63-24970310b72d" containerName="maas-api"
Jul 22 03:37:29.888125 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:29.888020    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8153ba0-9780-44c8-92a9-d96814e0604b" containerName="revoke-keys"
Jul 22 03:37:29.891676 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:29.891658    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"
Jul 22 03:37:29.894038 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:29.894013    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-1535280c-serving-cert\""
Jul 22 03:37:29.915928 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:29.915906    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"]
Jul 22 03:37:30.036666 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:30.036636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53b8b7dd-b7ae-40ee-a791-10ebaf339a98-maas-api-tls\") pod \"maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv\" (UID: \"53b8b7dd-b7ae-40ee-a791-10ebaf339a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"
Jul 22 03:37:30.036821 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:30.036700    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6zcm\" (UniqueName: \"kubernetes.io/projected/53b8b7dd-b7ae-40ee-a791-10ebaf339a98-kube-api-access-m6zcm\") pod \"maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv\" (UID: \"53b8b7dd-b7ae-40ee-a791-10ebaf339a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"
Jul 22 03:37:30.036821 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:30.036797    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53b8b7dd-b7ae-40ee-a791-10ebaf339a98-openshift-service-ca\") pod \"maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv\" (UID: \"53b8b7dd-b7ae-40ee-a791-10ebaf339a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"
Jul 22 03:37:30.138131 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:30.138059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6zcm\" (UniqueName: \"kubernetes.io/projected/53b8b7dd-b7ae-40ee-a791-10ebaf339a98-kube-api-access-m6zcm\") pod \"maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv\" (UID: \"53b8b7dd-b7ae-40ee-a791-10ebaf339a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"
Jul 22 03:37:30.138131 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:30.138106    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53b8b7dd-b7ae-40ee-a791-10ebaf339a98-openshift-service-ca\") pod \"maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv\" (UID: \"53b8b7dd-b7ae-40ee-a791-10ebaf339a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"
Jul 22 03:37:30.138318 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:30.138134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53b8b7dd-b7ae-40ee-a791-10ebaf339a98-maas-api-tls\") pod \"maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv\" (UID: \"53b8b7dd-b7ae-40ee-a791-10ebaf339a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"
Jul 22 03:37:30.138799 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:30.138774    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53b8b7dd-b7ae-40ee-a791-10ebaf339a98-openshift-service-ca\") pod \"maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv\" (UID: \"53b8b7dd-b7ae-40ee-a791-10ebaf339a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"
Jul 22 03:37:30.140361 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:30.140343    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53b8b7dd-b7ae-40ee-a791-10ebaf339a98-maas-api-tls\") pod \"maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv\" (UID: \"53b8b7dd-b7ae-40ee-a791-10ebaf339a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"
Jul 22 03:37:30.154059 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:30.154031    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6zcm\" (UniqueName: \"kubernetes.io/projected/53b8b7dd-b7ae-40ee-a791-10ebaf339a98-kube-api-access-m6zcm\") pod \"maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv\" (UID: \"53b8b7dd-b7ae-40ee-a791-10ebaf339a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"
Jul 22 03:37:30.201770 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:30.201747    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"
Jul 22 03:37:30.341480 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:30.341429    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"]
Jul 22 03:37:30.343990 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:37:30.343960    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b8b7dd_b7ae_40ee_a791_10ebaf339a98.slice/crio-73c92e147f8f708ebb6071899489d7a82e3a9b7b99e50fec05bb888ab0604495 WatchSource:0}: Error finding container 73c92e147f8f708ebb6071899489d7a82e3a9b7b99e50fec05bb888ab0604495: Status 404 returned error can't find the container with id 73c92e147f8f708ebb6071899489d7a82e3a9b7b99e50fec05bb888ab0604495
Jul 22 03:37:30.551065 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:30.551034    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv" event={"ID":"53b8b7dd-b7ae-40ee-a791-10ebaf339a98","Type":"ContainerStarted","Data":"73c92e147f8f708ebb6071899489d7a82e3a9b7b99e50fec05bb888ab0604495"}
Jul 22 03:37:31.559545 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:31.559512    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv" event={"ID":"53b8b7dd-b7ae-40ee-a791-10ebaf339a98","Type":"ContainerStarted","Data":"742cbe82daeadc591a75d8620dee3d71ab00f8beb08159528717fb106be5d3c8"}
Jul 22 03:37:31.559927 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:31.559610    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"
Jul 22 03:37:31.578950 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:31.578903    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv" podStartSLOduration=2.10430519 podStartE2EDuration="2.578888955s" totalImagesPullingTime="474.583765ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:37:31.576443672 +0000 UTC m=+1789.037994089" watchObservedRunningTime="2026-07-22 03:37:31.578888955 +0000 UTC m=+1789.040439359"
Jul 22 03:37:37.569439 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:37:37.569366    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"
Jul 22 03:38:05.091214 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.091072    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"]
Jul 22 03:38:05.091774 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.091323    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv" podUID="53b8b7dd-b7ae-40ee-a791-10ebaf339a98" containerName="maas-api" containerID="cri-o://742cbe82daeadc591a75d8620dee3d71ab00f8beb08159528717fb106be5d3c8" gracePeriod=30
Jul 22 03:38:05.330224 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.330199    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"
Jul 22 03:38:05.416622 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.416531    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53b8b7dd-b7ae-40ee-a791-10ebaf339a98-maas-api-tls\") pod \"53b8b7dd-b7ae-40ee-a791-10ebaf339a98\" (UID: \"53b8b7dd-b7ae-40ee-a791-10ebaf339a98\") "
Jul 22 03:38:05.416774 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.416655    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6zcm\" (UniqueName: \"kubernetes.io/projected/53b8b7dd-b7ae-40ee-a791-10ebaf339a98-kube-api-access-m6zcm\") pod \"53b8b7dd-b7ae-40ee-a791-10ebaf339a98\" (UID: \"53b8b7dd-b7ae-40ee-a791-10ebaf339a98\") "
Jul 22 03:38:05.416774 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.416690    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53b8b7dd-b7ae-40ee-a791-10ebaf339a98-openshift-service-ca\") pod \"53b8b7dd-b7ae-40ee-a791-10ebaf339a98\" (UID: \"53b8b7dd-b7ae-40ee-a791-10ebaf339a98\") "
Jul 22 03:38:05.417103 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.417073    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b8b7dd-b7ae-40ee-a791-10ebaf339a98-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "53b8b7dd-b7ae-40ee-a791-10ebaf339a98" (UID: "53b8b7dd-b7ae-40ee-a791-10ebaf339a98"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:38:05.418716 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.418691    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53b8b7dd-b7ae-40ee-a791-10ebaf339a98-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "53b8b7dd-b7ae-40ee-a791-10ebaf339a98" (UID: "53b8b7dd-b7ae-40ee-a791-10ebaf339a98"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:38:05.418793 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.418756    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53b8b7dd-b7ae-40ee-a791-10ebaf339a98-kube-api-access-m6zcm" (OuterVolumeSpecName: "kube-api-access-m6zcm") pod "53b8b7dd-b7ae-40ee-a791-10ebaf339a98" (UID: "53b8b7dd-b7ae-40ee-a791-10ebaf339a98"). InnerVolumeSpecName "kube-api-access-m6zcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:38:05.518030 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.517997    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53b8b7dd-b7ae-40ee-a791-10ebaf339a98-maas-api-tls\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:38:05.518030 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.518028    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6zcm\" (UniqueName: \"kubernetes.io/projected/53b8b7dd-b7ae-40ee-a791-10ebaf339a98-kube-api-access-m6zcm\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:38:05.518030 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.518037    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53b8b7dd-b7ae-40ee-a791-10ebaf339a98-openshift-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:38:05.708546 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.708501    2565 generic.go:356] "Generic (PLEG): container finished" podID="53b8b7dd-b7ae-40ee-a791-10ebaf339a98" containerID="742cbe82daeadc591a75d8620dee3d71ab00f8beb08159528717fb106be5d3c8" exitCode=0
Jul 22 03:38:05.708546 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.708549    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"
Jul 22 03:38:05.708783 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.708597    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv" event={"ID":"53b8b7dd-b7ae-40ee-a791-10ebaf339a98","Type":"ContainerDied","Data":"742cbe82daeadc591a75d8620dee3d71ab00f8beb08159528717fb106be5d3c8"}
Jul 22 03:38:05.708783 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.708657    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv" event={"ID":"53b8b7dd-b7ae-40ee-a791-10ebaf339a98","Type":"ContainerDied","Data":"73c92e147f8f708ebb6071899489d7a82e3a9b7b99e50fec05bb888ab0604495"}
Jul 22 03:38:05.708783 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.708679    2565 scope.go:117] "RemoveContainer" containerID="742cbe82daeadc591a75d8620dee3d71ab00f8beb08159528717fb106be5d3c8"
Jul 22 03:38:05.717417 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.717399    2565 scope.go:117] "RemoveContainer" containerID="742cbe82daeadc591a75d8620dee3d71ab00f8beb08159528717fb106be5d3c8"
Jul 22 03:38:05.717708 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:38:05.717689    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"742cbe82daeadc591a75d8620dee3d71ab00f8beb08159528717fb106be5d3c8\": container with ID starting with 742cbe82daeadc591a75d8620dee3d71ab00f8beb08159528717fb106be5d3c8 not found: ID does not exist" containerID="742cbe82daeadc591a75d8620dee3d71ab00f8beb08159528717fb106be5d3c8"
Jul 22 03:38:05.717765 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.717717    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"742cbe82daeadc591a75d8620dee3d71ab00f8beb08159528717fb106be5d3c8"} err="failed to get container status \"742cbe82daeadc591a75d8620dee3d71ab00f8beb08159528717fb106be5d3c8\": rpc error: code = NotFound desc = could not find container \"742cbe82daeadc591a75d8620dee3d71ab00f8beb08159528717fb106be5d3c8\": container with ID starting with 742cbe82daeadc591a75d8620dee3d71ab00f8beb08159528717fb106be5d3c8 not found: ID does not exist"
Jul 22 03:38:05.729693 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.729659    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"]
Jul 22 03:38:05.733837 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:05.733811    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1535280c-7cb64bbc76-jcjnv"]
Jul 22 03:38:07.243972 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:38:07.243929    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53b8b7dd-b7ae-40ee-a791-10ebaf339a98" path="/var/lib/kubelet/pods/53b8b7dd-b7ae-40ee-a791-10ebaf339a98/volumes"
Jul 22 03:39:52.175811 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:52.175770    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"]
Jul 22 03:39:52.176476 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:52.176175    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53b8b7dd-b7ae-40ee-a791-10ebaf339a98" containerName="maas-api"
Jul 22 03:39:52.176476 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:52.176190    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="53b8b7dd-b7ae-40ee-a791-10ebaf339a98" containerName="maas-api"
Jul 22 03:39:52.176476 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:52.176253    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="53b8b7dd-b7ae-40ee-a791-10ebaf339a98" containerName="maas-api"
Jul 22 03:39:52.179544 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:52.179523    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"
Jul 22 03:39:52.182770 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:52.182738    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-1c3450ee-serving-cert\""
Jul 22 03:39:52.194073 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:52.194042    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"]
Jul 22 03:39:52.211812 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:52.211779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/866f29cc-fcbb-4378-a906-7b2f543baa30-openshift-service-ca\") pod \"maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s\" (UID: \"866f29cc-fcbb-4378-a906-7b2f543baa30\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"
Jul 22 03:39:52.211994 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:52.211826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/866f29cc-fcbb-4378-a906-7b2f543baa30-maas-api-tls\") pod \"maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s\" (UID: \"866f29cc-fcbb-4378-a906-7b2f543baa30\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"
Jul 22 03:39:52.211994 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:52.211922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4hg4\" (UniqueName: \"kubernetes.io/projected/866f29cc-fcbb-4378-a906-7b2f543baa30-kube-api-access-p4hg4\") pod \"maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s\" (UID: \"866f29cc-fcbb-4378-a906-7b2f543baa30\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"
Jul 22 03:39:52.313368 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:52.313328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4hg4\" (UniqueName: \"kubernetes.io/projected/866f29cc-fcbb-4378-a906-7b2f543baa30-kube-api-access-p4hg4\") pod \"maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s\" (UID: \"866f29cc-fcbb-4378-a906-7b2f543baa30\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"
Jul 22 03:39:52.313617 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:52.313384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/866f29cc-fcbb-4378-a906-7b2f543baa30-openshift-service-ca\") pod \"maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s\" (UID: \"866f29cc-fcbb-4378-a906-7b2f543baa30\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"
Jul 22 03:39:52.313617 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:52.313420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/866f29cc-fcbb-4378-a906-7b2f543baa30-maas-api-tls\") pod \"maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s\" (UID: \"866f29cc-fcbb-4378-a906-7b2f543baa30\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"
Jul 22 03:39:52.313617 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:39:52.313523    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-serving-cert: secret "maas-api-e2e-mt-1c3450ee-serving-cert" not found
Jul 22 03:39:52.313617 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:39:52.313611    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866f29cc-fcbb-4378-a906-7b2f543baa30-maas-api-tls podName:866f29cc-fcbb-4378-a906-7b2f543baa30 nodeName:}" failed. No retries permitted until 2026-07-22 03:39:52.813586161 +0000 UTC m=+1930.275136545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/866f29cc-fcbb-4378-a906-7b2f543baa30-maas-api-tls") pod "maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s" (UID: "866f29cc-fcbb-4378-a906-7b2f543baa30") : secret "maas-api-e2e-mt-1c3450ee-serving-cert" not found
Jul 22 03:39:52.314048 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:52.314028    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/866f29cc-fcbb-4378-a906-7b2f543baa30-openshift-service-ca\") pod \"maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s\" (UID: \"866f29cc-fcbb-4378-a906-7b2f543baa30\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"
Jul 22 03:39:52.337944 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:52.337901    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4hg4\" (UniqueName: \"kubernetes.io/projected/866f29cc-fcbb-4378-a906-7b2f543baa30-kube-api-access-p4hg4\") pod \"maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s\" (UID: \"866f29cc-fcbb-4378-a906-7b2f543baa30\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"
Jul 22 03:39:52.817681 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:52.817642    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/866f29cc-fcbb-4378-a906-7b2f543baa30-maas-api-tls\") pod \"maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s\" (UID: \"866f29cc-fcbb-4378-a906-7b2f543baa30\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"
Jul 22 03:39:52.820161 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:52.820135    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/866f29cc-fcbb-4378-a906-7b2f543baa30-maas-api-tls\") pod \"maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s\" (UID: \"866f29cc-fcbb-4378-a906-7b2f543baa30\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"
Jul 22 03:39:53.090016 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:53.089927    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"
Jul 22 03:39:53.239603 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:53.235628    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"]
Jul 22 03:39:53.245108 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:39:53.245072    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod866f29cc_fcbb_4378_a906_7b2f543baa30.slice/crio-9fedc9a9d920429b16c78b0013bd1fd662ec1033beadfcd377405a9601fab640 WatchSource:0}: Error finding container 9fedc9a9d920429b16c78b0013bd1fd662ec1033beadfcd377405a9601fab640: Status 404 returned error can't find the container with id 9fedc9a9d920429b16c78b0013bd1fd662ec1033beadfcd377405a9601fab640
Jul 22 03:39:54.194162 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:54.194115    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s" event={"ID":"866f29cc-fcbb-4378-a906-7b2f543baa30","Type":"ContainerStarted","Data":"a5495f1a04a5bd34c675dd223af5b6aa88fa751ed3e8fdbf675988104d289528"}
Jul 22 03:39:54.194422 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:54.194184    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s" event={"ID":"866f29cc-fcbb-4378-a906-7b2f543baa30","Type":"ContainerStarted","Data":"9fedc9a9d920429b16c78b0013bd1fd662ec1033beadfcd377405a9601fab640"}
Jul 22 03:39:54.194422 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:54.194261    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"
Jul 22 03:39:54.212778 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:39:54.212717    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s" podStartSLOduration=1.796230919 podStartE2EDuration="2.212698394s" totalImagesPullingTime="416.467475ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:39:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:39:54.212480281 +0000 UTC m=+1931.674030702" watchObservedRunningTime="2026-07-22 03:39:54.212698394 +0000 UTC m=+1931.674248802"
Jul 22 03:40:00.205223 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:00.205190    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"
Jul 22 03:40:03.910958 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:03.910926    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c3450ee-4ztxg"]
Jul 22 03:40:03.914428 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:03.914411    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c3450ee-4ztxg"
Jul 22 03:40:03.920358 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:03.920340    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xvl7w\""
Jul 22 03:40:03.928939 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:03.928907    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c3450ee-4ztxg"]
Jul 22 03:40:04.014681 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:04.014654    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd32c820-e845-46a8-ba19-bbf542d77939-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1c3450ee-4ztxg\" (UID: \"bd32c820-e845-46a8-ba19-bbf542d77939\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c3450ee-4ztxg"
Jul 22 03:40:04.115482 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:04.115453    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd32c820-e845-46a8-ba19-bbf542d77939-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1c3450ee-4ztxg\" (UID: \"bd32c820-e845-46a8-ba19-bbf542d77939\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c3450ee-4ztxg"
Jul 22 03:40:04.116089 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:04.116068    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd32c820-e845-46a8-ba19-bbf542d77939-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1c3450ee-4ztxg\" (UID: \"bd32c820-e845-46a8-ba19-bbf542d77939\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c3450ee-4ztxg"
Jul 22 03:40:04.224049 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:04.224024    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c3450ee-4ztxg"
Jul 22 03:40:04.357610 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:04.357540    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c3450ee-4ztxg"]
Jul 22 03:40:05.244035 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:05.244000    2565 generic.go:356] "Generic (PLEG): container finished" podID="bd32c820-e845-46a8-ba19-bbf542d77939" containerID="4dc160512fe88e2a8fcac225cddf427ffe3cab1a398aa4fdf1004d08148d1692" exitCode=0
Jul 22 03:40:05.244472 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:05.244444    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c3450ee-4ztxg" event={"ID":"bd32c820-e845-46a8-ba19-bbf542d77939","Type":"ContainerDied","Data":"4dc160512fe88e2a8fcac225cddf427ffe3cab1a398aa4fdf1004d08148d1692"}
Jul 22 03:40:05.244623 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:05.244497    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c3450ee-4ztxg" event={"ID":"bd32c820-e845-46a8-ba19-bbf542d77939","Type":"ContainerStarted","Data":"c2fd1db85b07ea43030ae055d17b09b2c5e6290eb48c503fd9988f8da2ea8b42"}
Jul 22 03:40:06.378360 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:06.378336    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c3450ee-4ztxg"
Jul 22 03:40:06.432248 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:06.432220    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd32c820-e845-46a8-ba19-bbf542d77939-maas-api-service-ca\") pod \"bd32c820-e845-46a8-ba19-bbf542d77939\" (UID: \"bd32c820-e845-46a8-ba19-bbf542d77939\") "
Jul 22 03:40:06.432545 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:06.432522    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd32c820-e845-46a8-ba19-bbf542d77939-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bd32c820-e845-46a8-ba19-bbf542d77939" (UID: "bd32c820-e845-46a8-ba19-bbf542d77939"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:40:06.533147 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:06.533074    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd32c820-e845-46a8-ba19-bbf542d77939-maas-api-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:40:07.253700 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:07.253675    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c3450ee-4ztxg"
Jul 22 03:40:07.253825 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:07.253721    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c3450ee-4ztxg" event={"ID":"bd32c820-e845-46a8-ba19-bbf542d77939","Type":"ContainerDied","Data":"c2fd1db85b07ea43030ae055d17b09b2c5e6290eb48c503fd9988f8da2ea8b42"}
Jul 22 03:40:07.253825 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:07.253763    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2fd1db85b07ea43030ae055d17b09b2c5e6290eb48c503fd9988f8da2ea8b42"
Jul 22 03:40:14.502531 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:14.502496    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"]
Jul 22 03:40:14.503027 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:14.502821    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s" podUID="866f29cc-fcbb-4378-a906-7b2f543baa30" containerName="maas-api" containerID="cri-o://a5495f1a04a5bd34c675dd223af5b6aa88fa751ed3e8fdbf675988104d289528" gracePeriod=30
Jul 22 03:40:14.751829 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:14.751804    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"
Jul 22 03:40:14.904173 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:14.904069    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4hg4\" (UniqueName: \"kubernetes.io/projected/866f29cc-fcbb-4378-a906-7b2f543baa30-kube-api-access-p4hg4\") pod \"866f29cc-fcbb-4378-a906-7b2f543baa30\" (UID: \"866f29cc-fcbb-4378-a906-7b2f543baa30\") "
Jul 22 03:40:14.904338 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:14.904276    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/866f29cc-fcbb-4378-a906-7b2f543baa30-openshift-service-ca\") pod \"866f29cc-fcbb-4378-a906-7b2f543baa30\" (UID: \"866f29cc-fcbb-4378-a906-7b2f543baa30\") "
Jul 22 03:40:14.904338 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:14.904327    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/866f29cc-fcbb-4378-a906-7b2f543baa30-maas-api-tls\") pod \"866f29cc-fcbb-4378-a906-7b2f543baa30\" (UID: \"866f29cc-fcbb-4378-a906-7b2f543baa30\") "
Jul 22 03:40:14.904653 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:14.904626    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/866f29cc-fcbb-4378-a906-7b2f543baa30-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "866f29cc-fcbb-4378-a906-7b2f543baa30" (UID: "866f29cc-fcbb-4378-a906-7b2f543baa30"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:40:14.906238 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:14.906214    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/866f29cc-fcbb-4378-a906-7b2f543baa30-kube-api-access-p4hg4" (OuterVolumeSpecName: "kube-api-access-p4hg4") pod "866f29cc-fcbb-4378-a906-7b2f543baa30" (UID: "866f29cc-fcbb-4378-a906-7b2f543baa30"). InnerVolumeSpecName "kube-api-access-p4hg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:40:14.906341 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:14.906315    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/866f29cc-fcbb-4378-a906-7b2f543baa30-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "866f29cc-fcbb-4378-a906-7b2f543baa30" (UID: "866f29cc-fcbb-4378-a906-7b2f543baa30"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:40:15.005284 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:15.005244    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/866f29cc-fcbb-4378-a906-7b2f543baa30-openshift-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:40:15.005284 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:15.005279    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/866f29cc-fcbb-4378-a906-7b2f543baa30-maas-api-tls\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:40:15.005284 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:15.005288    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4hg4\" (UniqueName: \"kubernetes.io/projected/866f29cc-fcbb-4378-a906-7b2f543baa30-kube-api-access-p4hg4\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:40:15.297899 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:15.297863    2565 generic.go:356] "Generic (PLEG): container finished" podID="866f29cc-fcbb-4378-a906-7b2f543baa30" containerID="a5495f1a04a5bd34c675dd223af5b6aa88fa751ed3e8fdbf675988104d289528" exitCode=0
Jul 22 03:40:15.297899 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:15.297902    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"
Jul 22 03:40:15.298113 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:15.297905    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s" event={"ID":"866f29cc-fcbb-4378-a906-7b2f543baa30","Type":"ContainerDied","Data":"a5495f1a04a5bd34c675dd223af5b6aa88fa751ed3e8fdbf675988104d289528"}
Jul 22 03:40:15.298113 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:15.298038    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s" event={"ID":"866f29cc-fcbb-4378-a906-7b2f543baa30","Type":"ContainerDied","Data":"9fedc9a9d920429b16c78b0013bd1fd662ec1033beadfcd377405a9601fab640"}
Jul 22 03:40:15.298113 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:15.298067    2565 scope.go:117] "RemoveContainer" containerID="a5495f1a04a5bd34c675dd223af5b6aa88fa751ed3e8fdbf675988104d289528"
Jul 22 03:40:15.306778 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:15.306760    2565 scope.go:117] "RemoveContainer" containerID="a5495f1a04a5bd34c675dd223af5b6aa88fa751ed3e8fdbf675988104d289528"
Jul 22 03:40:15.307074 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:40:15.307054    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5495f1a04a5bd34c675dd223af5b6aa88fa751ed3e8fdbf675988104d289528\": container with ID starting with a5495f1a04a5bd34c675dd223af5b6aa88fa751ed3e8fdbf675988104d289528 not found: ID does not exist" containerID="a5495f1a04a5bd34c675dd223af5b6aa88fa751ed3e8fdbf675988104d289528"
Jul 22 03:40:15.307165 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:15.307085    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5495f1a04a5bd34c675dd223af5b6aa88fa751ed3e8fdbf675988104d289528"} err="failed to get container status \"a5495f1a04a5bd34c675dd223af5b6aa88fa751ed3e8fdbf675988104d289528\": rpc error: code = NotFound desc = could not find container \"a5495f1a04a5bd34c675dd223af5b6aa88fa751ed3e8fdbf675988104d289528\": container with ID starting with a5495f1a04a5bd34c675dd223af5b6aa88fa751ed3e8fdbf675988104d289528 not found: ID does not exist"
Jul 22 03:40:15.314865 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:15.314839    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"]
Jul 22 03:40:15.318320 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:15.318300    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1c3450ee-86ffdb9cf-srq8s"]
Jul 22 03:40:17.243478 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:17.243430    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="866f29cc-fcbb-4378-a906-7b2f543baa30" path="/var/lib/kubelet/pods/866f29cc-fcbb-4378-a906-7b2f543baa30/volumes"
Jul 22 03:40:18.983690 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:18.983651    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c3450ee-4ztxg"]
Jul 22 03:40:18.986684 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:18.986659    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c3450ee-4ztxg"]
Jul 22 03:40:19.244252 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:19.244172    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd32c820-e845-46a8-ba19-bbf542d77939" path="/var/lib/kubelet/pods/bd32c820-e845-46a8-ba19-bbf542d77939/volumes"
Jul 22 03:40:50.446673 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.446637    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"]
Jul 22 03:40:50.447216 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.447194    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd32c820-e845-46a8-ba19-bbf542d77939" containerName="revoke-keys"
Jul 22 03:40:50.447326 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.447219    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd32c820-e845-46a8-ba19-bbf542d77939" containerName="revoke-keys"
Jul 22 03:40:50.447326 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.447249    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="866f29cc-fcbb-4378-a906-7b2f543baa30" containerName="maas-api"
Jul 22 03:40:50.447326 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.447257    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="866f29cc-fcbb-4378-a906-7b2f543baa30" containerName="maas-api"
Jul 22 03:40:50.447477 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.447342    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="866f29cc-fcbb-4378-a906-7b2f543baa30" containerName="maas-api"
Jul 22 03:40:50.447477 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.447354    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd32c820-e845-46a8-ba19-bbf542d77939" containerName="revoke-keys"
Jul 22 03:40:50.450705 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.450683    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"
Jul 22 03:40:50.453421 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.453396    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-513b5fd3-serving-cert\""
Jul 22 03:40:50.461069 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.461043    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"]
Jul 22 03:40:50.522953 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.522914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzs8t\" (UniqueName: \"kubernetes.io/projected/4af16ad3-defd-4e99-85ed-e6db8434e9e7-kube-api-access-fzs8t\") pod \"maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh\" (UID: \"4af16ad3-defd-4e99-85ed-e6db8434e9e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"
Jul 22 03:40:50.523139 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.522971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4af16ad3-defd-4e99-85ed-e6db8434e9e7-openshift-service-ca\") pod \"maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh\" (UID: \"4af16ad3-defd-4e99-85ed-e6db8434e9e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"
Jul 22 03:40:50.523139 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.523036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4af16ad3-defd-4e99-85ed-e6db8434e9e7-maas-api-tls\") pod \"maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh\" (UID: \"4af16ad3-defd-4e99-85ed-e6db8434e9e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"
Jul 22 03:40:50.623852 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.623815    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4af16ad3-defd-4e99-85ed-e6db8434e9e7-openshift-service-ca\") pod \"maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh\" (UID: \"4af16ad3-defd-4e99-85ed-e6db8434e9e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"
Jul 22 03:40:50.624036 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.623887    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4af16ad3-defd-4e99-85ed-e6db8434e9e7-maas-api-tls\") pod \"maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh\" (UID: \"4af16ad3-defd-4e99-85ed-e6db8434e9e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"
Jul 22 03:40:50.624036 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.623926    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzs8t\" (UniqueName: \"kubernetes.io/projected/4af16ad3-defd-4e99-85ed-e6db8434e9e7-kube-api-access-fzs8t\") pod \"maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh\" (UID: \"4af16ad3-defd-4e99-85ed-e6db8434e9e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"
Jul 22 03:40:50.624616 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.624592    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4af16ad3-defd-4e99-85ed-e6db8434e9e7-openshift-service-ca\") pod \"maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh\" (UID: \"4af16ad3-defd-4e99-85ed-e6db8434e9e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"
Jul 22 03:40:50.626429 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.626406    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4af16ad3-defd-4e99-85ed-e6db8434e9e7-maas-api-tls\") pod \"maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh\" (UID: \"4af16ad3-defd-4e99-85ed-e6db8434e9e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"
Jul 22 03:40:50.635573 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.635531    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzs8t\" (UniqueName: \"kubernetes.io/projected/4af16ad3-defd-4e99-85ed-e6db8434e9e7-kube-api-access-fzs8t\") pod \"maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh\" (UID: \"4af16ad3-defd-4e99-85ed-e6db8434e9e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"
Jul 22 03:40:50.762874 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.762780    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"
Jul 22 03:40:50.911061 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.911029    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"]
Jul 22 03:40:50.911598 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:40:50.911547    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af16ad3_defd_4e99_85ed_e6db8434e9e7.slice/crio-c60070b1ef67cf09abff462b9697dc193717d35cf3516df9c6a026a18c81721e WatchSource:0}: Error finding container c60070b1ef67cf09abff462b9697dc193717d35cf3516df9c6a026a18c81721e: Status 404 returned error can't find the container with id c60070b1ef67cf09abff462b9697dc193717d35cf3516df9c6a026a18c81721e
Jul 22 03:40:50.913093 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:50.913073    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:40:51.461299 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:51.461259    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh" event={"ID":"4af16ad3-defd-4e99-85ed-e6db8434e9e7","Type":"ContainerStarted","Data":"e59c8c90e46a7b74640ecbcbb76e69b7164afad69d930d4058756619eebca671"}
Jul 22 03:40:51.461733 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:51.461319    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh" event={"ID":"4af16ad3-defd-4e99-85ed-e6db8434e9e7","Type":"ContainerStarted","Data":"c60070b1ef67cf09abff462b9697dc193717d35cf3516df9c6a026a18c81721e"}
Jul 22 03:40:51.461733 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:51.461350    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"
Jul 22 03:40:51.483864 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:51.483805    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh" podStartSLOduration=1.080708684 podStartE2EDuration="1.483789071s" totalImagesPullingTime="403.080387ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:40:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:40:51.481727184 +0000 UTC m=+1988.943277591" watchObservedRunningTime="2026-07-22 03:40:51.483789071 +0000 UTC m=+1988.945339476"
Jul 22 03:40:57.472974 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:40:57.472940    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"
Jul 22 03:41:33.295771 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:33.295726    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-513b5fd3-shd6h"]
Jul 22 03:41:33.299131 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:33.299106    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-513b5fd3-shd6h"
Jul 22 03:41:33.301455 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:33.301433    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xvl7w\""
Jul 22 03:41:33.305803 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:33.305771    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-513b5fd3-shd6h"]
Jul 22 03:41:33.394054 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:33.394013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31810633-b440-4955-bda2-5034fdbde7e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-513b5fd3-shd6h\" (UID: \"31810633-b440-4955-bda2-5034fdbde7e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-513b5fd3-shd6h"
Jul 22 03:41:33.494898 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:33.494858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31810633-b440-4955-bda2-5034fdbde7e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-513b5fd3-shd6h\" (UID: \"31810633-b440-4955-bda2-5034fdbde7e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-513b5fd3-shd6h"
Jul 22 03:41:33.495549 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:33.495528    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31810633-b440-4955-bda2-5034fdbde7e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-513b5fd3-shd6h\" (UID: \"31810633-b440-4955-bda2-5034fdbde7e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-513b5fd3-shd6h"
Jul 22 03:41:33.611983 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:33.611894    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-513b5fd3-shd6h"
Jul 22 03:41:33.777884 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:33.777783    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-513b5fd3-shd6h"]
Jul 22 03:41:33.780343 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:41:33.780315    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31810633_b440_4955_bda2_5034fdbde7e1.slice/crio-57022772dc9636cfbd185516ebe00b16dcfbd8f5503a6cb1ff4755c687ff0472 WatchSource:0}: Error finding container 57022772dc9636cfbd185516ebe00b16dcfbd8f5503a6cb1ff4755c687ff0472: Status 404 returned error can't find the container with id 57022772dc9636cfbd185516ebe00b16dcfbd8f5503a6cb1ff4755c687ff0472
Jul 22 03:41:34.656634 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:34.656597    2565 generic.go:356] "Generic (PLEG): container finished" podID="31810633-b440-4955-bda2-5034fdbde7e1" containerID="a7748e227a45d031322c6724d39de19487825e03402e26ff5a93159b06951e3e" exitCode=0
Jul 22 03:41:34.657017 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:34.656682    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-513b5fd3-shd6h" event={"ID":"31810633-b440-4955-bda2-5034fdbde7e1","Type":"ContainerDied","Data":"a7748e227a45d031322c6724d39de19487825e03402e26ff5a93159b06951e3e"}
Jul 22 03:41:34.657017 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:34.656737    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-513b5fd3-shd6h" event={"ID":"31810633-b440-4955-bda2-5034fdbde7e1","Type":"ContainerStarted","Data":"57022772dc9636cfbd185516ebe00b16dcfbd8f5503a6cb1ff4755c687ff0472"}
Jul 22 03:41:35.793953 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:35.793927    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-513b5fd3-shd6h"
Jul 22 03:41:35.815696 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:35.815668    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31810633-b440-4955-bda2-5034fdbde7e1-maas-api-service-ca\") pod \"31810633-b440-4955-bda2-5034fdbde7e1\" (UID: \"31810633-b440-4955-bda2-5034fdbde7e1\") "
Jul 22 03:41:35.816114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:35.816085    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31810633-b440-4955-bda2-5034fdbde7e1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "31810633-b440-4955-bda2-5034fdbde7e1" (UID: "31810633-b440-4955-bda2-5034fdbde7e1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:41:35.917322 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:35.917216    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31810633-b440-4955-bda2-5034fdbde7e1-maas-api-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:41:36.669017 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:36.668976    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-513b5fd3-shd6h" event={"ID":"31810633-b440-4955-bda2-5034fdbde7e1","Type":"ContainerDied","Data":"57022772dc9636cfbd185516ebe00b16dcfbd8f5503a6cb1ff4755c687ff0472"}
Jul 22 03:41:36.669197 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:36.669063    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57022772dc9636cfbd185516ebe00b16dcfbd8f5503a6cb1ff4755c687ff0472"
Jul 22 03:41:36.669197 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:36.668992    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-513b5fd3-shd6h"
Jul 22 03:41:48.791206 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:48.791163    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"]
Jul 22 03:41:48.791686 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:48.791359    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh" podUID="4af16ad3-defd-4e99-85ed-e6db8434e9e7" containerName="maas-api" containerID="cri-o://e59c8c90e46a7b74640ecbcbb76e69b7164afad69d930d4058756619eebca671" gracePeriod=30
Jul 22 03:41:49.037200 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.037173    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"
Jul 22 03:41:49.136796 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.136684    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4af16ad3-defd-4e99-85ed-e6db8434e9e7-maas-api-tls\") pod \"4af16ad3-defd-4e99-85ed-e6db8434e9e7\" (UID: \"4af16ad3-defd-4e99-85ed-e6db8434e9e7\") "
Jul 22 03:41:49.136796 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.136757    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzs8t\" (UniqueName: \"kubernetes.io/projected/4af16ad3-defd-4e99-85ed-e6db8434e9e7-kube-api-access-fzs8t\") pod \"4af16ad3-defd-4e99-85ed-e6db8434e9e7\" (UID: \"4af16ad3-defd-4e99-85ed-e6db8434e9e7\") "
Jul 22 03:41:49.137035 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.136876    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4af16ad3-defd-4e99-85ed-e6db8434e9e7-openshift-service-ca\") pod \"4af16ad3-defd-4e99-85ed-e6db8434e9e7\" (UID: \"4af16ad3-defd-4e99-85ed-e6db8434e9e7\") "
Jul 22 03:41:49.137275 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.137245    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af16ad3-defd-4e99-85ed-e6db8434e9e7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4af16ad3-defd-4e99-85ed-e6db8434e9e7" (UID: "4af16ad3-defd-4e99-85ed-e6db8434e9e7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:41:49.138825 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.138789    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af16ad3-defd-4e99-85ed-e6db8434e9e7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4af16ad3-defd-4e99-85ed-e6db8434e9e7" (UID: "4af16ad3-defd-4e99-85ed-e6db8434e9e7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:41:49.138923 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.138872    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4af16ad3-defd-4e99-85ed-e6db8434e9e7-kube-api-access-fzs8t" (OuterVolumeSpecName: "kube-api-access-fzs8t") pod "4af16ad3-defd-4e99-85ed-e6db8434e9e7" (UID: "4af16ad3-defd-4e99-85ed-e6db8434e9e7"). InnerVolumeSpecName "kube-api-access-fzs8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:41:49.237752 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.237712    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4af16ad3-defd-4e99-85ed-e6db8434e9e7-maas-api-tls\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:41:49.237752 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.237742    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzs8t\" (UniqueName: \"kubernetes.io/projected/4af16ad3-defd-4e99-85ed-e6db8434e9e7-kube-api-access-fzs8t\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:41:49.237752 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.237752    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4af16ad3-defd-4e99-85ed-e6db8434e9e7-openshift-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:41:49.728651 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.728616    2565 generic.go:356] "Generic (PLEG): container finished" podID="4af16ad3-defd-4e99-85ed-e6db8434e9e7" containerID="e59c8c90e46a7b74640ecbcbb76e69b7164afad69d930d4058756619eebca671" exitCode=0
Jul 22 03:41:49.728869 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.728673    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"
Jul 22 03:41:49.728869 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.728681    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh" event={"ID":"4af16ad3-defd-4e99-85ed-e6db8434e9e7","Type":"ContainerDied","Data":"e59c8c90e46a7b74640ecbcbb76e69b7164afad69d930d4058756619eebca671"}
Jul 22 03:41:49.728869 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.728753    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh" event={"ID":"4af16ad3-defd-4e99-85ed-e6db8434e9e7","Type":"ContainerDied","Data":"c60070b1ef67cf09abff462b9697dc193717d35cf3516df9c6a026a18c81721e"}
Jul 22 03:41:49.728869 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.728785    2565 scope.go:117] "RemoveContainer" containerID="e59c8c90e46a7b74640ecbcbb76e69b7164afad69d930d4058756619eebca671"
Jul 22 03:41:49.737387 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.737361    2565 scope.go:117] "RemoveContainer" containerID="e59c8c90e46a7b74640ecbcbb76e69b7164afad69d930d4058756619eebca671"
Jul 22 03:41:49.737784 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:41:49.737766    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e59c8c90e46a7b74640ecbcbb76e69b7164afad69d930d4058756619eebca671\": container with ID starting with e59c8c90e46a7b74640ecbcbb76e69b7164afad69d930d4058756619eebca671 not found: ID does not exist" containerID="e59c8c90e46a7b74640ecbcbb76e69b7164afad69d930d4058756619eebca671"
Jul 22 03:41:49.737848 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.737794    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e59c8c90e46a7b74640ecbcbb76e69b7164afad69d930d4058756619eebca671"} err="failed to get container status \"e59c8c90e46a7b74640ecbcbb76e69b7164afad69d930d4058756619eebca671\": rpc error: code = NotFound desc = could not find container \"e59c8c90e46a7b74640ecbcbb76e69b7164afad69d930d4058756619eebca671\": container with ID starting with e59c8c90e46a7b74640ecbcbb76e69b7164afad69d930d4058756619eebca671 not found: ID does not exist"
Jul 22 03:41:49.747409 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.747384    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"]
Jul 22 03:41:49.752393 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:49.752370    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-513b5fd3-b9864484b-d5fdh"]
Jul 22 03:41:51.244389 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:51.244354    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4af16ad3-defd-4e99-85ed-e6db8434e9e7" path="/var/lib/kubelet/pods/4af16ad3-defd-4e99-85ed-e6db8434e9e7/volumes"
Jul 22 03:41:53.375058 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:53.375018    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-513b5fd3-shd6h"]
Jul 22 03:41:53.377408 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:53.377381    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-513b5fd3-shd6h"]
Jul 22 03:41:55.243886 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:41:55.243840    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31810633-b440-4955-bda2-5034fdbde7e1" path="/var/lib/kubelet/pods/31810633-b440-4955-bda2-5034fdbde7e1/volumes"
Jul 22 03:42:43.252741 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:42:43.252709    2565 scope.go:117] "RemoveContainer" containerID="d992e5b12bb5dcfe20b66864c4d23fb9b754a4e2286b5eaee90b6913a221803c"
Jul 22 03:43:42.587764 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.587685    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"]
Jul 22 03:43:42.588213 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.588111    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31810633-b440-4955-bda2-5034fdbde7e1" containerName="revoke-keys"
Jul 22 03:43:42.588213 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.588125    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="31810633-b440-4955-bda2-5034fdbde7e1" containerName="revoke-keys"
Jul 22 03:43:42.588213 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.588139    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af16ad3-defd-4e99-85ed-e6db8434e9e7" containerName="maas-api"
Jul 22 03:43:42.588213 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.588147    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af16ad3-defd-4e99-85ed-e6db8434e9e7" containerName="maas-api"
Jul 22 03:43:42.588213 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.588208    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af16ad3-defd-4e99-85ed-e6db8434e9e7" containerName="maas-api"
Jul 22 03:43:42.588371 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.588222    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="31810633-b440-4955-bda2-5034fdbde7e1" containerName="revoke-keys"
Jul 22 03:43:42.591260 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.591239    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"
Jul 22 03:43:42.593761 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.593736    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-44f1c1-serving-cert\""
Jul 22 03:43:42.602011 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.601987    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"]
Jul 22 03:43:42.733779 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.733740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4de3a174-db02-460c-ad51-92e6363a2c55-openshift-service-ca\") pod \"maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp\" (UID: \"4de3a174-db02-460c-ad51-92e6363a2c55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"
Jul 22 03:43:42.733952 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.733796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28jhz\" (UniqueName: \"kubernetes.io/projected/4de3a174-db02-460c-ad51-92e6363a2c55-kube-api-access-28jhz\") pod \"maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp\" (UID: \"4de3a174-db02-460c-ad51-92e6363a2c55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"
Jul 22 03:43:42.733952 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.733824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4de3a174-db02-460c-ad51-92e6363a2c55-maas-api-tls\") pod \"maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp\" (UID: \"4de3a174-db02-460c-ad51-92e6363a2c55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"
Jul 22 03:43:42.834859 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.834820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4de3a174-db02-460c-ad51-92e6363a2c55-openshift-service-ca\") pod \"maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp\" (UID: \"4de3a174-db02-460c-ad51-92e6363a2c55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"
Jul 22 03:43:42.834859 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.834878    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28jhz\" (UniqueName: \"kubernetes.io/projected/4de3a174-db02-460c-ad51-92e6363a2c55-kube-api-access-28jhz\") pod \"maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp\" (UID: \"4de3a174-db02-460c-ad51-92e6363a2c55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"
Jul 22 03:43:42.835149 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.835000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4de3a174-db02-460c-ad51-92e6363a2c55-maas-api-tls\") pod \"maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp\" (UID: \"4de3a174-db02-460c-ad51-92e6363a2c55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"
Jul 22 03:43:42.835551 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.835527    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4de3a174-db02-460c-ad51-92e6363a2c55-openshift-service-ca\") pod \"maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp\" (UID: \"4de3a174-db02-460c-ad51-92e6363a2c55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"
Jul 22 03:43:42.837436 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.837415    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4de3a174-db02-460c-ad51-92e6363a2c55-maas-api-tls\") pod \"maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp\" (UID: \"4de3a174-db02-460c-ad51-92e6363a2c55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"
Jul 22 03:43:42.844082 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.844029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28jhz\" (UniqueName: \"kubernetes.io/projected/4de3a174-db02-460c-ad51-92e6363a2c55-kube-api-access-28jhz\") pod \"maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp\" (UID: \"4de3a174-db02-460c-ad51-92e6363a2c55\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"
Jul 22 03:43:42.902859 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:42.902821    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"
Jul 22 03:43:43.045231 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:43.045197    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"]
Jul 22 03:43:43.048005 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:43:43.047969    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4de3a174_db02_460c_ad51_92e6363a2c55.slice/crio-2c7bd98ea36c97322095cf788732ff3aa7d02177346cb1e2ff1c4d1a0c22a3b5 WatchSource:0}: Error finding container 2c7bd98ea36c97322095cf788732ff3aa7d02177346cb1e2ff1c4d1a0c22a3b5: Status 404 returned error can't find the container with id 2c7bd98ea36c97322095cf788732ff3aa7d02177346cb1e2ff1c4d1a0c22a3b5
Jul 22 03:43:43.227929 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:43.227891    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp" event={"ID":"4de3a174-db02-460c-ad51-92e6363a2c55","Type":"ContainerStarted","Data":"2c7bd98ea36c97322095cf788732ff3aa7d02177346cb1e2ff1c4d1a0c22a3b5"}
Jul 22 03:43:43.277725 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:43.277689    2565 scope.go:117] "RemoveContainer" containerID="36a7ece41217ab4aaa8c89404700f2d5d6cd9e2160ce702dd46b4d73c7d63649"
Jul 22 03:43:44.234515 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:44.234479    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp" event={"ID":"4de3a174-db02-460c-ad51-92e6363a2c55","Type":"ContainerStarted","Data":"35749906062af709587c864bf761e8f17c825f6c9fbf7f158b38c4f3e7105635"}
Jul 22 03:43:44.234934 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:44.234670    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"
Jul 22 03:43:44.254949 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:44.254885    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp" podStartSLOduration=1.7637014949999998 podStartE2EDuration="2.254866005s" totalImagesPullingTime="491.16451ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:43:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:43:44.252762163 +0000 UTC m=+2161.714312569" watchObservedRunningTime="2026-07-22 03:43:44.254866005 +0000 UTC m=+2161.716416410"
Jul 22 03:43:50.244733 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:50.244702    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"
Jul 22 03:43:50.588748 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:50.588669    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"]
Jul 22 03:43:50.592256 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:50.592235    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"
Jul 22 03:43:50.594899 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:50.594877    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-4c93e4-serving-cert\""
Jul 22 03:43:50.613813 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:50.613777    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"]
Jul 22 03:43:50.708531 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:50.708490    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af25d44-3726-40ee-b50b-2185d53a1ad3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp\" (UID: \"2af25d44-3726-40ee-b50b-2185d53a1ad3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"
Jul 22 03:43:50.708731 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:50.708596    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af25d44-3726-40ee-b50b-2185d53a1ad3-maas-api-tls\") pod \"maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp\" (UID: \"2af25d44-3726-40ee-b50b-2185d53a1ad3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"
Jul 22 03:43:50.708731 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:50.708633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cs7h\" (UniqueName: \"kubernetes.io/projected/2af25d44-3726-40ee-b50b-2185d53a1ad3-kube-api-access-5cs7h\") pod \"maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp\" (UID: \"2af25d44-3726-40ee-b50b-2185d53a1ad3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"
Jul 22 03:43:50.809595 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:50.809530    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af25d44-3726-40ee-b50b-2185d53a1ad3-maas-api-tls\") pod \"maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp\" (UID: \"2af25d44-3726-40ee-b50b-2185d53a1ad3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"
Jul 22 03:43:50.809806 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:50.809632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cs7h\" (UniqueName: \"kubernetes.io/projected/2af25d44-3726-40ee-b50b-2185d53a1ad3-kube-api-access-5cs7h\") pod \"maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp\" (UID: \"2af25d44-3726-40ee-b50b-2185d53a1ad3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"
Jul 22 03:43:50.809806 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:50.809676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af25d44-3726-40ee-b50b-2185d53a1ad3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp\" (UID: \"2af25d44-3726-40ee-b50b-2185d53a1ad3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"
Jul 22 03:43:50.810320 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:50.810294    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af25d44-3726-40ee-b50b-2185d53a1ad3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp\" (UID: \"2af25d44-3726-40ee-b50b-2185d53a1ad3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"
Jul 22 03:43:50.812138 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:50.812114    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af25d44-3726-40ee-b50b-2185d53a1ad3-maas-api-tls\") pod \"maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp\" (UID: \"2af25d44-3726-40ee-b50b-2185d53a1ad3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"
Jul 22 03:43:50.821999 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:50.821977    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cs7h\" (UniqueName: \"kubernetes.io/projected/2af25d44-3726-40ee-b50b-2185d53a1ad3-kube-api-access-5cs7h\") pod \"maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp\" (UID: \"2af25d44-3726-40ee-b50b-2185d53a1ad3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"
Jul 22 03:43:50.904868 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:50.904767    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"
Jul 22 03:43:51.050281 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:51.049947    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"]
Jul 22 03:43:51.052463 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:43:51.052434    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af25d44_3726_40ee_b50b_2185d53a1ad3.slice/crio-fd2df9bccbeabf10ea984e354af68d21b43fac694e9d6a196917d3c8eb4851f8 WatchSource:0}: Error finding container fd2df9bccbeabf10ea984e354af68d21b43fac694e9d6a196917d3c8eb4851f8: Status 404 returned error can't find the container with id fd2df9bccbeabf10ea984e354af68d21b43fac694e9d6a196917d3c8eb4851f8
Jul 22 03:43:51.270993 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:51.270955    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp" event={"ID":"2af25d44-3726-40ee-b50b-2185d53a1ad3","Type":"ContainerStarted","Data":"fd2df9bccbeabf10ea984e354af68d21b43fac694e9d6a196917d3c8eb4851f8"}
Jul 22 03:43:52.276649 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:52.276611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp" event={"ID":"2af25d44-3726-40ee-b50b-2185d53a1ad3","Type":"ContainerStarted","Data":"26e189d1f3e95fd4c69ea90392c34bd1d248563cbcd5784f81910c5a012ac23e"}
Jul 22 03:43:52.277139 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:52.276758    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"
Jul 22 03:43:52.304919 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:52.304863    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp" podStartSLOduration=1.9923808360000002 podStartE2EDuration="2.304846591s" totalImagesPullingTime="312.465755ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:43:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:43:52.303428982 +0000 UTC m=+2169.764979390" watchObservedRunningTime="2026-07-22 03:43:52.304846591 +0000 UTC m=+2169.766396997"
Jul 22 03:43:58.287908 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:43:58.287876    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"
Jul 22 03:45:00.132392 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.132353    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-44f1c1-29744865-hchth"]
Jul 22 03:45:00.135809 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.135784    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744865-gpn2x"]
Jul 22 03:45:00.135953 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.135913    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-44f1c1-29744865-hchth"
Jul 22 03:45:00.138303 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.138273    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xvl7w\""
Jul 22 03:45:00.139178 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.139159    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4c93e4-29744865-9stnr"]
Jul 22 03:45:00.139279 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.139255    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744865-gpn2x"
Jul 22 03:45:00.142214 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.142196    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4c93e4-29744865-9stnr"
Jul 22 03:45:00.145012 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.144981    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-44f1c1-29744865-hchth"]
Jul 22 03:45:00.148671 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.148641    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4c93e4-29744865-9stnr"]
Jul 22 03:45:00.149510 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.149210    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-44f1c1-29744865-hchth"
Jul 22 03:45:00.151003 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.150969    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744865-gpn2x"]
Jul 22 03:45:00.160386 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.160364    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744865-gpn2x"
Jul 22 03:45:00.198074 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.198043    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4c93e4-29744865-9stnr"
Jul 22 03:45:00.316415 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.314421    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-44f1c1-29744865-hchth"]
Jul 22 03:45:00.340982 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.340865    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744865-gpn2x"]
Jul 22 03:45:00.344235 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:45:00.344199    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1bb828_cc45_4b4b_a751_3444e185b625.slice/crio-7f8bbe575024f5038aa1a90c18ce6b488e1a2513ba156c6c02088749494ae48b WatchSource:0}: Error finding container 7f8bbe575024f5038aa1a90c18ce6b488e1a2513ba156c6c02088749494ae48b: Status 404 returned error can't find the container with id 7f8bbe575024f5038aa1a90c18ce6b488e1a2513ba156c6c02088749494ae48b
Jul 22 03:45:00.374129 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.374104    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4c93e4-29744865-9stnr"]
Jul 22 03:45:00.376007 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:45:00.375983    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5492e81d_f9c9_4401_bd0f_a8f978b7b4d1.slice/crio-1cfb1913a1b22cb40df69584b96a39ef380b7b36d12c95fcbb1c1cee0128d409 WatchSource:0}: Error finding container 1cfb1913a1b22cb40df69584b96a39ef380b7b36d12c95fcbb1c1cee0128d409: Status 404 returned error can't find the container with id 1cfb1913a1b22cb40df69584b96a39ef380b7b36d12c95fcbb1c1cee0128d409
Jul 22 03:45:00.592653 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.592609    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-44f1c1-29744865-hchth" event={"ID":"7a537242-1b8c-4ca9-89da-25ecef0a9adc","Type":"ContainerStarted","Data":"923e9b96655d330194a4df09c58d908a90b9eb2920067bf45b8af8fafe0f23c7"}
Jul 22 03:45:00.592835 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.592680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-44f1c1-29744865-hchth" event={"ID":"7a537242-1b8c-4ca9-89da-25ecef0a9adc","Type":"ContainerStarted","Data":"e76262be9707b0533dcfa68608e082f63ec12ca41894523e777db524265ea5be"}
Jul 22 03:45:00.593928 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.593900    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4c93e4-29744865-9stnr" event={"ID":"5492e81d-f9c9-4401-bd0f-a8f978b7b4d1","Type":"ContainerStarted","Data":"1cfb1913a1b22cb40df69584b96a39ef380b7b36d12c95fcbb1c1cee0128d409"}
Jul 22 03:45:00.595025 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.595000    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744865-gpn2x" event={"ID":"1a1bb828-cc45-4b4b-a751-3444e185b625","Type":"ContainerStarted","Data":"7f8bbe575024f5038aa1a90c18ce6b488e1a2513ba156c6c02088749494ae48b"}
Jul 22 03:45:00.608774 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:00.608707    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-44f1c1-29744865-hchth" podStartSLOduration=0.608685822 podStartE2EDuration="608.685822ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:45:00.607880509 +0000 UTC m=+2238.069430917" watchObservedRunningTime="2026-07-22 03:45:00.608685822 +0000 UTC m=+2238.070236229"
Jul 22 03:45:01.603447 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:01.603345    2565 generic.go:356] "Generic (PLEG): container finished" podID="7a537242-1b8c-4ca9-89da-25ecef0a9adc" containerID="923e9b96655d330194a4df09c58d908a90b9eb2920067bf45b8af8fafe0f23c7" exitCode=0
Jul 22 03:45:01.603885 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:01.603435    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-44f1c1-29744865-hchth" event={"ID":"7a537242-1b8c-4ca9-89da-25ecef0a9adc","Type":"ContainerDied","Data":"923e9b96655d330194a4df09c58d908a90b9eb2920067bf45b8af8fafe0f23c7"}
Jul 22 03:45:01.605059 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:01.605034    2565 generic.go:356] "Generic (PLEG): container finished" podID="5492e81d-f9c9-4401-bd0f-a8f978b7b4d1" containerID="9a2aa1f881b581f75274e94b937b501974fb6ade372803720c9439b1fe6ad012" exitCode=0
Jul 22 03:45:01.605160 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:01.605072    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4c93e4-29744865-9stnr" event={"ID":"5492e81d-f9c9-4401-bd0f-a8f978b7b4d1","Type":"ContainerDied","Data":"9a2aa1f881b581f75274e94b937b501974fb6ade372803720c9439b1fe6ad012"}
Jul 22 03:45:01.606583 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:01.606473    2565 generic.go:356] "Generic (PLEG): container finished" podID="1a1bb828-cc45-4b4b-a751-3444e185b625" containerID="6bd661cbf61a7fbb4eee5deb549e7e3fa540098304f49447d3dc3c9f2a492907" exitCode=0
Jul 22 03:45:01.606583 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:01.606523    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744865-gpn2x" event={"ID":"1a1bb828-cc45-4b4b-a751-3444e185b625","Type":"ContainerDied","Data":"6bd661cbf61a7fbb4eee5deb549e7e3fa540098304f49447d3dc3c9f2a492907"}
Jul 22 03:45:02.746663 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:02.746633    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-44f1c1-29744865-hchth"
Jul 22 03:45:02.791725 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:02.791674    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4c93e4-29744865-9stnr"
Jul 22 03:45:02.794763 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:02.794741    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744865-gpn2x"
Jul 22 03:45:03.617165 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:03.617072    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-44f1c1-29744865-hchth"
Jul 22 03:45:03.617348 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:03.617080    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-44f1c1-29744865-hchth" event={"ID":"7a537242-1b8c-4ca9-89da-25ecef0a9adc","Type":"ContainerDied","Data":"e76262be9707b0533dcfa68608e082f63ec12ca41894523e777db524265ea5be"}
Jul 22 03:45:03.617348 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:03.617309    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e76262be9707b0533dcfa68608e082f63ec12ca41894523e777db524265ea5be"
Jul 22 03:45:03.618451 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:03.618415    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4c93e4-29744865-9stnr" event={"ID":"5492e81d-f9c9-4401-bd0f-a8f978b7b4d1","Type":"ContainerDied","Data":"1cfb1913a1b22cb40df69584b96a39ef380b7b36d12c95fcbb1c1cee0128d409"}
Jul 22 03:45:03.618451 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:03.618442    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4c93e4-29744865-9stnr"
Jul 22 03:45:03.618708 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:03.618471    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1cfb1913a1b22cb40df69584b96a39ef380b7b36d12c95fcbb1c1cee0128d409"
Jul 22 03:45:03.619804 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:03.619776    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744865-gpn2x"
Jul 22 03:45:03.619804 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:03.619784    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744865-gpn2x" event={"ID":"1a1bb828-cc45-4b4b-a751-3444e185b625","Type":"ContainerDied","Data":"7f8bbe575024f5038aa1a90c18ce6b488e1a2513ba156c6c02088749494ae48b"}
Jul 22 03:45:03.619996 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:03.619822    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f8bbe575024f5038aa1a90c18ce6b488e1a2513ba156c6c02088749494ae48b"
Jul 22 03:45:20.733006 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:20.732958    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc"]
Jul 22 03:45:20.735722 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:20.733324    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a1bb828-cc45-4b4b-a751-3444e185b625" containerName="cleanup"
Jul 22 03:45:20.735722 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:20.733337    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a1bb828-cc45-4b4b-a751-3444e185b625" containerName="cleanup"
Jul 22 03:45:20.735722 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:20.733359    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a537242-1b8c-4ca9-89da-25ecef0a9adc" containerName="cleanup"
Jul 22 03:45:20.735722 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:20.733365    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a537242-1b8c-4ca9-89da-25ecef0a9adc" containerName="cleanup"
Jul 22 03:45:20.735722 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:20.733373    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5492e81d-f9c9-4401-bd0f-a8f978b7b4d1" containerName="cleanup"
Jul 22 03:45:20.735722 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:20.733378    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5492e81d-f9c9-4401-bd0f-a8f978b7b4d1" containerName="cleanup"
Jul 22 03:45:20.735722 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:20.733434    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5492e81d-f9c9-4401-bd0f-a8f978b7b4d1" containerName="cleanup"
Jul 22 03:45:20.735722 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:20.733444    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a537242-1b8c-4ca9-89da-25ecef0a9adc" containerName="cleanup"
Jul 22 03:45:20.735722 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:20.733450    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a1bb828-cc45-4b4b-a751-3444e185b625" containerName="cleanup"
Jul 22 03:45:20.736475 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:20.736457    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc"
Jul 22 03:45:20.738803 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:20.738783    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xvl7w\""
Jul 22 03:45:20.743400 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:20.743374    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc"]
Jul 22 03:45:20.889930 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:20.889886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf8a4d2-2805-45bf-a65e-362d49a3ba52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc\" (UID: \"9bf8a4d2-2805-45bf-a65e-362d49a3ba52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc"
Jul 22 03:45:20.990855 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:20.990761    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf8a4d2-2805-45bf-a65e-362d49a3ba52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc\" (UID: \"9bf8a4d2-2805-45bf-a65e-362d49a3ba52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc"
Jul 22 03:45:20.991444 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:20.991415    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf8a4d2-2805-45bf-a65e-362d49a3ba52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc\" (UID: \"9bf8a4d2-2805-45bf-a65e-362d49a3ba52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc"
Jul 22 03:45:21.049353 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:21.049312    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc"
Jul 22 03:45:21.183459 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:21.183422    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc"]
Jul 22 03:45:21.186794 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:45:21.186764    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf8a4d2_2805_45bf_a65e_362d49a3ba52.slice/crio-d0f56a0dabfe98bc54660e57f6a7afc59a016f1088194c7bba8013ac5d2ac26b WatchSource:0}: Error finding container d0f56a0dabfe98bc54660e57f6a7afc59a016f1088194c7bba8013ac5d2ac26b: Status 404 returned error can't find the container with id d0f56a0dabfe98bc54660e57f6a7afc59a016f1088194c7bba8013ac5d2ac26b
Jul 22 03:45:21.703628 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:21.703529    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc" event={"ID":"9bf8a4d2-2805-45bf-a65e-362d49a3ba52","Type":"ContainerStarted","Data":"6a9a313fecddf6355cc61cc5ffb443f78ea460eb2e2813c0c450da536caaf711"}
Jul 22 03:45:21.703628 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:21.703596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc" event={"ID":"9bf8a4d2-2805-45bf-a65e-362d49a3ba52","Type":"ContainerStarted","Data":"d0f56a0dabfe98bc54660e57f6a7afc59a016f1088194c7bba8013ac5d2ac26b"}
Jul 22 03:45:21.718414 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:21.718363    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc" podStartSLOduration=1.718347329 podStartE2EDuration="1.718347329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:45:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:45:21.717276442 +0000 UTC m=+2259.178826850" watchObservedRunningTime="2026-07-22 03:45:21.718347329 +0000 UTC m=+2259.179897734"
Jul 22 03:45:22.710166 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:22.710130    2565 generic.go:356] "Generic (PLEG): container finished" podID="9bf8a4d2-2805-45bf-a65e-362d49a3ba52" containerID="6a9a313fecddf6355cc61cc5ffb443f78ea460eb2e2813c0c450da536caaf711" exitCode=0
Jul 22 03:45:22.710591 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:22.710218    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc" event={"ID":"9bf8a4d2-2805-45bf-a65e-362d49a3ba52","Type":"ContainerDied","Data":"6a9a313fecddf6355cc61cc5ffb443f78ea460eb2e2813c0c450da536caaf711"}
Jul 22 03:45:23.848372 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:23.848346    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc"
Jul 22 03:45:24.016984 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:24.016888    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf8a4d2-2805-45bf-a65e-362d49a3ba52-maas-api-service-ca\") pod \"9bf8a4d2-2805-45bf-a65e-362d49a3ba52\" (UID: \"9bf8a4d2-2805-45bf-a65e-362d49a3ba52\") "
Jul 22 03:45:24.017283 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:24.017258    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bf8a4d2-2805-45bf-a65e-362d49a3ba52-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9bf8a4d2-2805-45bf-a65e-362d49a3ba52" (UID: "9bf8a4d2-2805-45bf-a65e-362d49a3ba52"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:45:24.117953 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:24.117923    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bf8a4d2-2805-45bf-a65e-362d49a3ba52-maas-api-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:45:24.721414 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:24.721372    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc" event={"ID":"9bf8a4d2-2805-45bf-a65e-362d49a3ba52","Type":"ContainerDied","Data":"d0f56a0dabfe98bc54660e57f6a7afc59a016f1088194c7bba8013ac5d2ac26b"}
Jul 22 03:45:24.721414 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:24.721422    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0f56a0dabfe98bc54660e57f6a7afc59a016f1088194c7bba8013ac5d2ac26b"
Jul 22 03:45:24.721671 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:24.721382    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc"
Jul 22 03:45:31.244888 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.244847    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"]
Jul 22 03:45:31.245401 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.245090    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp" podUID="4de3a174-db02-460c-ad51-92e6363a2c55" containerName="maas-api" containerID="cri-o://35749906062af709587c864bf761e8f17c825f6c9fbf7f158b38c4f3e7105635" gracePeriod=30
Jul 22 03:45:31.271112 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.271081    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-44f1c1-29744865-hchth"]
Jul 22 03:45:31.273319 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.273292    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-44f1c1-29744865-hchth"]
Jul 22 03:45:31.494924 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.494860    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"
Jul 22 03:45:31.688855 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.688815    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4de3a174-db02-460c-ad51-92e6363a2c55-openshift-service-ca\") pod \"4de3a174-db02-460c-ad51-92e6363a2c55\" (UID: \"4de3a174-db02-460c-ad51-92e6363a2c55\") "
Jul 22 03:45:31.689075 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.688874    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4de3a174-db02-460c-ad51-92e6363a2c55-maas-api-tls\") pod \"4de3a174-db02-460c-ad51-92e6363a2c55\" (UID: \"4de3a174-db02-460c-ad51-92e6363a2c55\") "
Jul 22 03:45:31.689075 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.688920    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28jhz\" (UniqueName: \"kubernetes.io/projected/4de3a174-db02-460c-ad51-92e6363a2c55-kube-api-access-28jhz\") pod \"4de3a174-db02-460c-ad51-92e6363a2c55\" (UID: \"4de3a174-db02-460c-ad51-92e6363a2c55\") "
Jul 22 03:45:31.689295 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.689270    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4de3a174-db02-460c-ad51-92e6363a2c55-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4de3a174-db02-460c-ad51-92e6363a2c55" (UID: "4de3a174-db02-460c-ad51-92e6363a2c55"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:45:31.691070 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.691043    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4de3a174-db02-460c-ad51-92e6363a2c55-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4de3a174-db02-460c-ad51-92e6363a2c55" (UID: "4de3a174-db02-460c-ad51-92e6363a2c55"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:45:31.691150 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.691074    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4de3a174-db02-460c-ad51-92e6363a2c55-kube-api-access-28jhz" (OuterVolumeSpecName: "kube-api-access-28jhz") pod "4de3a174-db02-460c-ad51-92e6363a2c55" (UID: "4de3a174-db02-460c-ad51-92e6363a2c55"). InnerVolumeSpecName "kube-api-access-28jhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:45:31.755002 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.754911    2565 generic.go:356] "Generic (PLEG): container finished" podID="4de3a174-db02-460c-ad51-92e6363a2c55" containerID="35749906062af709587c864bf761e8f17c825f6c9fbf7f158b38c4f3e7105635" exitCode=0
Jul 22 03:45:31.755002 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.754961    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"
Jul 22 03:45:31.755002 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.754978    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp" event={"ID":"4de3a174-db02-460c-ad51-92e6363a2c55","Type":"ContainerDied","Data":"35749906062af709587c864bf761e8f17c825f6c9fbf7f158b38c4f3e7105635"}
Jul 22 03:45:31.755224 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.755033    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp" event={"ID":"4de3a174-db02-460c-ad51-92e6363a2c55","Type":"ContainerDied","Data":"2c7bd98ea36c97322095cf788732ff3aa7d02177346cb1e2ff1c4d1a0c22a3b5"}
Jul 22 03:45:31.755224 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.755064    2565 scope.go:117] "RemoveContainer" containerID="35749906062af709587c864bf761e8f17c825f6c9fbf7f158b38c4f3e7105635"
Jul 22 03:45:31.764368 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.764350    2565 scope.go:117] "RemoveContainer" containerID="35749906062af709587c864bf761e8f17c825f6c9fbf7f158b38c4f3e7105635"
Jul 22 03:45:31.764649 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:45:31.764625    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35749906062af709587c864bf761e8f17c825f6c9fbf7f158b38c4f3e7105635\": container with ID starting with 35749906062af709587c864bf761e8f17c825f6c9fbf7f158b38c4f3e7105635 not found: ID does not exist" containerID="35749906062af709587c864bf761e8f17c825f6c9fbf7f158b38c4f3e7105635"
Jul 22 03:45:31.764705 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.764658    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35749906062af709587c864bf761e8f17c825f6c9fbf7f158b38c4f3e7105635"} err="failed to get container status \"35749906062af709587c864bf761e8f17c825f6c9fbf7f158b38c4f3e7105635\": rpc error: code = NotFound desc = could not find container \"35749906062af709587c864bf761e8f17c825f6c9fbf7f158b38c4f3e7105635\": container with ID starting with 35749906062af709587c864bf761e8f17c825f6c9fbf7f158b38c4f3e7105635 not found: ID does not exist"
Jul 22 03:45:31.779371 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.779345    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"]
Jul 22 03:45:31.783108 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.783081    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-44f1c1-7fcd6bc8f6-wq6gp"]
Jul 22 03:45:31.790476 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.790452    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28jhz\" (UniqueName: \"kubernetes.io/projected/4de3a174-db02-460c-ad51-92e6363a2c55-kube-api-access-28jhz\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:45:31.790594 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.790477    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4de3a174-db02-460c-ad51-92e6363a2c55-openshift-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:45:31.790594 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:31.790492    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4de3a174-db02-460c-ad51-92e6363a2c55-maas-api-tls\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:45:33.243924 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:33.243889    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4de3a174-db02-460c-ad51-92e6363a2c55" path="/var/lib/kubelet/pods/4de3a174-db02-460c-ad51-92e6363a2c55/volumes"
Jul 22 03:45:33.244291 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:33.244162    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a537242-1b8c-4ca9-89da-25ecef0a9adc" path="/var/lib/kubelet/pods/7a537242-1b8c-4ca9-89da-25ecef0a9adc/volumes"
Jul 22 03:45:35.824212 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:35.824176    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc"]
Jul 22 03:45:35.826928 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:35.826900    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-44f1c1-568lc"]
Jul 22 03:45:37.244001 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:37.243966    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bf8a4d2-2805-45bf-a65e-362d49a3ba52" path="/var/lib/kubelet/pods/9bf8a4d2-2805-45bf-a65e-362d49a3ba52/volumes"
Jul 22 03:45:53.793535 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:53.793500    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"]
Jul 22 03:45:53.794114 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:53.793774    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp" podUID="2af25d44-3726-40ee-b50b-2185d53a1ad3" containerName="maas-api" containerID="cri-o://26e189d1f3e95fd4c69ea90392c34bd1d248563cbcd5784f81910c5a012ac23e" gracePeriod=30
Jul 22 03:45:53.833017 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:53.832976    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4c93e4-29744865-9stnr"]
Jul 22 03:45:53.841427 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:53.841397    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-4c93e4-29744865-9stnr"]
Jul 22 03:45:54.045607 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.045522    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"
Jul 22 03:45:54.083011 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.082981    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af25d44-3726-40ee-b50b-2185d53a1ad3-openshift-service-ca\") pod \"2af25d44-3726-40ee-b50b-2185d53a1ad3\" (UID: \"2af25d44-3726-40ee-b50b-2185d53a1ad3\") "
Jul 22 03:45:54.083205 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.083053    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af25d44-3726-40ee-b50b-2185d53a1ad3-maas-api-tls\") pod \"2af25d44-3726-40ee-b50b-2185d53a1ad3\" (UID: \"2af25d44-3726-40ee-b50b-2185d53a1ad3\") "
Jul 22 03:45:54.083205 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.083075    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cs7h\" (UniqueName: \"kubernetes.io/projected/2af25d44-3726-40ee-b50b-2185d53a1ad3-kube-api-access-5cs7h\") pod \"2af25d44-3726-40ee-b50b-2185d53a1ad3\" (UID: \"2af25d44-3726-40ee-b50b-2185d53a1ad3\") "
Jul 22 03:45:54.083460 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.083428    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af25d44-3726-40ee-b50b-2185d53a1ad3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2af25d44-3726-40ee-b50b-2185d53a1ad3" (UID: "2af25d44-3726-40ee-b50b-2185d53a1ad3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:45:54.085194 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.085165    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2af25d44-3726-40ee-b50b-2185d53a1ad3-kube-api-access-5cs7h" (OuterVolumeSpecName: "kube-api-access-5cs7h") pod "2af25d44-3726-40ee-b50b-2185d53a1ad3" (UID: "2af25d44-3726-40ee-b50b-2185d53a1ad3"). InnerVolumeSpecName "kube-api-access-5cs7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:45:54.085294 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.085236    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2af25d44-3726-40ee-b50b-2185d53a1ad3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2af25d44-3726-40ee-b50b-2185d53a1ad3" (UID: "2af25d44-3726-40ee-b50b-2185d53a1ad3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:45:54.184297 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.184264    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af25d44-3726-40ee-b50b-2185d53a1ad3-maas-api-tls\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:45:54.184297 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.184294    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cs7h\" (UniqueName: \"kubernetes.io/projected/2af25d44-3726-40ee-b50b-2185d53a1ad3-kube-api-access-5cs7h\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:45:54.184297 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.184304    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af25d44-3726-40ee-b50b-2185d53a1ad3-openshift-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:45:54.863082 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.863048    2565 generic.go:356] "Generic (PLEG): container finished" podID="2af25d44-3726-40ee-b50b-2185d53a1ad3" containerID="26e189d1f3e95fd4c69ea90392c34bd1d248563cbcd5784f81910c5a012ac23e" exitCode=0
Jul 22 03:45:54.863833 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.863099    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"
Jul 22 03:45:54.863833 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.863135    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp" event={"ID":"2af25d44-3726-40ee-b50b-2185d53a1ad3","Type":"ContainerDied","Data":"26e189d1f3e95fd4c69ea90392c34bd1d248563cbcd5784f81910c5a012ac23e"}
Jul 22 03:45:54.863833 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.863179    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp" event={"ID":"2af25d44-3726-40ee-b50b-2185d53a1ad3","Type":"ContainerDied","Data":"fd2df9bccbeabf10ea984e354af68d21b43fac694e9d6a196917d3c8eb4851f8"}
Jul 22 03:45:54.863833 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.863201    2565 scope.go:117] "RemoveContainer" containerID="26e189d1f3e95fd4c69ea90392c34bd1d248563cbcd5784f81910c5a012ac23e"
Jul 22 03:45:54.875480 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.875463    2565 scope.go:117] "RemoveContainer" containerID="26e189d1f3e95fd4c69ea90392c34bd1d248563cbcd5784f81910c5a012ac23e"
Jul 22 03:45:54.875789 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:45:54.875767    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26e189d1f3e95fd4c69ea90392c34bd1d248563cbcd5784f81910c5a012ac23e\": container with ID starting with 26e189d1f3e95fd4c69ea90392c34bd1d248563cbcd5784f81910c5a012ac23e not found: ID does not exist" containerID="26e189d1f3e95fd4c69ea90392c34bd1d248563cbcd5784f81910c5a012ac23e"
Jul 22 03:45:54.875849 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.875799    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26e189d1f3e95fd4c69ea90392c34bd1d248563cbcd5784f81910c5a012ac23e"} err="failed to get container status \"26e189d1f3e95fd4c69ea90392c34bd1d248563cbcd5784f81910c5a012ac23e\": rpc error: code = NotFound desc = could not find container \"26e189d1f3e95fd4c69ea90392c34bd1d248563cbcd5784f81910c5a012ac23e\": container with ID starting with 26e189d1f3e95fd4c69ea90392c34bd1d248563cbcd5784f81910c5a012ac23e not found: ID does not exist"
Jul 22 03:45:54.886454 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.886427    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"]
Jul 22 03:45:54.889877 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:54.889853    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4c93e4-7bb766d5b6-nhbsp"]
Jul 22 03:45:55.243689 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:55.243657    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2af25d44-3726-40ee-b50b-2185d53a1ad3" path="/var/lib/kubelet/pods/2af25d44-3726-40ee-b50b-2185d53a1ad3/volumes"
Jul 22 03:45:55.243968 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:45:55.243954    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5492e81d-f9c9-4401-bd0f-a8f978b7b4d1" path="/var/lib/kubelet/pods/5492e81d-f9c9-4401-bd0f-a8f978b7b4d1/volumes"
Jul 22 03:46:09.275583 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.275531    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"]
Jul 22 03:46:09.276091 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.276072    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4de3a174-db02-460c-ad51-92e6363a2c55" containerName="maas-api"
Jul 22 03:46:09.276144 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.276094    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4de3a174-db02-460c-ad51-92e6363a2c55" containerName="maas-api"
Jul 22 03:46:09.276144 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.276111    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bf8a4d2-2805-45bf-a65e-362d49a3ba52" containerName="revoke-keys"
Jul 22 03:46:09.276144 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.276120    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bf8a4d2-2805-45bf-a65e-362d49a3ba52" containerName="revoke-keys"
Jul 22 03:46:09.276237 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.276146    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2af25d44-3726-40ee-b50b-2185d53a1ad3" containerName="maas-api"
Jul 22 03:46:09.276237 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.276155    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2af25d44-3726-40ee-b50b-2185d53a1ad3" containerName="maas-api"
Jul 22 03:46:09.276237 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.276234    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bf8a4d2-2805-45bf-a65e-362d49a3ba52" containerName="revoke-keys"
Jul 22 03:46:09.276331 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.276245    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4de3a174-db02-460c-ad51-92e6363a2c55" containerName="maas-api"
Jul 22 03:46:09.276331 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.276255    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2af25d44-3726-40ee-b50b-2185d53a1ad3" containerName="maas-api"
Jul 22 03:46:09.281064 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.281047    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"
Jul 22 03:46:09.283394 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.283370    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-7a2eef-serving-cert\""
Jul 22 03:46:09.288055 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.288027    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"]
Jul 22 03:46:09.428272 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.428231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9facde94-3e91-4d00-bdfa-e519c195df71-openshift-service-ca\") pod \"maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj\" (UID: \"9facde94-3e91-4d00-bdfa-e519c195df71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"
Jul 22 03:46:09.428458 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.428286    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9facde94-3e91-4d00-bdfa-e519c195df71-maas-api-tls\") pod \"maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj\" (UID: \"9facde94-3e91-4d00-bdfa-e519c195df71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"
Jul 22 03:46:09.428458 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.428314    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnrbz\" (UniqueName: \"kubernetes.io/projected/9facde94-3e91-4d00-bdfa-e519c195df71-kube-api-access-lnrbz\") pod \"maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj\" (UID: \"9facde94-3e91-4d00-bdfa-e519c195df71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"
Jul 22 03:46:09.529529 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.529435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9facde94-3e91-4d00-bdfa-e519c195df71-openshift-service-ca\") pod \"maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj\" (UID: \"9facde94-3e91-4d00-bdfa-e519c195df71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"
Jul 22 03:46:09.529529 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.529487    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9facde94-3e91-4d00-bdfa-e519c195df71-maas-api-tls\") pod \"maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj\" (UID: \"9facde94-3e91-4d00-bdfa-e519c195df71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"
Jul 22 03:46:09.529529 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.529506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnrbz\" (UniqueName: \"kubernetes.io/projected/9facde94-3e91-4d00-bdfa-e519c195df71-kube-api-access-lnrbz\") pod \"maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj\" (UID: \"9facde94-3e91-4d00-bdfa-e519c195df71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"
Jul 22 03:46:09.529786 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:46:09.529639    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-serving-cert: secret "maas-api-e2e-api-a-7a2eef-serving-cert" not found
Jul 22 03:46:09.529786 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:46:09.529715    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9facde94-3e91-4d00-bdfa-e519c195df71-maas-api-tls podName:9facde94-3e91-4d00-bdfa-e519c195df71 nodeName:}" failed. No retries permitted until 2026-07-22 03:46:10.029695301 +0000 UTC m=+2307.491245685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9facde94-3e91-4d00-bdfa-e519c195df71-maas-api-tls") pod "maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj" (UID: "9facde94-3e91-4d00-bdfa-e519c195df71") : secret "maas-api-e2e-api-a-7a2eef-serving-cert" not found
Jul 22 03:46:09.530128 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.530110    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9facde94-3e91-4d00-bdfa-e519c195df71-openshift-service-ca\") pod \"maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj\" (UID: \"9facde94-3e91-4d00-bdfa-e519c195df71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"
Jul 22 03:46:09.547024 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:09.546989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnrbz\" (UniqueName: \"kubernetes.io/projected/9facde94-3e91-4d00-bdfa-e519c195df71-kube-api-access-lnrbz\") pod \"maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj\" (UID: \"9facde94-3e91-4d00-bdfa-e519c195df71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"
Jul 22 03:46:10.034784 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:10.034742    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9facde94-3e91-4d00-bdfa-e519c195df71-maas-api-tls\") pod \"maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj\" (UID: \"9facde94-3e91-4d00-bdfa-e519c195df71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"
Jul 22 03:46:10.034976 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:46:10.034924    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-serving-cert: secret "maas-api-e2e-api-a-7a2eef-serving-cert" not found
Jul 22 03:46:10.035021 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:46:10.035003    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9facde94-3e91-4d00-bdfa-e519c195df71-maas-api-tls podName:9facde94-3e91-4d00-bdfa-e519c195df71 nodeName:}" failed. No retries permitted until 2026-07-22 03:46:11.034986052 +0000 UTC m=+2308.496536436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9facde94-3e91-4d00-bdfa-e519c195df71-maas-api-tls") pod "maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj" (UID: "9facde94-3e91-4d00-bdfa-e519c195df71") : secret "maas-api-e2e-api-a-7a2eef-serving-cert" not found
Jul 22 03:46:11.045268 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:11.045223    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9facde94-3e91-4d00-bdfa-e519c195df71-maas-api-tls\") pod \"maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj\" (UID: \"9facde94-3e91-4d00-bdfa-e519c195df71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"
Jul 22 03:46:11.047766 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:11.047744    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9facde94-3e91-4d00-bdfa-e519c195df71-maas-api-tls\") pod \"maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj\" (UID: \"9facde94-3e91-4d00-bdfa-e519c195df71\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"
Jul 22 03:46:11.094462 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:11.094424    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"
Jul 22 03:46:11.246181 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:11.246157    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"]
Jul 22 03:46:11.247305 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:46:11.247280    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9facde94_3e91_4d00_bdfa_e519c195df71.slice/crio-196d0b8103afe5dd728abe271c5bdf63d6347b08c597f9570be3b061af7149e3 WatchSource:0}: Error finding container 196d0b8103afe5dd728abe271c5bdf63d6347b08c597f9570be3b061af7149e3: Status 404 returned error can't find the container with id 196d0b8103afe5dd728abe271c5bdf63d6347b08c597f9570be3b061af7149e3
Jul 22 03:46:11.248681 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:11.248659    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:46:11.947657 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:11.947617    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj" event={"ID":"9facde94-3e91-4d00-bdfa-e519c195df71","Type":"ContainerStarted","Data":"c08aae0d1bb5c04f54f2be4b81d31a6eb63058c122f0222eaf07e4454ed37e00"}
Jul 22 03:46:11.947853 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:11.947680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj" event={"ID":"9facde94-3e91-4d00-bdfa-e519c195df71","Type":"ContainerStarted","Data":"196d0b8103afe5dd728abe271c5bdf63d6347b08c597f9570be3b061af7149e3"}
Jul 22 03:46:11.947853 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:11.947743    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"
Jul 22 03:46:11.968287 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:11.968234    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj" podStartSLOduration=2.407305785 podStartE2EDuration="2.968216644s" totalImagesPullingTime="560.910859ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:46:11.966635374 +0000 UTC m=+2309.428185780" watchObservedRunningTime="2026-07-22 03:46:11.968216644 +0000 UTC m=+2309.429767049"
Jul 22 03:46:17.490456 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:17.490421    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"]
Jul 22 03:46:17.493799 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:17.493783    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"
Jul 22 03:46:17.497110 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:17.497087    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-92a8f6-serving-cert\""
Jul 22 03:46:17.509928 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:17.509903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/322e64fa-de2e-4bc0-a06d-63129428b900-maas-api-tls\") pod \"maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s\" (UID: \"322e64fa-de2e-4bc0-a06d-63129428b900\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"
Jul 22 03:46:17.510065 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:17.509963    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/322e64fa-de2e-4bc0-a06d-63129428b900-openshift-service-ca\") pod \"maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s\" (UID: \"322e64fa-de2e-4bc0-a06d-63129428b900\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"
Jul 22 03:46:17.510065 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:17.510015    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks2ff\" (UniqueName: \"kubernetes.io/projected/322e64fa-de2e-4bc0-a06d-63129428b900-kube-api-access-ks2ff\") pod \"maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s\" (UID: \"322e64fa-de2e-4bc0-a06d-63129428b900\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"
Jul 22 03:46:17.514456 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:17.514427    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"]
Jul 22 03:46:17.610742 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:17.610703    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/322e64fa-de2e-4bc0-a06d-63129428b900-maas-api-tls\") pod \"maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s\" (UID: \"322e64fa-de2e-4bc0-a06d-63129428b900\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"
Jul 22 03:46:17.610943 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:17.610769    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/322e64fa-de2e-4bc0-a06d-63129428b900-openshift-service-ca\") pod \"maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s\" (UID: \"322e64fa-de2e-4bc0-a06d-63129428b900\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"
Jul 22 03:46:17.610943 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:17.610801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks2ff\" (UniqueName: \"kubernetes.io/projected/322e64fa-de2e-4bc0-a06d-63129428b900-kube-api-access-ks2ff\") pod \"maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s\" (UID: \"322e64fa-de2e-4bc0-a06d-63129428b900\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"
Jul 22 03:46:17.610943 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:46:17.610870    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-serving-cert: secret "maas-api-e2e-api-b-92a8f6-serving-cert" not found
Jul 22 03:46:17.610943 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:46:17.610939    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/322e64fa-de2e-4bc0-a06d-63129428b900-maas-api-tls podName:322e64fa-de2e-4bc0-a06d-63129428b900 nodeName:}" failed. No retries permitted until 2026-07-22 03:46:18.110920976 +0000 UTC m=+2315.572471363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/322e64fa-de2e-4bc0-a06d-63129428b900-maas-api-tls") pod "maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s" (UID: "322e64fa-de2e-4bc0-a06d-63129428b900") : secret "maas-api-e2e-api-b-92a8f6-serving-cert" not found
Jul 22 03:46:17.611673 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:17.611651    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/322e64fa-de2e-4bc0-a06d-63129428b900-openshift-service-ca\") pod \"maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s\" (UID: \"322e64fa-de2e-4bc0-a06d-63129428b900\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"
Jul 22 03:46:17.618871 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:17.618835    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks2ff\" (UniqueName: \"kubernetes.io/projected/322e64fa-de2e-4bc0-a06d-63129428b900-kube-api-access-ks2ff\") pod \"maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s\" (UID: \"322e64fa-de2e-4bc0-a06d-63129428b900\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"
Jul 22 03:46:17.957417 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:17.957388    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"
Jul 22 03:46:18.114316 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:18.114278    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/322e64fa-de2e-4bc0-a06d-63129428b900-maas-api-tls\") pod \"maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s\" (UID: \"322e64fa-de2e-4bc0-a06d-63129428b900\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"
Jul 22 03:46:18.117032 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:18.117006    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/322e64fa-de2e-4bc0-a06d-63129428b900-maas-api-tls\") pod \"maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s\" (UID: \"322e64fa-de2e-4bc0-a06d-63129428b900\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"
Jul 22 03:46:18.403963 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:18.403880    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"
Jul 22 03:46:18.553034 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:18.553005    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"]
Jul 22 03:46:18.555597 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:46:18.555549    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod322e64fa_de2e_4bc0_a06d_63129428b900.slice/crio-611d6fd075826f38be7862016f0cccc811630b9e04610bd3fbac849c7d9c50cc WatchSource:0}: Error finding container 611d6fd075826f38be7862016f0cccc811630b9e04610bd3fbac849c7d9c50cc: Status 404 returned error can't find the container with id 611d6fd075826f38be7862016f0cccc811630b9e04610bd3fbac849c7d9c50cc
Jul 22 03:46:18.979783 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:18.979754    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s" event={"ID":"322e64fa-de2e-4bc0-a06d-63129428b900","Type":"ContainerStarted","Data":"611d6fd075826f38be7862016f0cccc811630b9e04610bd3fbac849c7d9c50cc"}
Jul 22 03:46:19.985888 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:19.985849    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s" event={"ID":"322e64fa-de2e-4bc0-a06d-63129428b900","Type":"ContainerStarted","Data":"fe00def814facff077b1740cab8eefa2830c45bc1e6793e1100d5cba03bcb1f1"}
Jul 22 03:46:19.986339 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:19.985963    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"
Jul 22 03:46:20.003727 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:20.003677    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s" podStartSLOduration=2.590386037 podStartE2EDuration="3.003661343s" totalImagesPullingTime="413.275306ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:46:20.00198657 +0000 UTC m=+2317.463536975" watchObservedRunningTime="2026-07-22 03:46:20.003661343 +0000 UTC m=+2317.465211747"
Jul 22 03:46:25.997264 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:25.997228    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"
Jul 22 03:46:43.315422 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:43.315358    2565 scope.go:117] "RemoveContainer" containerID="4dc160512fe88e2a8fcac225cddf427ffe3cab1a398aa4fdf1004d08148d1692"
Jul 22 03:46:45.451186 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:45.451151    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"]
Jul 22 03:46:45.451679 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:45.451365    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj" podUID="9facde94-3e91-4d00-bdfa-e519c195df71" containerName="maas-api" containerID="cri-o://c08aae0d1bb5c04f54f2be4b81d31a6eb63058c122f0222eaf07e4454ed37e00" gracePeriod=30
Jul 22 03:46:45.703856 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:45.703804    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"
Jul 22 03:46:45.855637 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:45.855600    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9facde94-3e91-4d00-bdfa-e519c195df71-maas-api-tls\") pod \"9facde94-3e91-4d00-bdfa-e519c195df71\" (UID: \"9facde94-3e91-4d00-bdfa-e519c195df71\") "
Jul 22 03:46:45.855844 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:45.855697    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnrbz\" (UniqueName: \"kubernetes.io/projected/9facde94-3e91-4d00-bdfa-e519c195df71-kube-api-access-lnrbz\") pod \"9facde94-3e91-4d00-bdfa-e519c195df71\" (UID: \"9facde94-3e91-4d00-bdfa-e519c195df71\") "
Jul 22 03:46:45.855844 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:45.855796    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9facde94-3e91-4d00-bdfa-e519c195df71-openshift-service-ca\") pod \"9facde94-3e91-4d00-bdfa-e519c195df71\" (UID: \"9facde94-3e91-4d00-bdfa-e519c195df71\") "
Jul 22 03:46:45.856166 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:45.856141    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9facde94-3e91-4d00-bdfa-e519c195df71-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9facde94-3e91-4d00-bdfa-e519c195df71" (UID: "9facde94-3e91-4d00-bdfa-e519c195df71"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:46:45.857727 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:45.857702    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9facde94-3e91-4d00-bdfa-e519c195df71-kube-api-access-lnrbz" (OuterVolumeSpecName: "kube-api-access-lnrbz") pod "9facde94-3e91-4d00-bdfa-e519c195df71" (UID: "9facde94-3e91-4d00-bdfa-e519c195df71"). InnerVolumeSpecName "kube-api-access-lnrbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:46:45.857805 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:45.857729    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9facde94-3e91-4d00-bdfa-e519c195df71-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9facde94-3e91-4d00-bdfa-e519c195df71" (UID: "9facde94-3e91-4d00-bdfa-e519c195df71"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:46:45.957337 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:45.957251    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnrbz\" (UniqueName: \"kubernetes.io/projected/9facde94-3e91-4d00-bdfa-e519c195df71-kube-api-access-lnrbz\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:46:45.957337 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:45.957281    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9facde94-3e91-4d00-bdfa-e519c195df71-openshift-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:46:45.957337 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:45.957291    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9facde94-3e91-4d00-bdfa-e519c195df71-maas-api-tls\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:46:46.122664 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:46.122629    2565 generic.go:356] "Generic (PLEG): container finished" podID="9facde94-3e91-4d00-bdfa-e519c195df71" containerID="c08aae0d1bb5c04f54f2be4b81d31a6eb63058c122f0222eaf07e4454ed37e00" exitCode=0
Jul 22 03:46:46.122839 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:46.122685    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"
Jul 22 03:46:46.122839 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:46.122718    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj" event={"ID":"9facde94-3e91-4d00-bdfa-e519c195df71","Type":"ContainerDied","Data":"c08aae0d1bb5c04f54f2be4b81d31a6eb63058c122f0222eaf07e4454ed37e00"}
Jul 22 03:46:46.122839 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:46.122776    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj" event={"ID":"9facde94-3e91-4d00-bdfa-e519c195df71","Type":"ContainerDied","Data":"196d0b8103afe5dd728abe271c5bdf63d6347b08c597f9570be3b061af7149e3"}
Jul 22 03:46:46.122839 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:46.122801    2565 scope.go:117] "RemoveContainer" containerID="c08aae0d1bb5c04f54f2be4b81d31a6eb63058c122f0222eaf07e4454ed37e00"
Jul 22 03:46:46.131905 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:46.131886    2565 scope.go:117] "RemoveContainer" containerID="c08aae0d1bb5c04f54f2be4b81d31a6eb63058c122f0222eaf07e4454ed37e00"
Jul 22 03:46:46.132226 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:46:46.132207    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c08aae0d1bb5c04f54f2be4b81d31a6eb63058c122f0222eaf07e4454ed37e00\": container with ID starting with c08aae0d1bb5c04f54f2be4b81d31a6eb63058c122f0222eaf07e4454ed37e00 not found: ID does not exist" containerID="c08aae0d1bb5c04f54f2be4b81d31a6eb63058c122f0222eaf07e4454ed37e00"
Jul 22 03:46:46.132275 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:46.132238    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c08aae0d1bb5c04f54f2be4b81d31a6eb63058c122f0222eaf07e4454ed37e00"} err="failed to get container status \"c08aae0d1bb5c04f54f2be4b81d31a6eb63058c122f0222eaf07e4454ed37e00\": rpc error: code = NotFound desc = could not find container \"c08aae0d1bb5c04f54f2be4b81d31a6eb63058c122f0222eaf07e4454ed37e00\": container with ID starting with c08aae0d1bb5c04f54f2be4b81d31a6eb63058c122f0222eaf07e4454ed37e00 not found: ID does not exist"
Jul 22 03:46:46.143601 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:46.143551    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"]
Jul 22 03:46:46.147236 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:46.147208    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7a2eef-7fb766b4d6-5c2gj"]
Jul 22 03:46:47.243474 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:47.243436    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9facde94-3e91-4d00-bdfa-e519c195df71" path="/var/lib/kubelet/pods/9facde94-3e91-4d00-bdfa-e519c195df71/volumes"
Jul 22 03:46:56.483288 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:56.483247    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92a8f6-bqhcs"]
Jul 22 03:46:56.483814 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:56.483774    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9facde94-3e91-4d00-bdfa-e519c195df71" containerName="maas-api"
Jul 22 03:46:56.483814 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:56.483795    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9facde94-3e91-4d00-bdfa-e519c195df71" containerName="maas-api"
Jul 22 03:46:56.483938 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:56.483916    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9facde94-3e91-4d00-bdfa-e519c195df71" containerName="maas-api"
Jul 22 03:46:56.486870 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:56.486847    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92a8f6-bqhcs"
Jul 22 03:46:56.489464 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:56.489441    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xvl7w\""
Jul 22 03:46:56.494819 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:56.494791    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92a8f6-bqhcs"]
Jul 22 03:46:56.646460 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:56.646415    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/291ad213-8ecc-4502-9a34-5317aadf3189-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-92a8f6-bqhcs\" (UID: \"291ad213-8ecc-4502-9a34-5317aadf3189\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92a8f6-bqhcs"
Jul 22 03:46:56.746972 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:56.746875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/291ad213-8ecc-4502-9a34-5317aadf3189-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-92a8f6-bqhcs\" (UID: \"291ad213-8ecc-4502-9a34-5317aadf3189\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92a8f6-bqhcs"
Jul 22 03:46:56.747521 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:56.747502    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/291ad213-8ecc-4502-9a34-5317aadf3189-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-92a8f6-bqhcs\" (UID: \"291ad213-8ecc-4502-9a34-5317aadf3189\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92a8f6-bqhcs"
Jul 22 03:46:56.798764 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:56.798725    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92a8f6-bqhcs"
Jul 22 03:46:56.936731 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:56.936704    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92a8f6-bqhcs"]
Jul 22 03:46:56.938609 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:46:56.938578    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod291ad213_8ecc_4502_9a34_5317aadf3189.slice/crio-1cb16f3d2b3442b5927d3d0ee1d838a3aa86711ce2957744a32f6f701478b886 WatchSource:0}: Error finding container 1cb16f3d2b3442b5927d3d0ee1d838a3aa86711ce2957744a32f6f701478b886: Status 404 returned error can't find the container with id 1cb16f3d2b3442b5927d3d0ee1d838a3aa86711ce2957744a32f6f701478b886
Jul 22 03:46:57.181784 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:57.181747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92a8f6-bqhcs" event={"ID":"291ad213-8ecc-4502-9a34-5317aadf3189","Type":"ContainerStarted","Data":"1cb16f3d2b3442b5927d3d0ee1d838a3aa86711ce2957744a32f6f701478b886"}
Jul 22 03:46:58.187169 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:58.187135    2565 generic.go:356] "Generic (PLEG): container finished" podID="291ad213-8ecc-4502-9a34-5317aadf3189" containerID="6d98e4855efd5506071b3012e293f5e34689fc94e8945446a7714c7f48dff2a7" exitCode=0
Jul 22 03:46:58.187584 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:58.187220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92a8f6-bqhcs" event={"ID":"291ad213-8ecc-4502-9a34-5317aadf3189","Type":"ContainerDied","Data":"6d98e4855efd5506071b3012e293f5e34689fc94e8945446a7714c7f48dff2a7"}
Jul 22 03:46:59.329468 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:59.329434    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92a8f6-bqhcs"
Jul 22 03:46:59.475037 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:59.474918    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/291ad213-8ecc-4502-9a34-5317aadf3189-maas-api-service-ca\") pod \"291ad213-8ecc-4502-9a34-5317aadf3189\" (UID: \"291ad213-8ecc-4502-9a34-5317aadf3189\") "
Jul 22 03:46:59.475354 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:59.475326    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/291ad213-8ecc-4502-9a34-5317aadf3189-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "291ad213-8ecc-4502-9a34-5317aadf3189" (UID: "291ad213-8ecc-4502-9a34-5317aadf3189"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:46:59.576449 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:46:59.576412    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/291ad213-8ecc-4502-9a34-5317aadf3189-maas-api-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:47:00.203697 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:00.203662    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92a8f6-bqhcs"
Jul 22 03:47:00.203891 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:00.203664    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92a8f6-bqhcs" event={"ID":"291ad213-8ecc-4502-9a34-5317aadf3189","Type":"ContainerDied","Data":"1cb16f3d2b3442b5927d3d0ee1d838a3aa86711ce2957744a32f6f701478b886"}
Jul 22 03:47:00.203891 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:00.203783    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1cb16f3d2b3442b5927d3d0ee1d838a3aa86711ce2957744a32f6f701478b886"
Jul 22 03:47:11.965263 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:11.965226    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"]
Jul 22 03:47:11.965724 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:11.965446    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s" podUID="322e64fa-de2e-4bc0-a06d-63129428b900" containerName="maas-api" containerID="cri-o://fe00def814facff077b1740cab8eefa2830c45bc1e6793e1100d5cba03bcb1f1" gracePeriod=30
Jul 22 03:47:12.212437 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.212409    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"
Jul 22 03:47:12.259853 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.259758    2565 generic.go:356] "Generic (PLEG): container finished" podID="322e64fa-de2e-4bc0-a06d-63129428b900" containerID="fe00def814facff077b1740cab8eefa2830c45bc1e6793e1100d5cba03bcb1f1" exitCode=0
Jul 22 03:47:12.259853 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.259816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s" event={"ID":"322e64fa-de2e-4bc0-a06d-63129428b900","Type":"ContainerDied","Data":"fe00def814facff077b1740cab8eefa2830c45bc1e6793e1100d5cba03bcb1f1"}
Jul 22 03:47:12.259853 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.259828    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"
Jul 22 03:47:12.260094 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.259872    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s" event={"ID":"322e64fa-de2e-4bc0-a06d-63129428b900","Type":"ContainerDied","Data":"611d6fd075826f38be7862016f0cccc811630b9e04610bd3fbac849c7d9c50cc"}
Jul 22 03:47:12.260094 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.259901    2565 scope.go:117] "RemoveContainer" containerID="fe00def814facff077b1740cab8eefa2830c45bc1e6793e1100d5cba03bcb1f1"
Jul 22 03:47:12.269153 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.269131    2565 scope.go:117] "RemoveContainer" containerID="fe00def814facff077b1740cab8eefa2830c45bc1e6793e1100d5cba03bcb1f1"
Jul 22 03:47:12.269521 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:47:12.269498    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe00def814facff077b1740cab8eefa2830c45bc1e6793e1100d5cba03bcb1f1\": container with ID starting with fe00def814facff077b1740cab8eefa2830c45bc1e6793e1100d5cba03bcb1f1 not found: ID does not exist" containerID="fe00def814facff077b1740cab8eefa2830c45bc1e6793e1100d5cba03bcb1f1"
Jul 22 03:47:12.269620 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.269531    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe00def814facff077b1740cab8eefa2830c45bc1e6793e1100d5cba03bcb1f1"} err="failed to get container status \"fe00def814facff077b1740cab8eefa2830c45bc1e6793e1100d5cba03bcb1f1\": rpc error: code = NotFound desc = could not find container \"fe00def814facff077b1740cab8eefa2830c45bc1e6793e1100d5cba03bcb1f1\": container with ID starting with fe00def814facff077b1740cab8eefa2830c45bc1e6793e1100d5cba03bcb1f1 not found: ID does not exist"
Jul 22 03:47:12.294017 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.293980    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/322e64fa-de2e-4bc0-a06d-63129428b900-openshift-service-ca\") pod \"322e64fa-de2e-4bc0-a06d-63129428b900\" (UID: \"322e64fa-de2e-4bc0-a06d-63129428b900\") "
Jul 22 03:47:12.294227 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.294068    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/322e64fa-de2e-4bc0-a06d-63129428b900-maas-api-tls\") pod \"322e64fa-de2e-4bc0-a06d-63129428b900\" (UID: \"322e64fa-de2e-4bc0-a06d-63129428b900\") "
Jul 22 03:47:12.294227 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.294104    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ks2ff\" (UniqueName: \"kubernetes.io/projected/322e64fa-de2e-4bc0-a06d-63129428b900-kube-api-access-ks2ff\") pod \"322e64fa-de2e-4bc0-a06d-63129428b900\" (UID: \"322e64fa-de2e-4bc0-a06d-63129428b900\") "
Jul 22 03:47:12.294369 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.294343    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/322e64fa-de2e-4bc0-a06d-63129428b900-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "322e64fa-de2e-4bc0-a06d-63129428b900" (UID: "322e64fa-de2e-4bc0-a06d-63129428b900"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:47:12.294452 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.294435    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/322e64fa-de2e-4bc0-a06d-63129428b900-openshift-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:47:12.296224 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.296197    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/322e64fa-de2e-4bc0-a06d-63129428b900-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "322e64fa-de2e-4bc0-a06d-63129428b900" (UID: "322e64fa-de2e-4bc0-a06d-63129428b900"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:47:12.296358 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.296335    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/322e64fa-de2e-4bc0-a06d-63129428b900-kube-api-access-ks2ff" (OuterVolumeSpecName: "kube-api-access-ks2ff") pod "322e64fa-de2e-4bc0-a06d-63129428b900" (UID: "322e64fa-de2e-4bc0-a06d-63129428b900"). InnerVolumeSpecName "kube-api-access-ks2ff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:47:12.395069 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.395018    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/322e64fa-de2e-4bc0-a06d-63129428b900-maas-api-tls\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:47:12.395069 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.395052    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ks2ff\" (UniqueName: \"kubernetes.io/projected/322e64fa-de2e-4bc0-a06d-63129428b900-kube-api-access-ks2ff\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:47:12.586683 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.586643    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"]
Jul 22 03:47:12.589618 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:12.589589    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-92a8f6-6d546b7497-9tz6s"]
Jul 22 03:47:13.243750 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:13.243715    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="322e64fa-de2e-4bc0-a06d-63129428b900" path="/var/lib/kubelet/pods/322e64fa-de2e-4bc0-a06d-63129428b900/volumes"
Jul 22 03:47:16.570041 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:16.570001    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92a8f6-bqhcs"]
Jul 22 03:47:16.575990 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:16.575960    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-92a8f6-bqhcs"]
Jul 22 03:47:17.244326 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:17.244288    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="291ad213-8ecc-4502-9a34-5317aadf3189" path="/var/lib/kubelet/pods/291ad213-8ecc-4502-9a34-5317aadf3189/volumes"
Jul 22 03:47:26.817855 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:26.817821    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"]
Jul 22 03:47:26.818285 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:26.818202    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="322e64fa-de2e-4bc0-a06d-63129428b900" containerName="maas-api"
Jul 22 03:47:26.818285 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:26.818215    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="322e64fa-de2e-4bc0-a06d-63129428b900" containerName="maas-api"
Jul 22 03:47:26.818285 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:26.818227    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="291ad213-8ecc-4502-9a34-5317aadf3189" containerName="revoke-keys"
Jul 22 03:47:26.818285 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:26.818233    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="291ad213-8ecc-4502-9a34-5317aadf3189" containerName="revoke-keys"
Jul 22 03:47:26.818421 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:26.818308    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="322e64fa-de2e-4bc0-a06d-63129428b900" containerName="maas-api"
Jul 22 03:47:26.818421 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:26.818316    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="291ad213-8ecc-4502-9a34-5317aadf3189" containerName="revoke-keys"
Jul 22 03:47:26.821181 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:26.821162    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"
Jul 22 03:47:26.825883 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:26.825853    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-c713ac-serving-cert\""
Jul 22 03:47:26.839281 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:26.839248    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"]
Jul 22 03:47:26.922707 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:26.922667    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ee16d10-0290-4281-b98a-25f1ce803b34-maas-api-tls\") pod \"maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn\" (UID: \"3ee16d10-0290-4281-b98a-25f1ce803b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"
Jul 22 03:47:26.923195 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:26.922722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kh67\" (UniqueName: \"kubernetes.io/projected/3ee16d10-0290-4281-b98a-25f1ce803b34-kube-api-access-9kh67\") pod \"maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn\" (UID: \"3ee16d10-0290-4281-b98a-25f1ce803b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"
Jul 22 03:47:26.923195 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:26.922801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ee16d10-0290-4281-b98a-25f1ce803b34-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn\" (UID: \"3ee16d10-0290-4281-b98a-25f1ce803b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"
Jul 22 03:47:27.024240 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:27.024198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ee16d10-0290-4281-b98a-25f1ce803b34-maas-api-tls\") pod \"maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn\" (UID: \"3ee16d10-0290-4281-b98a-25f1ce803b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"
Jul 22 03:47:27.024466 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:27.024262    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kh67\" (UniqueName: \"kubernetes.io/projected/3ee16d10-0290-4281-b98a-25f1ce803b34-kube-api-access-9kh67\") pod \"maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn\" (UID: \"3ee16d10-0290-4281-b98a-25f1ce803b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"
Jul 22 03:47:27.024466 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:27.024287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ee16d10-0290-4281-b98a-25f1ce803b34-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn\" (UID: \"3ee16d10-0290-4281-b98a-25f1ce803b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"
Jul 22 03:47:27.024969 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:27.024949    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ee16d10-0290-4281-b98a-25f1ce803b34-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn\" (UID: \"3ee16d10-0290-4281-b98a-25f1ce803b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"
Jul 22 03:47:27.026712 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:27.026694    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ee16d10-0290-4281-b98a-25f1ce803b34-maas-api-tls\") pod \"maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn\" (UID: \"3ee16d10-0290-4281-b98a-25f1ce803b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"
Jul 22 03:47:27.038618 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:27.038591    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kh67\" (UniqueName: \"kubernetes.io/projected/3ee16d10-0290-4281-b98a-25f1ce803b34-kube-api-access-9kh67\") pod \"maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn\" (UID: \"3ee16d10-0290-4281-b98a-25f1ce803b34\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"
Jul 22 03:47:27.131866 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:27.131760    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"
Jul 22 03:47:27.272913 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:27.272891    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"]
Jul 22 03:47:27.275373 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:47:27.275342    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ee16d10_0290_4281_b98a_25f1ce803b34.slice/crio-a05cdf223923c299345b3ab0ac5c19ff12401acfb836ea2837532367b3dbb140 WatchSource:0}: Error finding container a05cdf223923c299345b3ab0ac5c19ff12401acfb836ea2837532367b3dbb140: Status 404 returned error can't find the container with id a05cdf223923c299345b3ab0ac5c19ff12401acfb836ea2837532367b3dbb140
Jul 22 03:47:27.332391 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:27.332352    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn" event={"ID":"3ee16d10-0290-4281-b98a-25f1ce803b34","Type":"ContainerStarted","Data":"a05cdf223923c299345b3ab0ac5c19ff12401acfb836ea2837532367b3dbb140"}
Jul 22 03:47:28.338955 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:28.338919    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn" event={"ID":"3ee16d10-0290-4281-b98a-25f1ce803b34","Type":"ContainerStarted","Data":"26c0b242e6903c9fd0832cf6a4c7233a101f77421cec3bf517c41451af5d35ec"}
Jul 22 03:47:28.339440 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:28.338980    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"
Jul 22 03:47:28.356164 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:28.356106    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn" podStartSLOduration=1.872065737 podStartE2EDuration="2.356087631s" totalImagesPullingTime="484.021894ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:47:28.354409807 +0000 UTC m=+2385.815960226" watchObservedRunningTime="2026-07-22 03:47:28.356087631 +0000 UTC m=+2385.817638036"
Jul 22 03:47:34.348280 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:34.348248    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"
Jul 22 03:47:34.946719 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:34.946675    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"]
Jul 22 03:47:34.950299 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:34.950277    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"
Jul 22 03:47:34.953008 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:34.952970    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-be39c1-serving-cert\""
Jul 22 03:47:34.962131 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:34.962099    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"]
Jul 22 03:47:35.098863 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:35.098824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4\" (UID: \"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"
Jul 22 03:47:35.099072 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:35.098915    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-maas-api-tls\") pod \"maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4\" (UID: \"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"
Jul 22 03:47:35.099072 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:35.098938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vzct\" (UniqueName: \"kubernetes.io/projected/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-kube-api-access-9vzct\") pod \"maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4\" (UID: \"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"
Jul 22 03:47:35.199493 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:35.199394    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-maas-api-tls\") pod \"maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4\" (UID: \"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"
Jul 22 03:47:35.199493 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:35.199438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vzct\" (UniqueName: \"kubernetes.io/projected/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-kube-api-access-9vzct\") pod \"maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4\" (UID: \"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"
Jul 22 03:47:35.199493 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:35.199473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4\" (UID: \"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"
Jul 22 03:47:35.199844 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:47:35.199595    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-serving-cert: secret "maas-api-e2e-shared-b-be39c1-serving-cert" not found
Jul 22 03:47:35.199844 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:47:35.199673    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-maas-api-tls podName:56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1 nodeName:}" failed. No retries permitted until 2026-07-22 03:47:35.699649829 +0000 UTC m=+2393.161200216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-maas-api-tls") pod "maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4" (UID: "56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1") : secret "maas-api-e2e-shared-b-be39c1-serving-cert" not found
Jul 22 03:47:35.200092 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:35.200074    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4\" (UID: \"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"
Jul 22 03:47:35.209740 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:35.209711    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vzct\" (UniqueName: \"kubernetes.io/projected/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-kube-api-access-9vzct\") pod \"maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4\" (UID: \"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"
Jul 22 03:47:35.705206 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:35.705156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-maas-api-tls\") pod \"maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4\" (UID: \"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"
Jul 22 03:47:35.707797 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:35.707768    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-maas-api-tls\") pod \"maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4\" (UID: \"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"
Jul 22 03:47:35.861825 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:35.861780    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"
Jul 22 03:47:36.004673 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:36.004569    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"]
Jul 22 03:47:36.007303 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:47:36.007275    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d789ac_dded_4ee6_a0d0_ecaef4a7c0e1.slice/crio-3df48b223d0c31bb77edf80263c37b8f9263c083e2771ff71b2bd4b70d1ff65e WatchSource:0}: Error finding container 3df48b223d0c31bb77edf80263c37b8f9263c083e2771ff71b2bd4b70d1ff65e: Status 404 returned error can't find the container with id 3df48b223d0c31bb77edf80263c37b8f9263c083e2771ff71b2bd4b70d1ff65e
Jul 22 03:47:36.382961 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:36.382933    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4" event={"ID":"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1","Type":"ContainerStarted","Data":"3df48b223d0c31bb77edf80263c37b8f9263c083e2771ff71b2bd4b70d1ff65e"}
Jul 22 03:47:37.388801 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:37.388761    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4" event={"ID":"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1","Type":"ContainerStarted","Data":"502548625e8fabd07e5dba65ef765ec5ae4a63644d71bbf902b4057077c83828"}
Jul 22 03:47:37.389212 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:37.388892    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"
Jul 22 03:47:37.410329 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:37.410272    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4" podStartSLOduration=3.099411136 podStartE2EDuration="3.410254637s" totalImagesPullingTime="310.843501ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:47:37.408866963 +0000 UTC m=+2394.870417368" watchObservedRunningTime="2026-07-22 03:47:37.410254637 +0000 UTC m=+2394.871805043"
Jul 22 03:47:43.338870 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:43.338834    2565 scope.go:117] "RemoveContainer" containerID="a7748e227a45d031322c6724d39de19487825e03402e26ff5a93159b06951e3e"
Jul 22 03:47:43.399579 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:47:43.399539    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"
Jul 22 03:51:43.388544 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:51:43.388511    2565 scope.go:117] "RemoveContainer" containerID="923e9b96655d330194a4df09c58d908a90b9eb2920067bf45b8af8fafe0f23c7"
Jul 22 03:51:43.396368 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:51:43.396350    2565 scope.go:117] "RemoveContainer" containerID="6a9a313fecddf6355cc61cc5ffb443f78ea460eb2e2813c0c450da536caaf711"
Jul 22 03:51:43.403536 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:51:43.403519    2565 scope.go:117] "RemoveContainer" containerID="9a2aa1f881b581f75274e94b937b501974fb6ade372803720c9439b1fe6ad012"
Jul 22 03:53:43.435713 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:43.435683    2565 scope.go:117] "RemoveContainer" containerID="6d98e4855efd5506071b3012e293f5e34689fc94e8945446a7714c7f48dff2a7"
Jul 22 03:53:54.623057 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:54.623023    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"]
Jul 22 03:53:54.623484 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:54.623241    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn" podUID="3ee16d10-0290-4281-b98a-25f1ce803b34" containerName="maas-api" containerID="cri-o://26c0b242e6903c9fd0832cf6a4c7233a101f77421cec3bf517c41451af5d35ec" gracePeriod=30
Jul 22 03:53:54.865437 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:54.865411    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"
Jul 22 03:53:54.954255 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:54.954224    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ee16d10-0290-4281-b98a-25f1ce803b34-maas-api-tls\") pod \"3ee16d10-0290-4281-b98a-25f1ce803b34\" (UID: \"3ee16d10-0290-4281-b98a-25f1ce803b34\") "
Jul 22 03:53:54.954402 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:54.954284    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kh67\" (UniqueName: \"kubernetes.io/projected/3ee16d10-0290-4281-b98a-25f1ce803b34-kube-api-access-9kh67\") pod \"3ee16d10-0290-4281-b98a-25f1ce803b34\" (UID: \"3ee16d10-0290-4281-b98a-25f1ce803b34\") "
Jul 22 03:53:54.954402 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:54.954320    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ee16d10-0290-4281-b98a-25f1ce803b34-openshift-service-ca\") pod \"3ee16d10-0290-4281-b98a-25f1ce803b34\" (UID: \"3ee16d10-0290-4281-b98a-25f1ce803b34\") "
Jul 22 03:53:54.954755 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:54.954732    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ee16d10-0290-4281-b98a-25f1ce803b34-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3ee16d10-0290-4281-b98a-25f1ce803b34" (UID: "3ee16d10-0290-4281-b98a-25f1ce803b34"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:53:54.956235 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:54.956214    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ee16d10-0290-4281-b98a-25f1ce803b34-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3ee16d10-0290-4281-b98a-25f1ce803b34" (UID: "3ee16d10-0290-4281-b98a-25f1ce803b34"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:53:54.956334 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:54.956315    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ee16d10-0290-4281-b98a-25f1ce803b34-kube-api-access-9kh67" (OuterVolumeSpecName: "kube-api-access-9kh67") pod "3ee16d10-0290-4281-b98a-25f1ce803b34" (UID: "3ee16d10-0290-4281-b98a-25f1ce803b34"). InnerVolumeSpecName "kube-api-access-9kh67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:53:55.055708 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:55.055674    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ee16d10-0290-4281-b98a-25f1ce803b34-maas-api-tls\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:53:55.055708 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:55.055704    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kh67\" (UniqueName: \"kubernetes.io/projected/3ee16d10-0290-4281-b98a-25f1ce803b34-kube-api-access-9kh67\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:53:55.055708 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:55.055713    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ee16d10-0290-4281-b98a-25f1ce803b34-openshift-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:53:55.098517 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:55.098487    2565 generic.go:356] "Generic (PLEG): container finished" podID="3ee16d10-0290-4281-b98a-25f1ce803b34" containerID="26c0b242e6903c9fd0832cf6a4c7233a101f77421cec3bf517c41451af5d35ec" exitCode=0
Jul 22 03:53:55.098672 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:55.098535    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"
Jul 22 03:53:55.098672 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:55.098578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn" event={"ID":"3ee16d10-0290-4281-b98a-25f1ce803b34","Type":"ContainerDied","Data":"26c0b242e6903c9fd0832cf6a4c7233a101f77421cec3bf517c41451af5d35ec"}
Jul 22 03:53:55.098672 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:55.098623    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn" event={"ID":"3ee16d10-0290-4281-b98a-25f1ce803b34","Type":"ContainerDied","Data":"a05cdf223923c299345b3ab0ac5c19ff12401acfb836ea2837532367b3dbb140"}
Jul 22 03:53:55.098672 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:55.098645    2565 scope.go:117] "RemoveContainer" containerID="26c0b242e6903c9fd0832cf6a4c7233a101f77421cec3bf517c41451af5d35ec"
Jul 22 03:53:55.107162 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:55.107146    2565 scope.go:117] "RemoveContainer" containerID="26c0b242e6903c9fd0832cf6a4c7233a101f77421cec3bf517c41451af5d35ec"
Jul 22 03:53:55.107430 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:53:55.107403    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26c0b242e6903c9fd0832cf6a4c7233a101f77421cec3bf517c41451af5d35ec\": container with ID starting with 26c0b242e6903c9fd0832cf6a4c7233a101f77421cec3bf517c41451af5d35ec not found: ID does not exist" containerID="26c0b242e6903c9fd0832cf6a4c7233a101f77421cec3bf517c41451af5d35ec"
Jul 22 03:53:55.107497 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:55.107429    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26c0b242e6903c9fd0832cf6a4c7233a101f77421cec3bf517c41451af5d35ec"} err="failed to get container status \"26c0b242e6903c9fd0832cf6a4c7233a101f77421cec3bf517c41451af5d35ec\": rpc error: code = NotFound desc = could not find container \"26c0b242e6903c9fd0832cf6a4c7233a101f77421cec3bf517c41451af5d35ec\": container with ID starting with 26c0b242e6903c9fd0832cf6a4c7233a101f77421cec3bf517c41451af5d35ec not found: ID does not exist"
Jul 22 03:53:55.122071 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:55.122046    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"]
Jul 22 03:53:55.129672 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:55.129647    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c713ac-5c66bd8b75-xvgzn"]
Jul 22 03:53:55.244058 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:53:55.243987    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ee16d10-0290-4281-b98a-25f1ce803b34" path="/var/lib/kubelet/pods/3ee16d10-0290-4281-b98a-25f1ce803b34/volumes"
Jul 22 03:54:16.660803 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:16.660719    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"]
Jul 22 03:54:16.661340 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:16.660991    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4" podUID="56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1" containerName="maas-api" containerID="cri-o://502548625e8fabd07e5dba65ef765ec5ae4a63644d71bbf902b4057077c83828" gracePeriod=30
Jul 22 03:54:16.906589 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:16.906542    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"
Jul 22 03:54:16.944941 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:16.944915    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-openshift-service-ca\") pod \"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1\" (UID: \"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1\") "
Jul 22 03:54:16.945128 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:16.944961    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-maas-api-tls\") pod \"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1\" (UID: \"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1\") "
Jul 22 03:54:16.945128 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:16.945027    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vzct\" (UniqueName: \"kubernetes.io/projected/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-kube-api-access-9vzct\") pod \"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1\" (UID: \"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1\") "
Jul 22 03:54:16.945288 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:16.945265    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1" (UID: "56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:54:16.947063 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:16.947036    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1" (UID: "56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:54:16.947192 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:16.947171    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-kube-api-access-9vzct" (OuterVolumeSpecName: "kube-api-access-9vzct") pod "56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1" (UID: "56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1"). InnerVolumeSpecName "kube-api-access-9vzct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:54:17.046011 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:17.045979    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vzct\" (UniqueName: \"kubernetes.io/projected/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-kube-api-access-9vzct\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:54:17.046011 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:17.046005    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-openshift-service-ca\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:54:17.046011 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:17.046016    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1-maas-api-tls\") on node \"ip-10-0-128-205.ec2.internal\" DevicePath \"\""
Jul 22 03:54:17.192108 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:17.192075    2565 generic.go:356] "Generic (PLEG): container finished" podID="56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1" containerID="502548625e8fabd07e5dba65ef765ec5ae4a63644d71bbf902b4057077c83828" exitCode=0
Jul 22 03:54:17.192276 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:17.192127    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"
Jul 22 03:54:17.192276 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:17.192161    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4" event={"ID":"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1","Type":"ContainerDied","Data":"502548625e8fabd07e5dba65ef765ec5ae4a63644d71bbf902b4057077c83828"}
Jul 22 03:54:17.192276 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:17.192214    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4" event={"ID":"56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1","Type":"ContainerDied","Data":"3df48b223d0c31bb77edf80263c37b8f9263c083e2771ff71b2bd4b70d1ff65e"}
Jul 22 03:54:17.192276 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:17.192236    2565 scope.go:117] "RemoveContainer" containerID="502548625e8fabd07e5dba65ef765ec5ae4a63644d71bbf902b4057077c83828"
Jul 22 03:54:17.201360 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:17.201338    2565 scope.go:117] "RemoveContainer" containerID="502548625e8fabd07e5dba65ef765ec5ae4a63644d71bbf902b4057077c83828"
Jul 22 03:54:17.201621 ip-10-0-128-205 kubenswrapper[2565]: E0722 03:54:17.201602    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"502548625e8fabd07e5dba65ef765ec5ae4a63644d71bbf902b4057077c83828\": container with ID starting with 502548625e8fabd07e5dba65ef765ec5ae4a63644d71bbf902b4057077c83828 not found: ID does not exist" containerID="502548625e8fabd07e5dba65ef765ec5ae4a63644d71bbf902b4057077c83828"
Jul 22 03:54:17.201687 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:17.201629    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"502548625e8fabd07e5dba65ef765ec5ae4a63644d71bbf902b4057077c83828"} err="failed to get container status \"502548625e8fabd07e5dba65ef765ec5ae4a63644d71bbf902b4057077c83828\": rpc error: code = NotFound desc = could not find container \"502548625e8fabd07e5dba65ef765ec5ae4a63644d71bbf902b4057077c83828\": container with ID starting with 502548625e8fabd07e5dba65ef765ec5ae4a63644d71bbf902b4057077c83828 not found: ID does not exist"
Jul 22 03:54:17.213538 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:17.213514    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"]
Jul 22 03:54:17.215870 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:17.215850    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-be39c1-7f8d4d67cf-t7zq4"]
Jul 22 03:54:17.244218 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:17.244189    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1" path="/var/lib/kubelet/pods/56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1/volumes"
Jul 22 03:54:34.129986 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:34.129958    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c66fb4cb9-h7rs8_09a07d8e-7b24-4ac6-b7d4-51a6d1f5a484/manager/0.log"
Jul 22 03:54:34.723095 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:34.723061    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fb7f869bf-lfm7s_bc303a86-6296-4500-9684-e7d04e218390/copy-manifests/0.log"
Jul 22 03:54:34.735987 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:34.735965    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fb7f869bf-lfm7s_bc303a86-6296-4500-9684-e7d04e218390/manager/0.log"
Jul 22 03:54:35.075302 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:35.075225    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-67964b4c9-xqj56_d8ef4cfe-2175-4a5a-8e67-ef1bd3756903/maas-api/0.log"
Jul 22 03:54:35.183241 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:35.183213    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744850-ss9fr_3afa2802-9a87-4da9-a747-e5009c47597c/cleanup/0.log"
Jul 22 03:54:35.292681 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:35.292659    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744865-gpn2x_1a1bb828-cc45-4b4b-a751-3444e185b625/cleanup/0.log"
Jul 22 03:54:35.406605 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:35.406510    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-l99wf_333a9c13-1025-4ced-bc1a-a7079dd4fd21/postgres/0.log"
Jul 22 03:54:37.930091 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:37.930060    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-g7q49_de4725a9-b593-4a58-bb55-43a80c6f6878/discovery/0.log"
Jul 22 03:54:38.372472 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:38.372388    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-nskb8_528ac324-9b2e-4d49-a177-10deebd04583/payload-pre-processing/0.log"
Jul 22 03:54:38.956104 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:38.956075    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-p7fzt_9319a121-cb27-443a-98eb-009901193d26/main/0.log"
Jul 22 03:54:39.291224 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:39.291153    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flpng9_a2a92ce0-7ee6-4c16-9488-141c72218f4f/main/0.log"
Jul 22 03:54:47.860330 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:47.860299    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x8mph_2e2a9ce4-415f-4f0e-b878-a19f08496cb9/global-pull-secret-syncer/0.log"
Jul 22 03:54:48.000915 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:48.000884    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lm5vf_f4d6d9fc-050a-472c-8189-78067e8fd96c/konnectivity-agent/0.log"
Jul 22 03:54:48.022949 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:48.022923    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-205.ec2.internal_88f274895667f5ef1e2f7c5805ba677d/haproxy/0.log"
Jul 22 03:54:55.615905 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:55.615824    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4gttm_2e48eb12-33a7-4554-88b4-38bb5d76fe50/node-exporter/0.log"
Jul 22 03:54:55.639264 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:55.639236    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4gttm_2e48eb12-33a7-4554-88b4-38bb5d76fe50/kube-rbac-proxy/0.log"
Jul 22 03:54:55.664905 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:55.664883    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4gttm_2e48eb12-33a7-4554-88b4-38bb5d76fe50/init-textfile/0.log"
Jul 22 03:54:56.054505 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:56.054478    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_806cc9a9-a1a3-4af0-9c58-f712faf6cd40/prometheus/0.log"
Jul 22 03:54:56.079112 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:56.079087    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_806cc9a9-a1a3-4af0-9c58-f712faf6cd40/config-reloader/0.log"
Jul 22 03:54:56.101999 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:56.101978    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_806cc9a9-a1a3-4af0-9c58-f712faf6cd40/thanos-sidecar/0.log"
Jul 22 03:54:56.124370 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:56.124341    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_806cc9a9-a1a3-4af0-9c58-f712faf6cd40/kube-rbac-proxy-web/0.log"
Jul 22 03:54:56.148468 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:56.148450    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_806cc9a9-a1a3-4af0-9c58-f712faf6cd40/kube-rbac-proxy/0.log"
Jul 22 03:54:56.172103 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:56.172082    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_806cc9a9-a1a3-4af0-9c58-f712faf6cd40/kube-rbac-proxy-thanos/0.log"
Jul 22 03:54:56.198174 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:56.198154    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_806cc9a9-a1a3-4af0-9c58-f712faf6cd40/init-config-reloader/0.log"
Jul 22 03:54:56.423161 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:56.423087    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86d8788ff9-mmvld_19794c73-1e89-46e8-9144-e170d284c709/thanos-query/0.log"
Jul 22 03:54:56.450029 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:56.449997    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86d8788ff9-mmvld_19794c73-1e89-46e8-9144-e170d284c709/kube-rbac-proxy-web/0.log"
Jul 22 03:54:56.476358 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:56.476336    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86d8788ff9-mmvld_19794c73-1e89-46e8-9144-e170d284c709/kube-rbac-proxy/0.log"
Jul 22 03:54:56.502438 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:56.502407    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86d8788ff9-mmvld_19794c73-1e89-46e8-9144-e170d284c709/prom-label-proxy/0.log"
Jul 22 03:54:56.525527 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:56.525503    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86d8788ff9-mmvld_19794c73-1e89-46e8-9144-e170d284c709/kube-rbac-proxy-rules/0.log"
Jul 22 03:54:56.548182 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:56.548164    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86d8788ff9-mmvld_19794c73-1e89-46e8-9144-e170d284c709/kube-rbac-proxy-metrics/0.log"
Jul 22 03:54:57.469757 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.469725    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"]
Jul 22 03:54:57.470109 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.470027    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1" containerName="maas-api"
Jul 22 03:54:57.470109 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.470038    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1" containerName="maas-api"
Jul 22 03:54:57.470109 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.470055    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ee16d10-0290-4281-b98a-25f1ce803b34" containerName="maas-api"
Jul 22 03:54:57.470109 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.470061    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ee16d10-0290-4281-b98a-25f1ce803b34" containerName="maas-api"
Jul 22 03:54:57.470109 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.470110    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ee16d10-0290-4281-b98a-25f1ce803b34" containerName="maas-api"
Jul 22 03:54:57.470270 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.470117    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d789ac-dded-4ee6-a0d0-ecaef4a7c0e1" containerName="maas-api"
Jul 22 03:54:57.473140 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.473118    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:54:57.475762 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.475740    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8cvpq\"/\"openshift-service-ca.crt\""
Jul 22 03:54:57.475762 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.475755    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8cvpq\"/\"kube-root-ca.crt\""
Jul 22 03:54:57.476665 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.476651    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8cvpq\"/\"default-dockercfg-c29st\""
Jul 22 03:54:57.483875 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.483857    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"]
Jul 22 03:54:57.580844 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.580819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16f0a2a6-6fe1-4660-a960-5a0495d8fe7d-sys\") pod \"perf-node-gather-daemonset-8775p\" (UID: \"16f0a2a6-6fe1-4660-a960-5a0495d8fe7d\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:54:57.580983 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.580967    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttmg2\" (UniqueName: \"kubernetes.io/projected/16f0a2a6-6fe1-4660-a960-5a0495d8fe7d-kube-api-access-ttmg2\") pod \"perf-node-gather-daemonset-8775p\" (UID: \"16f0a2a6-6fe1-4660-a960-5a0495d8fe7d\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:54:57.581071 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.580990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16f0a2a6-6fe1-4660-a960-5a0495d8fe7d-proc\") pod \"perf-node-gather-daemonset-8775p\" (UID: \"16f0a2a6-6fe1-4660-a960-5a0495d8fe7d\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:54:57.581071 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.581010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16f0a2a6-6fe1-4660-a960-5a0495d8fe7d-lib-modules\") pod \"perf-node-gather-daemonset-8775p\" (UID: \"16f0a2a6-6fe1-4660-a960-5a0495d8fe7d\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:54:57.581071 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.581037    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16f0a2a6-6fe1-4660-a960-5a0495d8fe7d-podres\") pod \"perf-node-gather-daemonset-8775p\" (UID: \"16f0a2a6-6fe1-4660-a960-5a0495d8fe7d\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:54:57.682309 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.682284    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttmg2\" (UniqueName: \"kubernetes.io/projected/16f0a2a6-6fe1-4660-a960-5a0495d8fe7d-kube-api-access-ttmg2\") pod \"perf-node-gather-daemonset-8775p\" (UID: \"16f0a2a6-6fe1-4660-a960-5a0495d8fe7d\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:54:57.682410 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.682313    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16f0a2a6-6fe1-4660-a960-5a0495d8fe7d-proc\") pod \"perf-node-gather-daemonset-8775p\" (UID: \"16f0a2a6-6fe1-4660-a960-5a0495d8fe7d\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:54:57.682410 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.682338    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16f0a2a6-6fe1-4660-a960-5a0495d8fe7d-lib-modules\") pod \"perf-node-gather-daemonset-8775p\" (UID: \"16f0a2a6-6fe1-4660-a960-5a0495d8fe7d\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:54:57.682483 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.682416    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/16f0a2a6-6fe1-4660-a960-5a0495d8fe7d-proc\") pod \"perf-node-gather-daemonset-8775p\" (UID: \"16f0a2a6-6fe1-4660-a960-5a0495d8fe7d\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:54:57.682483 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.682457    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16f0a2a6-6fe1-4660-a960-5a0495d8fe7d-podres\") pod \"perf-node-gather-daemonset-8775p\" (UID: \"16f0a2a6-6fe1-4660-a960-5a0495d8fe7d\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:54:57.682483 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.682463    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/16f0a2a6-6fe1-4660-a960-5a0495d8fe7d-lib-modules\") pod \"perf-node-gather-daemonset-8775p\" (UID: \"16f0a2a6-6fe1-4660-a960-5a0495d8fe7d\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:54:57.682604 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.682504    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16f0a2a6-6fe1-4660-a960-5a0495d8fe7d-sys\") pod \"perf-node-gather-daemonset-8775p\" (UID: \"16f0a2a6-6fe1-4660-a960-5a0495d8fe7d\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:54:57.682604 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.682543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/16f0a2a6-6fe1-4660-a960-5a0495d8fe7d-podres\") pod \"perf-node-gather-daemonset-8775p\" (UID: \"16f0a2a6-6fe1-4660-a960-5a0495d8fe7d\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:54:57.682669 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.682607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16f0a2a6-6fe1-4660-a960-5a0495d8fe7d-sys\") pod \"perf-node-gather-daemonset-8775p\" (UID: \"16f0a2a6-6fe1-4660-a960-5a0495d8fe7d\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:54:57.691432 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.691414    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttmg2\" (UniqueName: \"kubernetes.io/projected/16f0a2a6-6fe1-4660-a960-5a0495d8fe7d-kube-api-access-ttmg2\") pod \"perf-node-gather-daemonset-8775p\" (UID: \"16f0a2a6-6fe1-4660-a960-5a0495d8fe7d\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:54:57.783245 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.783181    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:54:57.911465 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:57.911432    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"]
Jul 22 03:54:57.915082 ip-10-0-128-205 kubenswrapper[2565]: W0722 03:54:57.915052    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod16f0a2a6_6fe1_4660_a960_5a0495d8fe7d.slice/crio-42fe71dda425303c493bfd5a9d772253e35477259c6cc0923969edba60992e01 WatchSource:0}: Error finding container 42fe71dda425303c493bfd5a9d772253e35477259c6cc0923969edba60992e01: Status 404 returned error can't find the container with id 42fe71dda425303c493bfd5a9d772253e35477259c6cc0923969edba60992e01
Jul 22 03:54:58.368633 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:58.368594    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p" event={"ID":"16f0a2a6-6fe1-4660-a960-5a0495d8fe7d","Type":"ContainerStarted","Data":"13c5cf3a182fb3dea0cff3d5e437d337b6ee411e0b93c4f53762b8d39171bad2"}
Jul 22 03:54:58.368823 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:58.368648    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p" event={"ID":"16f0a2a6-6fe1-4660-a960-5a0495d8fe7d","Type":"ContainerStarted","Data":"42fe71dda425303c493bfd5a9d772253e35477259c6cc0923969edba60992e01"}
Jul 22 03:54:58.368823 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:58.368717    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:54:58.385872 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:54:58.385829    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p" podStartSLOduration=1.385815717 podStartE2EDuration="1.385815717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:54:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:54:58.384648597 +0000 UTC m=+2835.846199004" watchObservedRunningTime="2026-07-22 03:54:58.385815717 +0000 UTC m=+2835.847366122"
Jul 22 03:55:00.512853 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:00.512823    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-94xck_e9ee21e8-ac38-4118-837e-acbba4d2eb09/dns/0.log"
Jul 22 03:55:00.533976 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:00.533954    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-94xck_e9ee21e8-ac38-4118-837e-acbba4d2eb09/kube-rbac-proxy/0.log"
Jul 22 03:55:00.699991 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:00.699962    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rnn7l_1c64ef25-ed44-4731-8c1d-fba203cee498/dns-node-resolver/0.log"
Jul 22 03:55:01.267593 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:01.267551    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lptm9_a4c74ab3-d9f1-4901-932f-841e01504f79/node-ca/0.log"
Jul 22 03:55:02.412630 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:02.412602    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-g7q49_de4725a9-b593-4a58-bb55-43a80c6f6878/discovery/0.log"
Jul 22 03:55:02.633320 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:02.633287    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-nskb8_528ac324-9b2e-4d49-a177-10deebd04583/payload-pre-processing/0.log"
Jul 22 03:55:03.470835 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:03.470810    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-64nw2_e5c57192-9ea2-40cd-bda6-4ef6ea7677ed/serve-healthcheck-canary/0.log"
Jul 22 03:55:04.115125 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:04.115100    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sbs7p_9fb47518-b064-48c7-a860-7bfb8b710eaa/kube-rbac-proxy/0.log"
Jul 22 03:55:04.139135 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:04.139109    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sbs7p_9fb47518-b064-48c7-a860-7bfb8b710eaa/exporter/0.log"
Jul 22 03:55:04.168569 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:04.168547    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sbs7p_9fb47518-b064-48c7-a860-7bfb8b710eaa/extractor/0.log"
Jul 22 03:55:04.382109 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:04.382023    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-8775p"
Jul 22 03:55:07.044782 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:07.044751    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c66fb4cb9-h7rs8_09a07d8e-7b24-4ac6-b7d4-51a6d1f5a484/manager/0.log"
Jul 22 03:55:07.452105 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:07.452080    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fb7f869bf-lfm7s_bc303a86-6296-4500-9684-e7d04e218390/manager/0.log"
Jul 22 03:55:07.474165 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:07.474134    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fb7f869bf-lfm7s_bc303a86-6296-4500-9684-e7d04e218390/copy-manifests/0.log"
Jul 22 03:55:07.944863 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:07.944818    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-g7q49_de4725a9-b593-4a58-bb55-43a80c6f6878/discovery/0.log"
Jul 22 03:55:08.051929 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:08.051862    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-nskb8_528ac324-9b2e-4d49-a177-10deebd04583/payload-pre-processing/0.log"
Jul 22 03:55:08.704892 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:08.704854    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8587dbf975-cx96x_9465c8c9-f3cb-472a-8bed-efdbf3d015e9/manager/0.log"
Jul 22 03:55:09.334396 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:09.334365    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-g7q49_de4725a9-b593-4a58-bb55-43a80c6f6878/discovery/0.log"
Jul 22 03:55:09.447272 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:09.447248    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-nskb8_528ac324-9b2e-4d49-a177-10deebd04583/payload-pre-processing/0.log"
Jul 22 03:55:13.505214 ip-10-0-128-205 kubenswrapper[2565]: I0722 03:55:13.505184    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-hwtqv_9630dd09-b625-41ff-8f43-18c7713a3f56/migrator/0.log"