Jul 22 12:35:15.342750 ip-10-0-130-160 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 22 12:35:15.342761 ip-10-0-130-160 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 22 12:35:15.342768 ip-10-0-130-160 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 22 12:35:15.343189 ip-10-0-130-160 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 22 12:35:25.114817 ip-10-0-130-160 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 22 12:35:25.114834 ip-10-0-130-160 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 519e75d8dd934bb9aa407509df5c655b --
Jul 22 12:37:16.022005 ip-10-0-130-160 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 12:37:16.442761 ip-10-0-130-160 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 12:37:16.442761 ip-10-0-130-160 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 12:37:16.442761 ip-10-0-130-160 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 12:37:16.442761 ip-10-0-130-160 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 12:37:16.442761 ip-10-0-130-160 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 12:37:16.443890 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.443734    2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 12:37:16.448632 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448611    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 12:37:16.448632 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448631    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448635    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448638    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448641    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448644    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448647    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448652    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448657    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448660    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448664    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448666    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448670    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448673    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448676    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448679    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448682    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448684    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448687    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448690    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 12:37:16.448704 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448692    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448695    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448697    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448700    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448703    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448706    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448709    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448727    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448729    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448732    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448735    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448738    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448741    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448743    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448746    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448748    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448751    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448753    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448755    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448758    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 12:37:16.449181 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448760    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448763    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448765    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448768    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448770    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448773    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448775    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448778    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448780    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448782    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448785    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448787    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448790    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448793    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448796    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448798    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448801    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448804    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448806    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448809    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 12:37:16.449659 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448811    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448814    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448816    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448819    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448821    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448823    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448826    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448828    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448830    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448833    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448836    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448839    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448841    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448846    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448849    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448853    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448855    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448858    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448861    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448863    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 12:37:16.450162 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448866    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448868    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448871    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448874    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448878    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448883    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448887    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448890    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448892    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448895    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448898    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448900    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448903    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448906    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448908    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448911    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448913    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448916    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.448918    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 12:37:16.450687 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449630    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449636    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449639    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449642    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449644    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449647    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449649    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449652    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449655    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449658    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449661    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449664    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449667    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449669    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449672    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449675    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449678    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449681    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449683    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449686    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 12:37:16.451161 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449688    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449691    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449693    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449697    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449703    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449707    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449728    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449731    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449734    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449737    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449739    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449742    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449745    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449747    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449750    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449752    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449755    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449759    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449763    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 12:37:16.451668 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449766    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449769    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449771    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449775    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449779    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449782    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449784    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449788    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449791    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449793    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449796    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449799    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449801    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449804    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449806    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449809    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449812    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449815    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449818    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449820    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 12:37:16.452170 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449823    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449825    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449828    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449831    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449833    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449836    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449838    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449841    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449843    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449846    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449849    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449851    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449854    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449857    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449859    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449863    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449866    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449869    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449872    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449874    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 12:37:16.452670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449877    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449879    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449882    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449885    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449887    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449890    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449892    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449894    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449897    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449899    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449902    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449904    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449907    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449909    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449912    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449914    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449917    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449919    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449922    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.449924    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 12:37:16.453222 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450330    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450335    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450338    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450340    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450343    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450346    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450348    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450351    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450354    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450356    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450360    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450362    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450365    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450367    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450373    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450375    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450377    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450380    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450383    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450386    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 12:37:16.453729 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450388    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450391    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450393    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450396    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450398    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450401    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450404    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450406    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450409    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450411    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450414    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450416    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450419    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450421    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450424    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450428    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450432    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450435    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450437    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 12:37:16.454214 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450440    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450442    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450445    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450466    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450471    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450474    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450477    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450483    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450486    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450489    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450492    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450494    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450497    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450500    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450503    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450506    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450508    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450511    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450514    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450517    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 12:37:16.454679 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450519    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450522    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450525    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450527    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450531    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450534    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450538    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450541    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450545    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450549    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450552    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450554    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450557    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450560    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450563    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450566    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450569    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450571    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450574    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 12:37:16.455186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450579    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450581    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450584    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450586    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450589    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450591    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450594    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450596    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450599    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450601    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450604    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450606    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450609    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450611    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450614    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450616    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450619    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450621    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450624    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450627    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 12:37:16.455683 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.450630    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450704    2556 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450725    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450734    2556 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450740    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450746    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450751    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450757    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450762    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450772    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450776    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450779    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450783    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450786    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450789    2556 flags.go:64] FLAG: --cgroup-root=""
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450792    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450795    2556 flags.go:64] FLAG: --client-ca-file=""
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450798    2556 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450800    2556 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450808    2556 flags.go:64] FLAG: --cluster-domain=""
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450810    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450813    2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450816    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450819    2556 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 12:37:16.456246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450823    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450826    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450829    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450832    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450835    2556 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450838    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450847    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450852    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450854    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450859    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450862    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450865    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450868    2556 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450871    2556 flags.go:64] FLAG: --enable-server="true"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450873    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450880    2556 flags.go:64] FLAG: --event-burst="100"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450883    2556 flags.go:64] FLAG: --event-qps="50"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450886    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450901    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450904    2556 flags.go:64] FLAG: --eviction-hard=""
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450912    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450915    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450918    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450921    2556 flags.go:64] FLAG: --eviction-soft=""
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450924    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 12:37:16.456842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450927    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450930    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450932    2556 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450935    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450939    2556 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450941    2556 flags.go:64] FLAG: --feature-gates=""
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450949    2556 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450952    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450955    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450958    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450961    2556 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450964    2556 flags.go:64] FLAG: --help="false"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450966    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-130-160.ec2.internal"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450969    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450973    2556 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450977    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450980    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450983    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450986    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450989    2556 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450992    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450995    2556 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.450997    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451000    2556 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 12:37:16.457465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451003    2556 flags.go:64] FLAG: --kube-reserved=""
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451006    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451016    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451019    2556 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451022    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451025    2556 flags.go:64] FLAG: --lock-file=""
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451028    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451030    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451033    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451039    2556 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451041    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451044    2556 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451047    2556 flags.go:64] FLAG: --logging-format="text"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451050    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451053    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451056    2556 flags.go:64] FLAG: --manifest-url=""
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451058    2556 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451063    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451066    2556 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451070    2556 flags.go:64] FLAG: --max-pods="110"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451073    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451075    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451081    2556 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451083    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451086    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 12:37:16.458104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451089    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451092    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451100    2556 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451103    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451106    2556 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451108    2556 flags.go:64] FLAG: --pod-cidr=""
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451111    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451117    2556 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451120    2556 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451124    2556 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451132    2556 flags.go:64] FLAG: --port="10250"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451135    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451138    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03b5f9e13787f05b8"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451141    2556 flags.go:64] FLAG: --qos-reserved=""
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451144    2556 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451146    2556 flags.go:64] FLAG: --register-node="true"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451150    2556 flags.go:64] FLAG: --register-with-taints=""
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451153    2556 flags.go:64] FLAG: --registry-burst="10"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451156    2556 flags.go:64] FLAG: --registry-qps="5"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451159    2556 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451162    2556 flags.go:64] FLAG: --reserved-memory=""
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451165    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451169    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451172    2556 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451175    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 12:37:16.458761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451178    2556 flags.go:64] FLAG: --runonce="false"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451180    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451183    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451186    2556 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451190    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451193    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451195    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451198    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451201    2556 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451204    2556 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451206    2556 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451209    2556 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451211    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451215    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451218    2556 flags.go:64] FLAG: --system-cgroups=""
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451221    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451226    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451229    2556 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451235    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451239    2556 flags.go:64] FLAG: --tls-min-version=""
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451242    2556 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451245    2556 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451248    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451250    2556 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451253    2556 flags.go:64] FLAG: --v="2"
Jul 22 12:37:16.459405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451257    2556 flags.go:64] FLAG: --version="false"
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451261    2556 flags.go:64] FLAG: --vmodule=""
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451265    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.451268    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451407    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451410    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451414    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451417    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451419    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451422    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451425    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451428    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451431    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451434    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451436    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451439    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451441    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451444    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451446    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451449    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 12:37:16.460048 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451451    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451455    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451458    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451460    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451463    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451466    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451469    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451472    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451474    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451477    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451479    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451482    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451484    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451497    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451499    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451502    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451504    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451507    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451509    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451512    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 12:37:16.460543 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451514    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451517    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451519    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451522    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451525    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451527    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451529    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451532    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451534    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451537    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451539    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451542    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451544    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451548    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451550    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451553    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451557    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451561    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451564    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451567    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 12:37:16.461074 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451570    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451573    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451575    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451578    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451581    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451584    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451587    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451590    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451593    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451595    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451598    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451601    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451604    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451606    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451609    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451612    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451615    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451617    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451621    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 12:37:16.461558 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451624    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451627    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451629    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451632    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451634    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451637    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451641    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451643    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451645    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451648    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451651    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451653    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451656    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451659    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451661    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451664    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451666    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451669    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451671    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451674    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 12:37:16.462037 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451676    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 12:37:16.462530 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451679    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 12:37:16.462530 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451682    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 12:37:16.462530 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.451685    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 12:37:16.462530 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.452467    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 12:37:16.462530 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.459504    2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 12:37:16.462530 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.459524    2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 12:37:16.462530 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.460499    2556 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 12:37:16.462530 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.460509    2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 12:37:16.462530 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460570    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 12:37:16.462530 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460578    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 12:37:16.462530 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460581    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 12:37:16.462530 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460585    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 12:37:16.462530 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460588    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 12:37:16.462530 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460591    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 12:37:16.462530 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460594    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460597    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460600    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460602    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460605    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460607    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460610    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460612    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460615    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460617    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460620    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460623    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460628    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460631    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460634    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460636    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460639    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460642    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460644    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 12:37:16.463009 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460647    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460650    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460652    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460655    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460660    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460662    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460665    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460668    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460670    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460673    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460675    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460678    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460681    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460683    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460685    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460688    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460690    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460693    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460695    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460698    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 12:37:16.463803 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460700    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460702    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460705    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460707    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460726    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460730    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460733    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460736    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460738    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460741    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460743    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460746    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460748    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460750    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460753    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460755    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460759    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460762    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460765    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460767    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 12:37:16.464364 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460770    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460773    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460775    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460778    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460780    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460783    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460785    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460788    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460790    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460793    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460795    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460797    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460800    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460802    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460805    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460808    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460810    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460813    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460815    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460817    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 12:37:16.464874 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460820    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 12:37:16.465355 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460822    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 12:37:16.465355 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460824    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 12:37:16.465355 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460827    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 12:37:16.465355 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460829    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 12:37:16.465355 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460832    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 12:37:16.465355 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460835    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 12:37:16.465355 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460837    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 12:37:16.465355 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460840    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 12:37:16.465355 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460843    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 12:37:16.465355 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460846    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 12:37:16.465355 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460848    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 12:37:16.465355 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460852    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 12:37:16.465355 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460856    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 12:37:16.465355 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.460862    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460984    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460989    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460992    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460995    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.460997    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461000    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461003    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461006    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461008    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461011    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461014    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461016    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461019    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461022    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461024    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461026    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461029    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461031    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461034    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 12:37:16.465709 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461037    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461041    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461045    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461048    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461051    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461054    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461057    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461060    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461062    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461065    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461068    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461070    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461073    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461076    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461078    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461081    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461084    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461086    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461089    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 12:37:16.466192 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461092    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461094    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461097    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461099    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461101    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461103    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461106    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461108    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461112    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461115    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461117    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461119    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461122    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461124    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461126    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461129    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461131    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461134    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461137    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 12:37:16.466648 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461140    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461143    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461145    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461148    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461156    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461158    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461161    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461163    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461166    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461168    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461171    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461173    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461176    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461178    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461180    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461183    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461185    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461188    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461190    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461192    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 12:37:16.467119 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461195    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461197    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461200    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461202    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461204    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461207    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461209    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461211    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461214    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461216    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461219    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461221    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461224    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461227    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461229    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461232    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461234    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461237    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461240    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461242    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 12:37:16.467605 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461245    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 12:37:16.468125 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:16.461247    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 12:37:16.468125 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.461252    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 12:37:16.468125 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.461418    2556 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 12:37:16.468125 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.465047    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 12:37:16.468125 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.466422    2556 server.go:1019] "Starting client certificate rotation"
Jul 22 12:37:16.468125 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.466521    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 12:37:16.468125 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.466561    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 12:37:16.469030 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.469015    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 12:37:16.470232 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.470214    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 12:37:16.478301 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.478282    2556 log.go:25] "Validated CRI v1 runtime API"
Jul 22 12:37:16.481674 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.481658    2556 log.go:25] "Validated CRI v1 image API"
Jul 22 12:37:16.482446 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.482429    2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 12:37:16.486708 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.486688    2556 fs.go:135] Filesystem UUIDs: map[2f0357ef-5d78-499f-b68d-9a798338aca9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 93fe7461-1d8a-42d4-9dcb-7896c24767dc:/dev/nvme0n1p4]
Jul 22 12:37:16.486800 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.486707    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 12:37:16.492156 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.492037    2556 manager.go:216] Machine: {Timestamp:2026-07-22 12:37:16.49051616 +0000 UTC m=+0.351724844 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099060 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21c7b7d9640a91a471c70346249f63 SystemUUID:ec21c7b7-d964-0a91-a471-c70346249f63 BootID:519e75d8-dd93-4bb9-aa40-7509df5c655b Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:58:9e:1b:18:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:58:9e:1b:18:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:1b:83:9f:27:df Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 12:37:16.492156 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.492151    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 12:37:16.492264 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.492238    2556 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 12:37:16.495241 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.495211    2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 12:37:16.495442 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.495246    2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-160.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 12:37:16.496589 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.496578    2556 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 12:37:16.496629 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.496593    2556 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 12:37:16.496629 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.496601    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 12:37:16.497318 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.497308    2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 12:37:16.497438 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.497421    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 12:37:16.498694 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.498683    2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 12:37:16.501502 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.501490    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 12:37:16.501632 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.501622    2556 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 12:37:16.501660 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.501655    2556 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 12:37:16.501688 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.501679    2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 12:37:16.501780 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.501769    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 12:37:16.501812 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.501790    2556 kubelet.go:398] "Adding apiserver pod source"
Jul 22 12:37:16.501812 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.501802    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 12:37:16.502392 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.502376    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 12:37:16.502456 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.502397    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 12:37:16.504778 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.504746    2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 12:37:16.508903 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.508885    2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 12:37:16.508982 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.508917    2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 12:37:16.510798 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.510778    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 12:37:16.510867 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.510807    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 12:37:16.510867 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.510816    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 12:37:16.510867 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.510824    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 12:37:16.510867 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.510836    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 12:37:16.510867 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.510843    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 12:37:16.510867 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.510855    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 12:37:16.510867 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.510862    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 12:37:16.511054 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.510872    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 12:37:16.511054 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.510881    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 12:37:16.511054 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.510893    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 12:37:16.511054 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.510904    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 12:37:16.511615 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.511603    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 12:37:16.511652 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.511620    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 12:37:16.514119 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.514104    2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-160.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 12:37:16.514220 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.514199    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 12:37:16.514318 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.514296    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 12:37:16.514867 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.514854    2556 server.go:1268] "Started kubelet"
Jul 22 12:37:16.514983 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.514955    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 12:37:16.515219 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.514942    2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 12:37:16.515280 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.515264    2556 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 12:37:16.515823 ip-10-0-130-160 systemd[1]: Started Kubernetes Kubelet.
Jul 22 12:37:16.517533 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.517506    2556 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 12:37:16.519381 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.519360    2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 12:37:16.520205 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.520179    2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 12:37:16.525115 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.525094    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 12:37:16.525200 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.525113    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 12:37:16.525265 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.525206    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-160.ec2.internal\" not found"
Jul 22 12:37:16.525813 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.525783    2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 12:37:16.525956 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.525938    2556 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 12:37:16.525956 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.525957    2556 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 12:37:16.526102 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.526019    2556 factory.go:55] Registering systemd factory
Jul 22 12:37:16.526102 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.526079    2556 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 12:37:16.526184 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.526046    2556 factory.go:223] Registration of the systemd container factory successfully
Jul 22 12:37:16.526263 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.526111    2556 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 12:37:16.526417 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.526403    2556 factory.go:153] Registering CRI-O factory
Jul 22 12:37:16.526458 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.526421    2556 factory.go:223] Registration of the crio container factory successfully
Jul 22 12:37:16.526493 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.526474    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 12:37:16.526532 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.526501    2556 factory.go:103] Registering Raw factory
Jul 22 12:37:16.526532 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.526516    2556 manager.go:1196] Started watching for new ooms in manager
Jul 22 12:37:16.527024 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.526999    2556 manager.go:349] Starting recovery of all containers
Jul 22 12:37:16.528830 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.528807    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gfvpr"
Jul 22 12:37:16.531167 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.530077    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-160.ec2.internal.18c49cdf99a36f11  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-160.ec2.internal,UID:ip-10-0-130-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-160.ec2.internal,},FirstTimestamp:2026-07-22 12:37:16.514823953 +0000 UTC m=+0.376032722,LastTimestamp:2026-07-22 12:37:16.514823953 +0000 UTC m=+0.376032722,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-160.ec2.internal,}"
Jul 22 12:37:16.531276 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.531163    2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-160.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 12:37:16.531342 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.531273    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 12:37:16.536543 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.536526    2556 manager.go:354] Recovery completed
Jul 22 12:37:16.537263 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.537226    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gfvpr"
Jul 22 12:37:16.538707 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.538681    2556 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 22 12:37:16.542732 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.542701    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 12:37:16.544536 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.544522    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 12:37:16.544619 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.544554    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 12:37:16.544619 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.544570    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasSufficientPID"
Jul 22 12:37:16.545151 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.545137    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 12:37:16.545197 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.545154    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 12:37:16.545228 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.545153    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 12:37:16.545228 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.545222    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 12:37:16.545945 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.545931    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 12:37:16.545995 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.545956    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 12:37:16.545995 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.545966    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasSufficientPID"
Jul 22 12:37:16.546386 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.546374    2556 policy_none.go:49] "None policy: Start"
Jul 22 12:37:16.546416 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.546392    2556 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 12:37:16.546416 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.546401    2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 12:37:16.546868 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.546799    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-160.ec2.internal.18c49cdf9b68d289  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-160.ec2.internal,UID:ip-10-0-130-160.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-160.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-160.ec2.internal,},FirstTimestamp:2026-07-22 12:37:16.544537225 +0000 UTC m=+0.405745917,LastTimestamp:2026-07-22 12:37:16.544537225 +0000 UTC m=+0.405745917,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-160.ec2.internal,}"
Jul 22 12:37:16.547346 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.547334    2556 policy_none.go:47] "Start"
Jul 22 12:37:16.598405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.598384    2556 manager.go:337] "Starting Device Plugin manager"
Jul 22 12:37:16.598545 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.598432    2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 12:37:16.598545 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.598446    2556 server.go:87] "Starting device plugin registration server"
Jul 22 12:37:16.598959 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.598792    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 12:37:16.599037 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.598966    2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 12:37:16.599087 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.599073    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 12:37:16.599169 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.599156    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 12:37:16.599169 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.599168    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 12:37:16.599763 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.599709    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 12:37:16.599843 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.599801    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-160.ec2.internal\" not found"
Jul 22 12:37:16.673170 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.673135    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 12:37:16.674459 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.674431    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 12:37:16.674540 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.674468    2556 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 12:37:16.674540 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.674490    2556 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 12:37:16.674540 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.674527    2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 12:37:16.677210 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.677192    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 12:37:16.699132 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.699067    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 12:37:16.700285 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.700266    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 12:37:16.700366 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.700301    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 12:37:16.700366 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.700317    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasSufficientPID"
Jul 22 12:37:16.700366 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.700342    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-160.ec2.internal"
Jul 22 12:37:16.708587 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.708568    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-160.ec2.internal"
Jul 22 12:37:16.708635 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.708594    2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-160.ec2.internal\": node \"ip-10-0-130-160.ec2.internal\" not found"
Jul 22 12:37:16.739133 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.739103    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-160.ec2.internal\" not found"
Jul 22 12:37:16.775608 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.775574    2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-160.ec2.internal"]
Jul 22 12:37:16.775703 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.775685    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 12:37:16.780119 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.780105    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 12:37:16.780195 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.780134    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 12:37:16.780195 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.780144    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasSufficientPID"
Jul 22 12:37:16.781467 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.781456    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 12:37:16.781577 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.781564    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal"
Jul 22 12:37:16.781627 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.781612    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 12:37:16.782245 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.782231    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 12:37:16.782321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.782252    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 12:37:16.782321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.782263    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasSufficientPID"
Jul 22 12:37:16.782321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.782234    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 12:37:16.782436 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.782326    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 12:37:16.782436 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.782338    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasSufficientPID"
Jul 22 12:37:16.783617 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.783601    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-160.ec2.internal"
Jul 22 12:37:16.783702 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.783625    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 12:37:16.788203 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.788187    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 12:37:16.788291 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.788220    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 12:37:16.788291 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.788236    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeHasSufficientPID"
Jul 22 12:37:16.804351 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.804329    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-160.ec2.internal\" not found" node="ip-10-0-130-160.ec2.internal"
Jul 22 12:37:16.810123 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.810107    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-160.ec2.internal\" not found" node="ip-10-0-130-160.ec2.internal"
Jul 22 12:37:16.828727 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.828692    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c8d43111888f079a9689a4d2f852443-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal\" (UID: \"0c8d43111888f079a9689a4d2f852443\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal"
Jul 22 12:37:16.828831 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.828733    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7976a83d9e3242dd32fc595d5fadaffb-config\") pod \"kube-apiserver-proxy-ip-10-0-130-160.ec2.internal\" (UID: \"7976a83d9e3242dd32fc595d5fadaffb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-160.ec2.internal"
Jul 22 12:37:16.828831 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.828760    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c8d43111888f079a9689a4d2f852443-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal\" (UID: \"0c8d43111888f079a9689a4d2f852443\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal"
Jul 22 12:37:16.839861 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.839832    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-160.ec2.internal\" not found"
Jul 22 12:37:16.929505 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.929463    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c8d43111888f079a9689a4d2f852443-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal\" (UID: \"0c8d43111888f079a9689a4d2f852443\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal"
Jul 22 12:37:16.929505 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.929496    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c8d43111888f079a9689a4d2f852443-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal\" (UID: \"0c8d43111888f079a9689a4d2f852443\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal"
Jul 22 12:37:16.929701 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.929513    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c8d43111888f079a9689a4d2f852443-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal\" (UID: \"0c8d43111888f079a9689a4d2f852443\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal"
Jul 22 12:37:16.929701 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.929539    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7976a83d9e3242dd32fc595d5fadaffb-config\") pod \"kube-apiserver-proxy-ip-10-0-130-160.ec2.internal\" (UID: \"7976a83d9e3242dd32fc595d5fadaffb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-160.ec2.internal"
Jul 22 12:37:16.929701 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.929567    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c8d43111888f079a9689a4d2f852443-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal\" (UID: \"0c8d43111888f079a9689a4d2f852443\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal"
Jul 22 12:37:16.929701 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:16.929576    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7976a83d9e3242dd32fc595d5fadaffb-config\") pod \"kube-apiserver-proxy-ip-10-0-130-160.ec2.internal\" (UID: \"7976a83d9e3242dd32fc595d5fadaffb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-160.ec2.internal"
Jul 22 12:37:16.940590 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:16.940562    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-160.ec2.internal\" not found"
Jul 22 12:37:17.041429 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:17.041349    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-160.ec2.internal\" not found"
Jul 22 12:37:17.107575 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:17.107541    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal"
Jul 22 12:37:17.113833 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:17.113795    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-160.ec2.internal"
Jul 22 12:37:17.142425 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:17.142395    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-160.ec2.internal\" not found"
Jul 22 12:37:17.243063 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:17.243018    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-160.ec2.internal\" not found"
Jul 22 12:37:18.564545 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:18.564466    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-160.ec2.internal\" not found"
Jul 22 12:37:18.603141 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.603122    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 12:37:18.647229 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.647199    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal"
Jul 22 12:37:18.658670 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.658649    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 12:37:18.660598 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.660584    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-160.ec2.internal"
Jul 22 12:37:18.668070 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.668050    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 12:37:18.687199 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.687167    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 12:37:18.687326 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.687310    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 12:37:18.687372 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.687310    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 12:37:18.723523 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.723492    2556 apiserver.go:52] "Watching apiserver"
Jul 22 12:37:18.745279 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.745247    2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 12:37:18.745635 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.745614    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-sb677","openshift-network-diagnostics/network-check-target-cgwsm","kube-system/konnectivity-agent-kjbch","kube-system/kube-apiserver-proxy-ip-10-0-130-160.ec2.internal","openshift-multus/multus-additional-cni-plugins-s698q","openshift-multus/network-metrics-daemon-jvncr","openshift-network-operator/iptables-alerter-mkkf8","openshift-ovn-kubernetes/ovnkube-node-vbkcp","kube-system/global-pull-secret-syncer-f5xrr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx","openshift-cluster-node-tuning-operator/tuned-nww7b","openshift-dns/node-resolver-bpdhv","openshift-image-registry/node-ca-br64g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal"]
Jul 22 12:37:18.746586 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.746569    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 12:37:18.747103 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.747083    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.748773 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.748751    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:18.748861 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:18.748840    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgwsm" podUID="c5271282-15aa-43a3-9c6c-f7a482d0ad03"
Jul 22 12:37:18.751303 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.749986    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 12:37:18.751303 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.750020    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w895b\""
Jul 22 12:37:18.751303 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.750296    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 12:37:18.751303 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.750554    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 12:37:18.751728 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.751706    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bpdhv"
Jul 22 12:37:18.752761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.752745    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.753467 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.753449    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8b6bd950-92d7-4904-af50-d260db489f0f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.753529 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.753475    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8b6bd950-92d7-4904-af50-d260db489f0f-socket-dir\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.753529 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.753496    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8b6bd950-92d7-4904-af50-d260db489f0f-registration-dir\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.753596 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.753538    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8b6bd950-92d7-4904-af50-d260db489f0f-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.753596 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.753560    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8b6bd950-92d7-4904-af50-d260db489f0f-sys-fs\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.753596 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.753583    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj98t\" (UniqueName: \"kubernetes.io/projected/8b6bd950-92d7-4904-af50-d260db489f0f-kube-api-access-zj98t\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.753712 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.753613    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8b6bd950-92d7-4904-af50-d260db489f0f-device-dir\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.753712 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.753639    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kphd8\" (UniqueName: \"kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8\") pod \"network-check-target-cgwsm\" (UID: \"c5271282-15aa-43a3-9c6c-f7a482d0ad03\") " pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:18.753935 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.753922    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mkkf8"
Jul 22 12:37:18.754209 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.754187    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 12:37:18.754288 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.754197    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 12:37:18.754390 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.754377    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-knszc\""
Jul 22 12:37:18.755091 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.755078    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4w98b\""
Jul 22 12:37:18.755272 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.755254    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 12:37:18.755365 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.755284    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:18.755365 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:18.755332    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:18.755365 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.755283    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 12:37:18.756575 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.756559    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.756965 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.756946    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 12:37:18.757073 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.756973    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 12:37:18.757073 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.756971    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8d9dr\""
Jul 22 12:37:18.757251 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.757237    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 12:37:18.757727 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.757714    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-br64g"
Jul 22 12:37:18.758890 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.758874    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:18.758975 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:18.758938    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:18.760276 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.760262    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.761404 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.761390    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kjbch"
Jul 22 12:37:18.761722 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.761701    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 12:37:18.761722 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.761721    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 12:37:18.761879 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.761746    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 12:37:18.761879 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.761749    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 12:37:18.762000 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.761988    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rffs6\""
Jul 22 12:37:18.762768 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.762741    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 12:32:17 +0000 UTC" deadline="2028-01-13 12:38:08.300293945 +0000 UTC"
Jul 22 12:37:18.762768 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.762768    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12960h0m49.537529496s"
Jul 22 12:37:18.762947 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.762934    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 12:37:18.763012 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.762970    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.763207 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.763182    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 12:37:18.763661 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.763643    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 12:37:18.763865 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.763849    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 12:37:18.763930 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.763906    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-n4fck\""
Jul 22 12:37:18.765824 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.765806    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 12:37:18.766533 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.766517    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cmt27\""
Jul 22 12:37:18.768524 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.768506    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 12:37:18.768627 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.768536    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 12:37:18.768627 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.768561    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 12:37:18.768627 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.768570    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7zg26\""
Jul 22 12:37:18.768627 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.768595    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 12:37:18.768859 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.768659    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 12:37:18.768913 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.768898    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 12:37:18.769100 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.769081    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xz9d6\""
Jul 22 12:37:18.769174 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.769122    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 12:37:18.769174 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.769143    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 12:37:18.769256 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.769224    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 12:37:18.785474 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.785457    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5mk72"
Jul 22 12:37:18.795542 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.795523    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5mk72"
Jul 22 12:37:18.847870 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.847846    2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 12:37:18.854099 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854079    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8b6bd950-92d7-4904-af50-d260db489f0f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.854261 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854105    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8b6bd950-92d7-4904-af50-d260db489f0f-registration-dir\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.854261 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854124    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8b6bd950-92d7-4904-af50-d260db489f0f-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.854261 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854151    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-run\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.854261 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854177    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-os-release\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.854261 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854198    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-etc-kubernetes\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.854261 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854201    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8b6bd950-92d7-4904-af50-d260db489f0f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.854261 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854221    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-run-netns\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.854261 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854204    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8b6bd950-92d7-4904-af50-d260db489f0f-registration-dir\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.854261 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854254    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-cni-bin\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.854261 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854256    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8b6bd950-92d7-4904-af50-d260db489f0f-etc-selinux\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.854568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854293    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-sys\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.854568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854323    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/564b611d-b20e-44d0-9291-6d6b96855346-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.854568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854342    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-cnibin\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.854568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854357    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/caeba436-52ed-4fa3-9e4e-25153afdb333-cni-binary-copy\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.854568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854372    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a214fc4b-db41-4fd7-b2ac-59aaa1720409-konnectivity-ca\") pod \"konnectivity-agent-kjbch\" (UID: \"a214fc4b-db41-4fd7-b2ac-59aaa1720409\") " pod="kube-system/konnectivity-agent-kjbch"
Jul 22 12:37:18.854568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854387    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-log-socket\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.854568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854404    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgqvb\" (UniqueName: \"kubernetes.io/projected/8f4f742d-de43-487c-885b-1600fc6cfc6f-kube-api-access-tgqvb\") pod \"iptables-alerter-mkkf8\" (UID: \"8f4f742d-de43-487c-885b-1600fc6cfc6f\") " pod="openshift-network-operator/iptables-alerter-mkkf8"
Jul 22 12:37:18.854568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854426    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-host-var-lib-cni-multus\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.854568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854448    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-dbus\") pod \"global-pull-secret-syncer-f5xrr\" (UID: \"053dcfaf-ab25-4783-ad4a-4aa9693b8f6c\") " pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:18.854568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854472    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f4f742d-de43-487c-885b-1600fc6cfc6f-host-slash\") pod \"iptables-alerter-mkkf8\" (UID: \"8f4f742d-de43-487c-885b-1600fc6cfc6f\") " pod="openshift-network-operator/iptables-alerter-mkkf8"
Jul 22 12:37:18.854568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854494    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/564b611d-b20e-44d0-9291-6d6b96855346-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.854568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854509    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-run-systemd\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.854568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854524    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-run-ovn-kubernetes\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.854568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854539    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-cni-netd\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.854568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854561    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8b6bd950-92d7-4904-af50-d260db489f0f-sys-fs\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.855097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854581    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-system-cni-dir\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.855097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854618    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8b6bd950-92d7-4904-af50-d260db489f0f-sys-fs\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.855097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854634    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-hostroot\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.855097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854656    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-slash\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.855097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854697    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kphd8\" (UniqueName: \"kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8\") pod \"network-check-target-cgwsm\" (UID: \"c5271282-15aa-43a3-9c6c-f7a482d0ad03\") " pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:18.855097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854716    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9366ceb-c6c3-4b73-a46c-b78c25651192-tmp\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.855097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854733    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/564b611d-b20e-44d0-9291-6d6b96855346-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.855097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854749    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-host-run-k8s-cni-cncf-io\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.855097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854768    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aec9d056-2cee-42b8-bb4e-f333e1269945-hosts-file\") pod \"node-resolver-bpdhv\" (UID: \"aec9d056-2cee-42b8-bb4e-f333e1269945\") " pod="openshift-dns/node-resolver-bpdhv"
Jul 22 12:37:18.855097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854790    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-kubelet\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.855097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854804    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-lib-modules\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.855097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854817    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xhs9\" (UniqueName: \"kubernetes.io/projected/e9366ceb-c6c3-4b73-a46c-b78c25651192-kube-api-access-9xhs9\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.855097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854831    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/564b611d-b20e-44d0-9291-6d6b96855346-os-release\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.855097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854854    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-systemd-units\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.855097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854872    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-var-lib-kubelet\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.855097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854907    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-host\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.855911 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854941    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f4f742d-de43-487c-885b-1600fc6cfc6f-iptables-alerter-script\") pod \"iptables-alerter-mkkf8\" (UID: \"8f4f742d-de43-487c-885b-1600fc6cfc6f\") " pod="openshift-network-operator/iptables-alerter-mkkf8"
Jul 22 12:37:18.855911 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854967    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/caeba436-52ed-4fa3-9e4e-25153afdb333-multus-daemon-config\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.855911 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854982    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltvtk\" (UniqueName: \"kubernetes.io/projected/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-kube-api-access-ltvtk\") pod \"network-metrics-daemon-jvncr\" (UID: \"8b097cfe-19a9-4eee-980f-3a19a58f6d0d\") " pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:18.855911 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.854997    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-sysctl-d\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.855911 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855017    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs\") pod \"network-metrics-daemon-jvncr\" (UID: \"8b097cfe-19a9-4eee-980f-3a19a58f6d0d\") " pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:18.855911 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855036    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-run-ovn\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.855911 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855049    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-ovn-node-metrics-cert\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.855911 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855062    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-sysconfig\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.855911 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855081    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-kubernetes\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.855911 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855110    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/564b611d-b20e-44d0-9291-6d6b96855346-cnibin\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.855911 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855124    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grwmh\" (UniqueName: \"kubernetes.io/projected/564b611d-b20e-44d0-9291-6d6b96855346-kube-api-access-grwmh\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.855911 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855142    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-multus-conf-dir\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.855911 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855158    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn9q6\" (UniqueName: \"kubernetes.io/projected/caeba436-52ed-4fa3-9e4e-25153afdb333-kube-api-access-mn9q6\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.855911 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855175    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8b6bd950-92d7-4904-af50-d260db489f0f-socket-dir\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.855911 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855188    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-multus-cni-dir\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.855911 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855208    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-kubelet-config\") pod \"global-pull-secret-syncer-f5xrr\" (UID: \"053dcfaf-ab25-4783-ad4a-4aa9693b8f6c\") " pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:18.856589 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855269    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret\") pod \"global-pull-secret-syncer-f5xrr\" (UID: \"053dcfaf-ab25-4783-ad4a-4aa9693b8f6c\") " pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:18.856589 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855294    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-env-overrides\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.856589 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855313    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8b6bd950-92d7-4904-af50-d260db489f0f-socket-dir\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.856589 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855318    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-modprobe-d\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.856589 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855340    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-host-var-lib-kubelet\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.856589 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855356    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-var-lib-openvswitch\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.856589 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855369    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-etc-openvswitch\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.856589 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855384    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.856589 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855402    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-ovnkube-script-lib\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.856589 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855418    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj98t\" (UniqueName: \"kubernetes.io/projected/8b6bd950-92d7-4904-af50-d260db489f0f-kube-api-access-zj98t\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.856589 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855434    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-systemd\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.856589 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855450    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ffd5eeb-b641-4040-ba1b-14a54f34aef2-serviceca\") pod \"node-ca-br64g\" (UID: \"8ffd5eeb-b641-4040-ba1b-14a54f34aef2\") " pod="openshift-image-registry/node-ca-br64g"
Jul 22 12:37:18.856589 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855488    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mhtk\" (UniqueName: \"kubernetes.io/projected/8ffd5eeb-b641-4040-ba1b-14a54f34aef2-kube-api-access-9mhtk\") pod \"node-ca-br64g\" (UID: \"8ffd5eeb-b641-4040-ba1b-14a54f34aef2\") " pod="openshift-image-registry/node-ca-br64g"
Jul 22 12:37:18.856589 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855548    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-host-run-netns\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.856589 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855572    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aec9d056-2cee-42b8-bb4e-f333e1269945-tmp-dir\") pod \"node-resolver-bpdhv\" (UID: \"aec9d056-2cee-42b8-bb4e-f333e1269945\") " pod="openshift-dns/node-resolver-bpdhv"
Jul 22 12:37:18.856589 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855593    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a214fc4b-db41-4fd7-b2ac-59aaa1720409-agent-certs\") pod \"konnectivity-agent-kjbch\" (UID: \"a214fc4b-db41-4fd7-b2ac-59aaa1720409\") " pod="kube-system/konnectivity-agent-kjbch"
Jul 22 12:37:18.857311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855618    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8b6bd950-92d7-4904-af50-d260db489f0f-device-dir\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.857311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855655    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8b6bd950-92d7-4904-af50-d260db489f0f-device-dir\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.857311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855656    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-tuned\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.857311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855714    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/564b611d-b20e-44d0-9291-6d6b96855346-system-cni-dir\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.857311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855739    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ffd5eeb-b641-4040-ba1b-14a54f34aef2-host\") pod \"node-ca-br64g\" (UID: \"8ffd5eeb-b641-4040-ba1b-14a54f34aef2\") " pod="openshift-image-registry/node-ca-br64g"
Jul 22 12:37:18.857311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855759    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd6b7\" (UniqueName: \"kubernetes.io/projected/aec9d056-2cee-42b8-bb4e-f333e1269945-kube-api-access-kd6b7\") pod \"node-resolver-bpdhv\" (UID: \"aec9d056-2cee-42b8-bb4e-f333e1269945\") " pod="openshift-dns/node-resolver-bpdhv"
Jul 22 12:37:18.857311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855800    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-run-openvswitch\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.857311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855832    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctrzr\" (UniqueName: \"kubernetes.io/projected/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-kube-api-access-ctrzr\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.857311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855855    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/564b611d-b20e-44d0-9291-6d6b96855346-cni-binary-copy\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.857311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855877    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-host-var-lib-cni-bin\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.857311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855899    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-host-run-multus-certs\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.857311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855919    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-node-log\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.857311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855941    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-sysctl-conf\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.857311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855972    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-multus-socket-dir-parent\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.857311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.855994    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-ovnkube-config\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.865080 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:18.865055    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 12:37:18.865080 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:18.865082    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 12:37:18.865316 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:18.865095    2556 projected.go:196] Error preparing data for projected volume kube-api-access-kphd8 for pod openshift-network-diagnostics/network-check-target-cgwsm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:37:18.865316 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:18.865216    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8 podName:c5271282-15aa-43a3-9c6c-f7a482d0ad03 nodeName:}" failed. No retries permitted until 2026-07-22 12:37:19.365194591 +0000 UTC m=+2.005440830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kphd8" (UniqueName: "kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8") pod "network-check-target-cgwsm" (UID: "c5271282-15aa-43a3-9c6c-f7a482d0ad03") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:37:18.866224 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.866196    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 12:37:18.869633 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.869615    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj98t\" (UniqueName: \"kubernetes.io/projected/8b6bd950-92d7-4904-af50-d260db489f0f-kube-api-access-zj98t\") pod \"aws-ebs-csi-driver-node-9nhtx\" (UID: \"8b6bd950-92d7-4904-af50-d260db489f0f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:18.901637 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.901612    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 12:37:18.956833 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.956807    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-multus-cni-dir\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.956833 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.956837    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-kubelet-config\") pod \"global-pull-secret-syncer-f5xrr\" (UID: \"053dcfaf-ab25-4783-ad4a-4aa9693b8f6c\") " pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:18.957065 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.956860    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret\") pod \"global-pull-secret-syncer-f5xrr\" (UID: \"053dcfaf-ab25-4783-ad4a-4aa9693b8f6c\") " pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:18.957065 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.956884    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-env-overrides\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.957065 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.956940    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-modprobe-d\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.957065 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.956983    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-host-var-lib-kubelet\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.957065 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:18.956996    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 12:37:18.957065 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957009    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-var-lib-openvswitch\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.957065 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957034    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-etc-openvswitch\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.957065 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957035    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-modprobe-d\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.957065 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957049    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-multus-cni-dir\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.957065 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957056    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.957065 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:18.957075    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret podName:053dcfaf-ab25-4783-ad4a-4aa9693b8f6c nodeName:}" failed. No retries permitted until 2026-07-22 12:37:19.457053981 +0000 UTC m=+2.097300217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret") pod "global-pull-secret-syncer-f5xrr" (UID: "053dcfaf-ab25-4783-ad4a-4aa9693b8f6c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 12:37:18.957599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.956949    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-kubelet-config\") pod \"global-pull-secret-syncer-f5xrr\" (UID: \"053dcfaf-ab25-4783-ad4a-4aa9693b8f6c\") " pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:18.957599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957102    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-var-lib-openvswitch\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.957599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957116    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-ovnkube-script-lib\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.957599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957103    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.957599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957155    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-host-var-lib-kubelet\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.957599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957162    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-systemd\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.957599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957166    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-etc-openvswitch\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.957599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957187    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ffd5eeb-b641-4040-ba1b-14a54f34aef2-serviceca\") pod \"node-ca-br64g\" (UID: \"8ffd5eeb-b641-4040-ba1b-14a54f34aef2\") " pod="openshift-image-registry/node-ca-br64g"
Jul 22 12:37:18.957599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957211    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mhtk\" (UniqueName: \"kubernetes.io/projected/8ffd5eeb-b641-4040-ba1b-14a54f34aef2-kube-api-access-9mhtk\") pod \"node-ca-br64g\" (UID: \"8ffd5eeb-b641-4040-ba1b-14a54f34aef2\") " pod="openshift-image-registry/node-ca-br64g"
Jul 22 12:37:18.957599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957220    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-systemd\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.957599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957235    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-host-run-netns\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.957599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957259    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aec9d056-2cee-42b8-bb4e-f333e1269945-tmp-dir\") pod \"node-resolver-bpdhv\" (UID: \"aec9d056-2cee-42b8-bb4e-f333e1269945\") " pod="openshift-dns/node-resolver-bpdhv"
Jul 22 12:37:18.957599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957284    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a214fc4b-db41-4fd7-b2ac-59aaa1720409-agent-certs\") pod \"konnectivity-agent-kjbch\" (UID: \"a214fc4b-db41-4fd7-b2ac-59aaa1720409\") " pod="kube-system/konnectivity-agent-kjbch"
Jul 22 12:37:18.957599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957308    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-tuned\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.957599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957332    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/564b611d-b20e-44d0-9291-6d6b96855346-system-cni-dir\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.957599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957354    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ffd5eeb-b641-4040-ba1b-14a54f34aef2-host\") pod \"node-ca-br64g\" (UID: \"8ffd5eeb-b641-4040-ba1b-14a54f34aef2\") " pod="openshift-image-registry/node-ca-br64g"
Jul 22 12:37:18.957599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957375    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd6b7\" (UniqueName: \"kubernetes.io/projected/aec9d056-2cee-42b8-bb4e-f333e1269945-kube-api-access-kd6b7\") pod \"node-resolver-bpdhv\" (UID: \"aec9d056-2cee-42b8-bb4e-f333e1269945\") " pod="openshift-dns/node-resolver-bpdhv"
Jul 22 12:37:18.957599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957386    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-env-overrides\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.958451 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957398    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-run-openvswitch\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.958451 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957424    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctrzr\" (UniqueName: \"kubernetes.io/projected/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-kube-api-access-ctrzr\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.958451 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957451    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/564b611d-b20e-44d0-9291-6d6b96855346-cni-binary-copy\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.958451 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957476    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-host-var-lib-cni-bin\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.958451 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957495    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-host-run-multus-certs\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.958451 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957536    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-node-log\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.958451 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957559    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-sysctl-conf\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.958451 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957580    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-multus-socket-dir-parent\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.958451 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957613    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-ovnkube-config\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.958451 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957620    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ffd5eeb-b641-4040-ba1b-14a54f34aef2-serviceca\") pod \"node-ca-br64g\" (UID: \"8ffd5eeb-b641-4040-ba1b-14a54f34aef2\") " pod="openshift-image-registry/node-ca-br64g"
Jul 22 12:37:18.958451 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957640    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-run\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.958451 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957662    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-os-release\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.958451 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957705    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-etc-kubernetes\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.958451 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957721    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aec9d056-2cee-42b8-bb4e-f333e1269945-tmp-dir\") pod \"node-resolver-bpdhv\" (UID: \"aec9d056-2cee-42b8-bb4e-f333e1269945\") " pod="openshift-dns/node-resolver-bpdhv"
Jul 22 12:37:18.958451 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957750    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-ovnkube-script-lib\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.958451 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957758    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-run-netns\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.958451 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957782    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-host-run-netns\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.958451 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957803    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-cni-bin\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.959321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957819    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-host-var-lib-cni-bin\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.959321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957829    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-sys\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.959321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957845    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/564b611d-b20e-44d0-9291-6d6b96855346-system-cni-dir\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.959321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957853    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/564b611d-b20e-44d0-9291-6d6b96855346-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.959321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957859    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-host-run-multus-certs\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.959321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957875    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-cnibin\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.959321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957885    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ffd5eeb-b641-4040-ba1b-14a54f34aef2-host\") pod \"node-ca-br64g\" (UID: \"8ffd5eeb-b641-4040-ba1b-14a54f34aef2\") " pod="openshift-image-registry/node-ca-br64g"
Jul 22 12:37:18.959321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957900    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-node-log\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.959321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.957973    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/caeba436-52ed-4fa3-9e4e-25153afdb333-cni-binary-copy\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.959321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958001    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a214fc4b-db41-4fd7-b2ac-59aaa1720409-konnectivity-ca\") pod \"konnectivity-agent-kjbch\" (UID: \"a214fc4b-db41-4fd7-b2ac-59aaa1720409\") " pod="kube-system/konnectivity-agent-kjbch"
Jul 22 12:37:18.959321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958035    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-log-socket\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.959321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958066    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-run-netns\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.959321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958183    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/564b611d-b20e-44d0-9291-6d6b96855346-cni-binary-copy\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.959321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958158    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgqvb\" (UniqueName: \"kubernetes.io/projected/8f4f742d-de43-487c-885b-1600fc6cfc6f-kube-api-access-tgqvb\") pod \"iptables-alerter-mkkf8\" (UID: \"8f4f742d-de43-487c-885b-1600fc6cfc6f\") " pod="openshift-network-operator/iptables-alerter-mkkf8"
Jul 22 12:37:18.959321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958236    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-host-var-lib-cni-multus\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.959321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958244    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-multus-socket-dir-parent\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.959321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958263    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-dbus\") pod \"global-pull-secret-syncer-f5xrr\" (UID: \"053dcfaf-ab25-4783-ad4a-4aa9693b8f6c\") " pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:18.959321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958290    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f4f742d-de43-487c-885b-1600fc6cfc6f-host-slash\") pod \"iptables-alerter-mkkf8\" (UID: \"8f4f742d-de43-487c-885b-1600fc6cfc6f\") " pod="openshift-network-operator/iptables-alerter-mkkf8"
Jul 22 12:37:18.960235 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958310    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-cnibin\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.960235 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958320    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/564b611d-b20e-44d0-9291-6d6b96855346-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.960235 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958346    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-run-systemd\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.960235 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958372    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-run-ovn-kubernetes\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.960235 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958397    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-cni-netd\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.960235 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958413    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-ovnkube-config\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.960235 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958425    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-system-cni-dir\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.960235 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958482    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-system-cni-dir\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.960235 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958475    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-run\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.960235 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958514    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-sys\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.960235 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958519    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-run-openvswitch\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.960235 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958203    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/564b611d-b20e-44d0-9291-6d6b96855346-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.960235 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958530    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-hostroot\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.960235 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958560    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-hostroot\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.960235 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958560    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-slash\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.960235 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958590    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-slash\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.960235 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958613    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9366ceb-c6c3-4b73-a46c-b78c25651192-tmp\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.960235 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958625    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-host-var-lib-cni-multus\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.961144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958640    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/564b611d-b20e-44d0-9291-6d6b96855346-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.961144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958666    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-host-run-k8s-cni-cncf-io\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.961144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958719    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f4f742d-de43-487c-885b-1600fc6cfc6f-host-slash\") pod \"iptables-alerter-mkkf8\" (UID: \"8f4f742d-de43-487c-885b-1600fc6cfc6f\") " pod="openshift-network-operator/iptables-alerter-mkkf8"
Jul 22 12:37:18.961144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958293    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-cni-bin\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.961144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958737    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aec9d056-2cee-42b8-bb4e-f333e1269945-hosts-file\") pod \"node-resolver-bpdhv\" (UID: \"aec9d056-2cee-42b8-bb4e-f333e1269945\") " pod="openshift-dns/node-resolver-bpdhv"
Jul 22 12:37:18.961144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958761    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-kubelet\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.961144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958783    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-lib-modules\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.961144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958823    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xhs9\" (UniqueName: \"kubernetes.io/projected/e9366ceb-c6c3-4b73-a46c-b78c25651192-kube-api-access-9xhs9\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.961144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958847    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/564b611d-b20e-44d0-9291-6d6b96855346-os-release\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.961144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958870    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-systemd-units\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.961144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958882    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/caeba436-52ed-4fa3-9e4e-25153afdb333-cni-binary-copy\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.961144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958893    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-var-lib-kubelet\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.961144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958929    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-host\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.961144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958936    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-var-lib-kubelet\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.961144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958984    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-host\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.961144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959000    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-log-socket\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.961144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958036    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-sysctl-conf\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.961144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959060    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-os-release\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.961707 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959067    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aec9d056-2cee-42b8-bb4e-f333e1269945-hosts-file\") pod \"node-resolver-bpdhv\" (UID: \"aec9d056-2cee-42b8-bb4e-f333e1269945\") " pod="openshift-dns/node-resolver-bpdhv"
Jul 22 12:37:18.961707 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959100    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-kubelet\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.961707 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959112    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-etc-kubernetes\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.961707 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959180    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/564b611d-b20e-44d0-9291-6d6b96855346-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.961707 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959187    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-lib-modules\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.961707 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959238    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-run-ovn-kubernetes\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.961707 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959245    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/564b611d-b20e-44d0-9291-6d6b96855346-os-release\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.961707 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959276    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f4f742d-de43-487c-885b-1600fc6cfc6f-iptables-alerter-script\") pod \"iptables-alerter-mkkf8\" (UID: \"8f4f742d-de43-487c-885b-1600fc6cfc6f\") " pod="openshift-network-operator/iptables-alerter-mkkf8"
Jul 22 12:37:18.961707 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959287    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-host-run-k8s-cni-cncf-io\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.961707 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959304    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/caeba436-52ed-4fa3-9e4e-25153afdb333-multus-daemon-config\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.961707 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959409    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a214fc4b-db41-4fd7-b2ac-59aaa1720409-konnectivity-ca\") pod \"konnectivity-agent-kjbch\" (UID: \"a214fc4b-db41-4fd7-b2ac-59aaa1720409\") " pod="kube-system/konnectivity-agent-kjbch"
Jul 22 12:37:18.961707 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959644    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-host-cni-netd\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.961707 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.958693    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-dbus\") pod \"global-pull-secret-syncer-f5xrr\" (UID: \"053dcfaf-ab25-4783-ad4a-4aa9693b8f6c\") " pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:18.961707 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959724    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-run-systemd\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.961707 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959746    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/caeba436-52ed-4fa3-9e4e-25153afdb333-multus-daemon-config\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.961707 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959738    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/564b611d-b20e-44d0-9291-6d6b96855346-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.961707 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959948    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-systemd-units\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.962293 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.959988    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltvtk\" (UniqueName: \"kubernetes.io/projected/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-kube-api-access-ltvtk\") pod \"network-metrics-daemon-jvncr\" (UID: \"8b097cfe-19a9-4eee-980f-3a19a58f6d0d\") " pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:18.962293 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.960016    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-sysctl-d\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.962293 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.960041    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs\") pod \"network-metrics-daemon-jvncr\" (UID: \"8b097cfe-19a9-4eee-980f-3a19a58f6d0d\") " pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:18.962293 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.960065    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-run-ovn\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.962293 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.960089    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-ovn-node-metrics-cert\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.962293 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.960113    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-sysconfig\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.962293 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.960150    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-kubernetes\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.962293 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.960177    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/564b611d-b20e-44d0-9291-6d6b96855346-cnibin\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.962293 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.960202    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grwmh\" (UniqueName: \"kubernetes.io/projected/564b611d-b20e-44d0-9291-6d6b96855346-kube-api-access-grwmh\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.962293 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.960232    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-multus-conf-dir\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.962293 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.960234    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f4f742d-de43-487c-885b-1600fc6cfc6f-iptables-alerter-script\") pod \"iptables-alerter-mkkf8\" (UID: \"8f4f742d-de43-487c-885b-1600fc6cfc6f\") " pod="openshift-network-operator/iptables-alerter-mkkf8"
Jul 22 12:37:18.962293 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.960257    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn9q6\" (UniqueName: \"kubernetes.io/projected/caeba436-52ed-4fa3-9e4e-25153afdb333-kube-api-access-mn9q6\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.962293 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.960295    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-run-ovn\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.962293 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.960318    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-sysctl-d\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.962293 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.960359    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-sysconfig\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.962293 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:18.960445    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:37:18.962293 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:18.960522    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs podName:8b097cfe-19a9-4eee-980f-3a19a58f6d0d nodeName:}" failed. No retries permitted until 2026-07-22 12:37:19.46050177 +0000 UTC m=+2.100747996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs") pod "network-metrics-daemon-jvncr" (UID: "8b097cfe-19a9-4eee-980f-3a19a58f6d0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:37:18.962802 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:18.960558    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7976a83d9e3242dd32fc595d5fadaffb.slice/crio-36b09c1ae164d8301df30c356ab04b916d2718338ea30b2ae081910280b07a8f WatchSource:0}: Error finding container 36b09c1ae164d8301df30c356ab04b916d2718338ea30b2ae081910280b07a8f: Status 404 returned error can't find the container with id 36b09c1ae164d8301df30c356ab04b916d2718338ea30b2ae081910280b07a8f
Jul 22 12:37:18.962802 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.960624    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/564b611d-b20e-44d0-9291-6d6b96855346-cnibin\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.962802 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.960624    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-kubernetes\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.962802 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.960829    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e9366ceb-c6c3-4b73-a46c-b78c25651192-etc-tuned\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.962802 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.961043    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/caeba436-52ed-4fa3-9e4e-25153afdb333-multus-conf-dir\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.962802 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.961881    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9366ceb-c6c3-4b73-a46c-b78c25651192-tmp\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.962802 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.962732    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a214fc4b-db41-4fd7-b2ac-59aaa1720409-agent-certs\") pod \"konnectivity-agent-kjbch\" (UID: \"a214fc4b-db41-4fd7-b2ac-59aaa1720409\") " pod="kube-system/konnectivity-agent-kjbch"
Jul 22 12:37:18.962997 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.962862    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-ovn-node-metrics-cert\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.965251 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.965235    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 12:37:18.971141 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.971118    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd6b7\" (UniqueName: \"kubernetes.io/projected/aec9d056-2cee-42b8-bb4e-f333e1269945-kube-api-access-kd6b7\") pod \"node-resolver-bpdhv\" (UID: \"aec9d056-2cee-42b8-bb4e-f333e1269945\") " pod="openshift-dns/node-resolver-bpdhv"
Jul 22 12:37:18.973095 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.973069    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn9q6\" (UniqueName: \"kubernetes.io/projected/caeba436-52ed-4fa3-9e4e-25153afdb333-kube-api-access-mn9q6\") pod \"multus-sb677\" (UID: \"caeba436-52ed-4fa3-9e4e-25153afdb333\") " pod="openshift-multus/multus-sb677"
Jul 22 12:37:18.973221 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.973075    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xhs9\" (UniqueName: \"kubernetes.io/projected/e9366ceb-c6c3-4b73-a46c-b78c25651192-kube-api-access-9xhs9\") pod \"tuned-nww7b\" (UID: \"e9366ceb-c6c3-4b73-a46c-b78c25651192\") " pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:18.975772 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.973790    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grwmh\" (UniqueName: \"kubernetes.io/projected/564b611d-b20e-44d0-9291-6d6b96855346-kube-api-access-grwmh\") pod \"multus-additional-cni-plugins-s698q\" (UID: \"564b611d-b20e-44d0-9291-6d6b96855346\") " pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:18.975772 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.973950    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgqvb\" (UniqueName: \"kubernetes.io/projected/8f4f742d-de43-487c-885b-1600fc6cfc6f-kube-api-access-tgqvb\") pod \"iptables-alerter-mkkf8\" (UID: \"8f4f742d-de43-487c-885b-1600fc6cfc6f\") " pod="openshift-network-operator/iptables-alerter-mkkf8"
Jul 22 12:37:18.975772 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.973982    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltvtk\" (UniqueName: \"kubernetes.io/projected/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-kube-api-access-ltvtk\") pod \"network-metrics-daemon-jvncr\" (UID: \"8b097cfe-19a9-4eee-980f-3a19a58f6d0d\") " pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:18.975772 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.973980    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctrzr\" (UniqueName: \"kubernetes.io/projected/ef7c0e9e-ae44-495c-a75e-b9045efb5cdb-kube-api-access-ctrzr\") pod \"ovnkube-node-vbkcp\" (UID: \"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb\") " pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:18.975772 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.974657    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mhtk\" (UniqueName: \"kubernetes.io/projected/8ffd5eeb-b641-4040-ba1b-14a54f34aef2-kube-api-access-9mhtk\") pod \"node-ca-br64g\" (UID: \"8ffd5eeb-b641-4040-ba1b-14a54f34aef2\") " pod="openshift-image-registry/node-ca-br64g"
Jul 22 12:37:18.981115 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:18.981100    2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 12:37:19.085262 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.085184    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx"
Jul 22 12:37:19.093757 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:19.093731    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6bd950_92d7_4904_af50_d260db489f0f.slice/crio-5cb1e3ea0a40bdeb603548a32170dce510739f7fdd224c018f40c79b7d3292f3 WatchSource:0}: Error finding container 5cb1e3ea0a40bdeb603548a32170dce510739f7fdd224c018f40c79b7d3292f3: Status 404 returned error can't find the container with id 5cb1e3ea0a40bdeb603548a32170dce510739f7fdd224c018f40c79b7d3292f3
Jul 22 12:37:19.102098 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.102074    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bpdhv"
Jul 22 12:37:19.109926 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:19.109904    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaec9d056_2cee_42b8_bb4e_f333e1269945.slice/crio-6eab236c2c6243ada43c24c1cc7f549479571c7ca477f2b309653401cfa18af3 WatchSource:0}: Error finding container 6eab236c2c6243ada43c24c1cc7f549479571c7ca477f2b309653401cfa18af3: Status 404 returned error can't find the container with id 6eab236c2c6243ada43c24c1cc7f549479571c7ca477f2b309653401cfa18af3
Jul 22 12:37:19.121054 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.121035    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nww7b"
Jul 22 12:37:19.128363 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:19.128341    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9366ceb_c6c3_4b73_a46c_b78c25651192.slice/crio-7ff6934ef332c9a5a195f51b9a5d86232c88fe017e968a81d85a520bf7920f8b WatchSource:0}: Error finding container 7ff6934ef332c9a5a195f51b9a5d86232c88fe017e968a81d85a520bf7920f8b: Status 404 returned error can't find the container with id 7ff6934ef332c9a5a195f51b9a5d86232c88fe017e968a81d85a520bf7920f8b
Jul 22 12:37:19.133763 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.133745    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mkkf8"
Jul 22 12:37:19.140851 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:19.140829    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f4f742d_de43_487c_885b_1600fc6cfc6f.slice/crio-65254f5d1a2cabb851991d8d7bcc2ef77274349121e42203eb46a11cb4f41dd1 WatchSource:0}: Error finding container 65254f5d1a2cabb851991d8d7bcc2ef77274349121e42203eb46a11cb4f41dd1: Status 404 returned error can't find the container with id 65254f5d1a2cabb851991d8d7bcc2ef77274349121e42203eb46a11cb4f41dd1
Jul 22 12:37:19.149765 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.149744    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s698q"
Jul 22 12:37:19.157670 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:19.157648    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod564b611d_b20e_44d0_9291_6d6b96855346.slice/crio-59da7801a8b360871d4de8501144e4a93342d8091de9997ac1414e345dddd3bc WatchSource:0}: Error finding container 59da7801a8b360871d4de8501144e4a93342d8091de9997ac1414e345dddd3bc: Status 404 returned error can't find the container with id 59da7801a8b360871d4de8501144e4a93342d8091de9997ac1414e345dddd3bc
Jul 22 12:37:19.166898 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.166876    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-br64g"
Jul 22 12:37:19.174922 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:19.174898    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ffd5eeb_b641_4040_ba1b_14a54f34aef2.slice/crio-5a08d0ffc4096c5b68902e85d19bc76c2d4b4801491ec7cd6ebef0eb9b8c6630 WatchSource:0}: Error finding container 5a08d0ffc4096c5b68902e85d19bc76c2d4b4801491ec7cd6ebef0eb9b8c6630: Status 404 returned error can't find the container with id 5a08d0ffc4096c5b68902e85d19bc76c2d4b4801491ec7cd6ebef0eb9b8c6630
Jul 22 12:37:19.188721 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.188700    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sb677"
Jul 22 12:37:19.195753 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:19.195723    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaeba436_52ed_4fa3_9e4e_25153afdb333.slice/crio-a9fd3340b1d8319e9a5de26d41b7fc69200210b676c74c086e15fcf3f0aeb487 WatchSource:0}: Error finding container a9fd3340b1d8319e9a5de26d41b7fc69200210b676c74c086e15fcf3f0aeb487: Status 404 returned error can't find the container with id a9fd3340b1d8319e9a5de26d41b7fc69200210b676c74c086e15fcf3f0aeb487
Jul 22 12:37:19.204351 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.204329    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kjbch"
Jul 22 12:37:19.209057 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.208965    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:19.211457 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:19.211435    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda214fc4b_db41_4fd7_b2ac_59aaa1720409.slice/crio-b9ec7ffdaf86648f492efdd61ead788efd9abf87e88a36ea764493c835e2d336 WatchSource:0}: Error finding container b9ec7ffdaf86648f492efdd61ead788efd9abf87e88a36ea764493c835e2d336: Status 404 returned error can't find the container with id b9ec7ffdaf86648f492efdd61ead788efd9abf87e88a36ea764493c835e2d336
Jul 22 12:37:19.222739 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:19.222718    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7c0e9e_ae44_495c_a75e_b9045efb5cdb.slice/crio-cefcf84f621f6b53db57b4b32b560513cbe275298e58e446e06532b3a9aa1420 WatchSource:0}: Error finding container cefcf84f621f6b53db57b4b32b560513cbe275298e58e446e06532b3a9aa1420: Status 404 returned error can't find the container with id cefcf84f621f6b53db57b4b32b560513cbe275298e58e446e06532b3a9aa1420
Jul 22 12:37:19.224146 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:19.224102    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8d43111888f079a9689a4d2f852443.slice/crio-bfa3f9b538d49bfe44a480ba2342bf3f5b36b041e4de1d7d693e280b3bd86d20 WatchSource:0}: Error finding container bfa3f9b538d49bfe44a480ba2342bf3f5b36b041e4de1d7d693e280b3bd86d20: Status 404 returned error can't find the container with id bfa3f9b538d49bfe44a480ba2342bf3f5b36b041e4de1d7d693e280b3bd86d20
Jul 22 12:37:19.463246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.463149    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kphd8\" (UniqueName: \"kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8\") pod \"network-check-target-cgwsm\" (UID: \"c5271282-15aa-43a3-9c6c-f7a482d0ad03\") " pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:19.463246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.463196    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs\") pod \"network-metrics-daemon-jvncr\" (UID: \"8b097cfe-19a9-4eee-980f-3a19a58f6d0d\") " pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:19.463246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.463224    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret\") pod \"global-pull-secret-syncer-f5xrr\" (UID: \"053dcfaf-ab25-4783-ad4a-4aa9693b8f6c\") " pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:19.463507 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:19.463326    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 12:37:19.463507 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:19.463338    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:37:19.463507 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:19.463336    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 12:37:19.463507 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:19.463364    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 12:37:19.463507 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:19.463379    2556 projected.go:196] Error preparing data for projected volume kube-api-access-kphd8 for pod openshift-network-diagnostics/network-check-target-cgwsm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:37:19.463507 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:19.463396    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret podName:053dcfaf-ab25-4783-ad4a-4aa9693b8f6c nodeName:}" failed. No retries permitted until 2026-07-22 12:37:20.463375804 +0000 UTC m=+3.103622024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret") pod "global-pull-secret-syncer-f5xrr" (UID: "053dcfaf-ab25-4783-ad4a-4aa9693b8f6c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 12:37:19.463507 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:19.463414    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs podName:8b097cfe-19a9-4eee-980f-3a19a58f6d0d nodeName:}" failed. No retries permitted until 2026-07-22 12:37:20.463405543 +0000 UTC m=+3.103651765 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs") pod "network-metrics-daemon-jvncr" (UID: "8b097cfe-19a9-4eee-980f-3a19a58f6d0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:37:19.463507 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:19.463432    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8 podName:c5271282-15aa-43a3-9c6c-f7a482d0ad03 nodeName:}" failed. No retries permitted until 2026-07-22 12:37:20.46342305 +0000 UTC m=+3.103669272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kphd8" (UniqueName: "kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8") pod "network-check-target-cgwsm" (UID: "c5271282-15aa-43a3-9c6c-f7a482d0ad03") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:37:19.712700 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.712653    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 12:37:19.797823 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.797660    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 12:32:18 +0000 UTC" deadline="2028-04-13 14:35:43.859041764 +0000 UTC"
Jul 22 12:37:19.797823 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.797734    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15145h58m24.061311919s"
Jul 22 12:37:19.899315 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.898322    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:19.899315 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:19.898459    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:19.899315 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.898881    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:19.899315 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:19.898985    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:19.899315 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.899057    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:19.899315 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:19.899128    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgwsm" podUID="c5271282-15aa-43a3-9c6c-f7a482d0ad03"
Jul 22 12:37:19.908531 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.908481    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bpdhv" event={"ID":"aec9d056-2cee-42b8-bb4e-f333e1269945","Type":"ContainerStarted","Data":"6eab236c2c6243ada43c24c1cc7f549479571c7ca477f2b309653401cfa18af3"}
Jul 22 12:37:19.911995 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.911915    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-160.ec2.internal" event={"ID":"7976a83d9e3242dd32fc595d5fadaffb","Type":"ContainerStarted","Data":"36b09c1ae164d8301df30c356ab04b916d2718338ea30b2ae081910280b07a8f"}
Jul 22 12:37:19.913742 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.913600    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kjbch" event={"ID":"a214fc4b-db41-4fd7-b2ac-59aaa1720409","Type":"ContainerStarted","Data":"b9ec7ffdaf86648f492efdd61ead788efd9abf87e88a36ea764493c835e2d336"}
Jul 22 12:37:19.920211 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.920127    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sb677" event={"ID":"caeba436-52ed-4fa3-9e4e-25153afdb333","Type":"ContainerStarted","Data":"a9fd3340b1d8319e9a5de26d41b7fc69200210b676c74c086e15fcf3f0aeb487"}
Jul 22 12:37:19.923862 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.923722    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-br64g" event={"ID":"8ffd5eeb-b641-4040-ba1b-14a54f34aef2","Type":"ContainerStarted","Data":"5a08d0ffc4096c5b68902e85d19bc76c2d4b4801491ec7cd6ebef0eb9b8c6630"}
Jul 22 12:37:19.928719 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.928592    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s698q" event={"ID":"564b611d-b20e-44d0-9291-6d6b96855346","Type":"ContainerStarted","Data":"59da7801a8b360871d4de8501144e4a93342d8091de9997ac1414e345dddd3bc"}
Jul 22 12:37:19.936424 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.936394    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nww7b" event={"ID":"e9366ceb-c6c3-4b73-a46c-b78c25651192","Type":"ContainerStarted","Data":"7ff6934ef332c9a5a195f51b9a5d86232c88fe017e968a81d85a520bf7920f8b"}
Jul 22 12:37:19.942122 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.942085    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx" event={"ID":"8b6bd950-92d7-4904-af50-d260db489f0f","Type":"ContainerStarted","Data":"5cb1e3ea0a40bdeb603548a32170dce510739f7fdd224c018f40c79b7d3292f3"}
Jul 22 12:37:19.945125 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.945100    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal" event={"ID":"0c8d43111888f079a9689a4d2f852443","Type":"ContainerStarted","Data":"bfa3f9b538d49bfe44a480ba2342bf3f5b36b041e4de1d7d693e280b3bd86d20"}
Jul 22 12:37:19.950624 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.950599    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp" event={"ID":"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb","Type":"ContainerStarted","Data":"cefcf84f621f6b53db57b4b32b560513cbe275298e58e446e06532b3a9aa1420"}
Jul 22 12:37:19.971591 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:19.971535    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mkkf8" event={"ID":"8f4f742d-de43-487c-885b-1600fc6cfc6f","Type":"ContainerStarted","Data":"65254f5d1a2cabb851991d8d7bcc2ef77274349121e42203eb46a11cb4f41dd1"}
Jul 22 12:37:20.473749 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:20.473702    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs\") pod \"network-metrics-daemon-jvncr\" (UID: \"8b097cfe-19a9-4eee-980f-3a19a58f6d0d\") " pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:20.473941 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:20.473761    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret\") pod \"global-pull-secret-syncer-f5xrr\" (UID: \"053dcfaf-ab25-4783-ad4a-4aa9693b8f6c\") " pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:20.473941 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:20.473827    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kphd8\" (UniqueName: \"kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8\") pod \"network-check-target-cgwsm\" (UID: \"c5271282-15aa-43a3-9c6c-f7a482d0ad03\") " pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:20.474052 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:20.473974    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 12:37:20.474052 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:20.473991    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 12:37:20.474052 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:20.474004    2556 projected.go:196] Error preparing data for projected volume kube-api-access-kphd8 for pod openshift-network-diagnostics/network-check-target-cgwsm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:37:20.474204 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:20.474064    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8 podName:c5271282-15aa-43a3-9c6c-f7a482d0ad03 nodeName:}" failed. No retries permitted until 2026-07-22 12:37:22.474044233 +0000 UTC m=+5.114290475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kphd8" (UniqueName: "kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8") pod "network-check-target-cgwsm" (UID: "c5271282-15aa-43a3-9c6c-f7a482d0ad03") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:37:20.474499 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:20.474477    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:37:20.474613 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:20.474534    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs podName:8b097cfe-19a9-4eee-980f-3a19a58f6d0d nodeName:}" failed. No retries permitted until 2026-07-22 12:37:22.474519551 +0000 UTC m=+5.114765773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs") pod "network-metrics-daemon-jvncr" (UID: "8b097cfe-19a9-4eee-980f-3a19a58f6d0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:37:20.474613 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:20.474595    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 12:37:20.474776 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:20.474640    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret podName:053dcfaf-ab25-4783-ad4a-4aa9693b8f6c nodeName:}" failed. No retries permitted until 2026-07-22 12:37:22.474629153 +0000 UTC m=+5.114875375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret") pod "global-pull-secret-syncer-f5xrr" (UID: "053dcfaf-ab25-4783-ad4a-4aa9693b8f6c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 12:37:20.730338 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:20.730256    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 12:37:20.798385 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:20.798337    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 12:32:18 +0000 UTC" deadline="2028-02-13 03:15:36.467062571 +0000 UTC"
Jul 22 12:37:20.798385 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:20.798376    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13694h38m15.668691045s"
Jul 22 12:37:21.899938 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:21.899052    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:21.899938 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:21.899179    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgwsm" podUID="c5271282-15aa-43a3-9c6c-f7a482d0ad03"
Jul 22 12:37:21.899938 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:21.899593    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:21.899938 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:21.899712    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:21.899938 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:21.899775    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:21.899938 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:21.899849    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:22.493869 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:22.493832    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kphd8\" (UniqueName: \"kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8\") pod \"network-check-target-cgwsm\" (UID: \"c5271282-15aa-43a3-9c6c-f7a482d0ad03\") " pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:22.494059 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:22.493887    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs\") pod \"network-metrics-daemon-jvncr\" (UID: \"8b097cfe-19a9-4eee-980f-3a19a58f6d0d\") " pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:22.494059 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:22.493917    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret\") pod \"global-pull-secret-syncer-f5xrr\" (UID: \"053dcfaf-ab25-4783-ad4a-4aa9693b8f6c\") " pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:22.494176 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:22.494059    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 12:37:22.494176 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:22.494122    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret podName:053dcfaf-ab25-4783-ad4a-4aa9693b8f6c nodeName:}" failed. No retries permitted until 2026-07-22 12:37:26.494098691 +0000 UTC m=+9.134344911 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret") pod "global-pull-secret-syncer-f5xrr" (UID: "053dcfaf-ab25-4783-ad4a-4aa9693b8f6c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 12:37:22.494543 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:22.494519    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 12:37:22.494543 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:22.494545    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 12:37:22.494738 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:22.494557    2556 projected.go:196] Error preparing data for projected volume kube-api-access-kphd8 for pod openshift-network-diagnostics/network-check-target-cgwsm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:37:22.494738 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:22.494600    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8 podName:c5271282-15aa-43a3-9c6c-f7a482d0ad03 nodeName:}" failed. No retries permitted until 2026-07-22 12:37:26.494585645 +0000 UTC m=+9.134831864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kphd8" (UniqueName: "kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8") pod "network-check-target-cgwsm" (UID: "c5271282-15aa-43a3-9c6c-f7a482d0ad03") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:37:22.494738 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:22.494664    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:37:22.494738 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:22.494716    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs podName:8b097cfe-19a9-4eee-980f-3a19a58f6d0d nodeName:}" failed. No retries permitted until 2026-07-22 12:37:26.49470344 +0000 UTC m=+9.134949667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs") pod "network-metrics-daemon-jvncr" (UID: "8b097cfe-19a9-4eee-980f-3a19a58f6d0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:37:23.898122 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:23.897365    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:23.898122 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:23.897371    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:23.898122 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:23.897643    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:23.898122 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:23.897498    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgwsm" podUID="c5271282-15aa-43a3-9c6c-f7a482d0ad03"
Jul 22 12:37:23.898122 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:23.897798    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:23.898122 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:23.897876    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:25.896295 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:25.896261    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:25.896757 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:25.896378    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:25.896757 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:25.896393    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:25.896757 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:25.896485    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgwsm" podUID="c5271282-15aa-43a3-9c6c-f7a482d0ad03"
Jul 22 12:37:25.896757 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:25.896262    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:25.896757 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:25.896587    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:26.528969 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:26.528917    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kphd8\" (UniqueName: \"kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8\") pod \"network-check-target-cgwsm\" (UID: \"c5271282-15aa-43a3-9c6c-f7a482d0ad03\") " pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:26.529201 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:26.528979    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs\") pod \"network-metrics-daemon-jvncr\" (UID: \"8b097cfe-19a9-4eee-980f-3a19a58f6d0d\") " pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:26.529201 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:26.529012    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret\") pod \"global-pull-secret-syncer-f5xrr\" (UID: \"053dcfaf-ab25-4783-ad4a-4aa9693b8f6c\") " pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:26.529201 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:26.529138    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 12:37:26.529201 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:26.529201    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret podName:053dcfaf-ab25-4783-ad4a-4aa9693b8f6c nodeName:}" failed. No retries permitted until 2026-07-22 12:37:34.529181283 +0000 UTC m=+17.169427504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret") pod "global-pull-secret-syncer-f5xrr" (UID: "053dcfaf-ab25-4783-ad4a-4aa9693b8f6c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 12:37:26.529630 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:26.529600    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 12:37:26.529630 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:26.529624    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 12:37:26.529814 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:26.529637    2556 projected.go:196] Error preparing data for projected volume kube-api-access-kphd8 for pod openshift-network-diagnostics/network-check-target-cgwsm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:37:26.529814 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:26.529766    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:37:26.529895 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:26.529862    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8 podName:c5271282-15aa-43a3-9c6c-f7a482d0ad03 nodeName:}" failed. No retries permitted until 2026-07-22 12:37:34.529667245 +0000 UTC m=+17.169913469 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kphd8" (UniqueName: "kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8") pod "network-check-target-cgwsm" (UID: "c5271282-15aa-43a3-9c6c-f7a482d0ad03") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:37:26.529895 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:26.529885    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs podName:8b097cfe-19a9-4eee-980f-3a19a58f6d0d nodeName:}" failed. No retries permitted until 2026-07-22 12:37:34.529872669 +0000 UTC m=+17.170118895 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs") pod "network-metrics-daemon-jvncr" (UID: "8b097cfe-19a9-4eee-980f-3a19a58f6d0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:37:27.897206 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:27.897174    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:27.897585 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:27.897281    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgwsm" podUID="c5271282-15aa-43a3-9c6c-f7a482d0ad03"
Jul 22 12:37:27.897731 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:27.897714    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:27.897848 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:27.897824    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:27.897912 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:27.897899    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:27.897989 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:27.897973    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:29.896627 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:29.896591    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:29.896627 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:29.896604    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:29.896627 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:29.896591    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:29.897185 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:29.896726    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:29.897185 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:29.896765    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgwsm" podUID="c5271282-15aa-43a3-9c6c-f7a482d0ad03"
Jul 22 12:37:29.897185 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:29.896850    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:31.896434 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:31.896397    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:31.896884 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:31.896443    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:31.896884 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:31.896397    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:31.896884 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:31.896530    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:31.896884 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:31.896619    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgwsm" podUID="c5271282-15aa-43a3-9c6c-f7a482d0ad03"
Jul 22 12:37:31.896884 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:31.896718    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:33.896434 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:33.895658    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:33.896434 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:33.895798    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:33.896434 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:33.896201    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:33.896434 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:33.896294    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:33.896434 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:33.896348    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:33.896434 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:33.896401    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgwsm" podUID="c5271282-15aa-43a3-9c6c-f7a482d0ad03"
Jul 22 12:37:34.589105 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:34.589068    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kphd8\" (UniqueName: \"kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8\") pod \"network-check-target-cgwsm\" (UID: \"c5271282-15aa-43a3-9c6c-f7a482d0ad03\") " pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:34.589105 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:34.589110    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs\") pod \"network-metrics-daemon-jvncr\" (UID: \"8b097cfe-19a9-4eee-980f-3a19a58f6d0d\") " pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:34.589360 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:34.589139    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret\") pod \"global-pull-secret-syncer-f5xrr\" (UID: \"053dcfaf-ab25-4783-ad4a-4aa9693b8f6c\") " pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:34.589360 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:34.589230    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:37:34.589360 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:34.589247    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 12:37:34.589360 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:34.589275    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 12:37:34.589360 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:34.589288    2556 projected.go:196] Error preparing data for projected volume kube-api-access-kphd8 for pod openshift-network-diagnostics/network-check-target-cgwsm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:37:34.589360 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:34.589315    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 12:37:34.589360 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:34.589289    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs podName:8b097cfe-19a9-4eee-980f-3a19a58f6d0d nodeName:}" failed. No retries permitted until 2026-07-22 12:37:50.589269963 +0000 UTC m=+33.229516198 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs") pod "network-metrics-daemon-jvncr" (UID: "8b097cfe-19a9-4eee-980f-3a19a58f6d0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:37:34.589360 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:34.589353    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8 podName:c5271282-15aa-43a3-9c6c-f7a482d0ad03 nodeName:}" failed. No retries permitted until 2026-07-22 12:37:50.58933637 +0000 UTC m=+33.229582604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kphd8" (UniqueName: "kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8") pod "network-check-target-cgwsm" (UID: "c5271282-15aa-43a3-9c6c-f7a482d0ad03") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:37:34.589695 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:34.589374    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret podName:053dcfaf-ab25-4783-ad4a-4aa9693b8f6c nodeName:}" failed. No retries permitted until 2026-07-22 12:37:50.589363972 +0000 UTC m=+33.229610198 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret") pod "global-pull-secret-syncer-f5xrr" (UID: "053dcfaf-ab25-4783-ad4a-4aa9693b8f6c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 12:37:35.896061 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:35.896020    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:35.896575 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:35.896160    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:35.896575 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:35.896020    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:35.896575 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:35.896252    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:35.896575 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:35.896288    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:35.896575 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:35.896385    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgwsm" podUID="c5271282-15aa-43a3-9c6c-f7a482d0ad03"
Jul 22 12:37:37.897385 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:37.897350    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:37.897867 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:37.897461    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:37.897867 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:37.897472    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:37.897867 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:37.897564    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:37.897867 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:37.897619    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:37.897867 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:37.897741    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgwsm" podUID="c5271282-15aa-43a3-9c6c-f7a482d0ad03"
Jul 22 12:37:39.896620 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:39.896594    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:39.896925 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:39.896625    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:39.896925 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:39.896594    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:39.896925 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:39.896730    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:39.896925 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:39.896797    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:39.896925 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:39.896868    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgwsm" podUID="c5271282-15aa-43a3-9c6c-f7a482d0ad03"
Jul 22 12:37:41.026508 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:41.026219    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 12:37:41.027056 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:41.026971    2556 generic.go:356] "Generic (PLEG): container finished" podID="ef7c0e9e-ae44-495c-a75e-b9045efb5cdb" containerID="0e3d22d52f33ff2ad682abca122934e3ac09f8b529e31055bc608d942e3fe3a4" exitCode=1
Jul 22 12:37:41.027056 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:41.027008    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp" event={"ID":"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb","Type":"ContainerStarted","Data":"de87f859699e618bbca2bc34397de034290667a612d619b0dda3c36e4745d4d9"}
Jul 22 12:37:41.027338 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:41.027314    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp" event={"ID":"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb","Type":"ContainerStarted","Data":"df195043c386affab0a7ed9e86cb9c321af5026d0148f3bd42ca0c04e413de2d"}
Jul 22 12:37:41.027445 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:41.027374    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp" event={"ID":"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb","Type":"ContainerStarted","Data":"146b7c13a17393735af742e924323636f84e2bc86639903c476343c787674a44"}
Jul 22 12:37:41.027445 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:41.027426    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp" event={"ID":"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb","Type":"ContainerStarted","Data":"549ae5bdb6a86236c2f6444f269349ea9268d49ad0b3b99456bea7fd4ba21b82"}
Jul 22 12:37:41.027542 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:41.027479    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp" event={"ID":"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb","Type":"ContainerDied","Data":"0e3d22d52f33ff2ad682abca122934e3ac09f8b529e31055bc608d942e3fe3a4"}
Jul 22 12:37:41.027542 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:41.027534    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp" event={"ID":"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb","Type":"ContainerStarted","Data":"d3289cb263208c0f1f144da3d5a2dbcaabce756fe15079d627f4adeb0795ac77"}
Jul 22 12:37:41.028847 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:41.028821    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-160.ec2.internal" event={"ID":"7976a83d9e3242dd32fc595d5fadaffb","Type":"ContainerStarted","Data":"12766b2ce1578d783a82706b1f718b5ab7c9b7d85a5609d1c908622dd9ae2f7e"}
Jul 22 12:37:41.030387 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:41.030363    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sb677" event={"ID":"caeba436-52ed-4fa3-9e4e-25153afdb333","Type":"ContainerStarted","Data":"a780e5829d92cf3547bbfa919d29f3a395f715101ee87f15c8d828d595089eed"}
Jul 22 12:37:41.032174 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:41.032153    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nww7b" event={"ID":"e9366ceb-c6c3-4b73-a46c-b78c25651192","Type":"ContainerStarted","Data":"9db4c9d91b61cbbcb75b29f956584842d12511fbde930d7fba73fadb810d13af"}
Jul 22 12:37:41.044427 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:41.044386    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-160.ec2.internal" podStartSLOduration=23.04437301 podStartE2EDuration="23.04437301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:37:41.043863131 +0000 UTC m=+23.684109390" watchObservedRunningTime="2026-07-22 12:37:41.04437301 +0000 UTC m=+23.684619252"
Jul 22 12:37:41.080004 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:41.079511    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nww7b" podStartSLOduration=3.107556313 podStartE2EDuration="24.079491183s" totalImagesPullingTime="20.97193487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:37:41.061520146 +0000 UTC m=+23.701766388" watchObservedRunningTime="2026-07-22 12:37:41.079491183 +0000 UTC m=+23.719737425"
Jul 22 12:37:41.080558 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:41.080519    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sb677" podStartSLOduration=2.1747457629999998 podStartE2EDuration="23.080504337s" totalImagesPullingTime="20.905758574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:37:41.079046308 +0000 UTC m=+23.719292573" watchObservedRunningTime="2026-07-22 12:37:41.080504337 +0000 UTC m=+23.720750579"
Jul 22 12:37:41.896015 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:41.895979    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:41.896246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:41.895982    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:41.896246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:41.896146    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:41.896246 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:41.896136    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:41.896381 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:41.896258    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:41.896381 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:41.896326    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgwsm" podUID="c5271282-15aa-43a3-9c6c-f7a482d0ad03"
Jul 22 12:37:42.035356 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.035318    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kjbch" event={"ID":"a214fc4b-db41-4fd7-b2ac-59aaa1720409","Type":"ContainerStarted","Data":"0eeab833b87c5f7f0ee18593afc80893022ea8dd5b6be187c0ff3d8180f32491"}
Jul 22 12:37:42.036812 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.036789    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-br64g" event={"ID":"8ffd5eeb-b641-4040-ba1b-14a54f34aef2","Type":"ContainerStarted","Data":"960caa475d36980a1349227eac411f2517c2e8cf6a09c1a42d8637a895ef2329"}
Jul 22 12:37:42.038236 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.038215    2556 generic.go:356] "Generic (PLEG): container finished" podID="564b611d-b20e-44d0-9291-6d6b96855346" containerID="219dfcc260c0f17e80bd067c3d53d06f0b2fd50048d40703d5ad6a9073727b1f" exitCode=0
Jul 22 12:37:42.038323 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.038300    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s698q" event={"ID":"564b611d-b20e-44d0-9291-6d6b96855346","Type":"ContainerDied","Data":"219dfcc260c0f17e80bd067c3d53d06f0b2fd50048d40703d5ad6a9073727b1f"}
Jul 22 12:37:42.039937 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.039920    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx" event={"ID":"8b6bd950-92d7-4904-af50-d260db489f0f","Type":"ContainerStarted","Data":"d0ccf84ae8d7dd959dbb189d8bf066a0acb55b82af0db5a4762d72144c045dcd"}
Jul 22 12:37:42.042448 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.042076    2556 generic.go:356] "Generic (PLEG): container finished" podID="0c8d43111888f079a9689a4d2f852443" containerID="76be20aa0faf5b216d5e75a38044c95e4613f5e31c7ce1e46acad09d188c4b35" exitCode=0
Jul 22 12:37:42.042448 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.042158    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal" event={"ID":"0c8d43111888f079a9689a4d2f852443","Type":"ContainerDied","Data":"76be20aa0faf5b216d5e75a38044c95e4613f5e31c7ce1e46acad09d188c4b35"}
Jul 22 12:37:42.044328 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.044304    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mkkf8" event={"ID":"8f4f742d-de43-487c-885b-1600fc6cfc6f","Type":"ContainerStarted","Data":"2edaf67c15848019fa838beeb9431022b3ab6c9a9517c172040a069f7b24c588"}
Jul 22 12:37:42.046186 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.046168    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bpdhv" event={"ID":"aec9d056-2cee-42b8-bb4e-f333e1269945","Type":"ContainerStarted","Data":"e860dc0e1cc9dd29736ee8dadd32933e246a4794b9cbac291938869bea6e93fa"}
Jul 22 12:37:42.052925 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.052881    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kjbch" podStartSLOduration=3.378846895 podStartE2EDuration="24.052868267s" totalImagesPullingTime="20.674021372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:37:42.052108478 +0000 UTC m=+24.692354718" watchObservedRunningTime="2026-07-22 12:37:42.052868267 +0000 UTC m=+24.693114507"
Jul 22 12:37:42.080756 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.080709    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bpdhv" podStartSLOduration=4.088923971 podStartE2EDuration="25.080695123s" totalImagesPullingTime="20.991771152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:37:42.080570372 +0000 UTC m=+24.720816643" watchObservedRunningTime="2026-07-22 12:37:42.080695123 +0000 UTC m=+24.720941356"
Jul 22 12:37:42.117567 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.117524    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mkkf8" podStartSLOduration=4.326392949 podStartE2EDuration="25.117509874s" totalImagesPullingTime="20.791116925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:37:42.095389107 +0000 UTC m=+24.735635347" watchObservedRunningTime="2026-07-22 12:37:42.117509874 +0000 UTC m=+24.757756153"
Jul 22 12:37:42.131794 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.131711    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-br64g" podStartSLOduration=3.374720158 podStartE2EDuration="24.131694015s" totalImagesPullingTime="20.756973857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:37:42.131626174 +0000 UTC m=+24.771872427" watchObservedRunningTime="2026-07-22 12:37:42.131694015 +0000 UTC m=+24.771940251"
Jul 22 12:37:42.263313 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.263136    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjbch_a214fc4b-db41-4fd7-b2ac-59aaa1720409/konnectivity-agent/0.log" limit=1024
Jul 22 12:37:42.327846 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.327822    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjbch_a214fc4b-db41-4fd7-b2ac-59aaa1720409/konnectivity-agent/0.log" limit=1024
Jul 22 12:37:42.577296 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.577274    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 12:37:42.832607 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.832486    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T12:37:42.577292635Z","UUID":"d357df4b-697a-45b1-8dfc-63528a7c7d3a","Handler":null,"Name":"","Endpoint":""}
Jul 22 12:37:42.833845 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.833826    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 12:37:42.833983 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:42.833853    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 12:37:43.051068 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:43.051034    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx" event={"ID":"8b6bd950-92d7-4904-af50-d260db489f0f","Type":"ContainerStarted","Data":"40444cf9b7c6cd41fbafabd32c8498379ceb8914ab5947f6c6fc202afb70ed40"}
Jul 22 12:37:43.053048 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:43.053022    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal" event={"ID":"0c8d43111888f079a9689a4d2f852443","Type":"ContainerStarted","Data":"5577434d27fc420fce7ff9e5ee17275ca4eca24e2fed4a7c6aa40932e52bf507"}
Jul 22 12:37:43.068697 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:43.068638    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-160.ec2.internal" podStartSLOduration=25.068626479 podStartE2EDuration="25.068626479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:37:43.06856836 +0000 UTC m=+25.708814619" watchObservedRunningTime="2026-07-22 12:37:43.068626479 +0000 UTC m=+25.708872720"
Jul 22 12:37:43.214409 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:43.214312    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kjbch"
Jul 22 12:37:43.896224 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:43.896198    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:43.896417 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:43.896312    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:43.896417 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:43.896206    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:43.896417 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:43.896380    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:43.896417 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:43.896199    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:43.896637 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:43.896433    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgwsm" podUID="c5271282-15aa-43a3-9c6c-f7a482d0ad03"
Jul 22 12:37:44.057544 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:44.057461    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx" event={"ID":"8b6bd950-92d7-4904-af50-d260db489f0f","Type":"ContainerStarted","Data":"f2fd7f437c6d90f48d0154ffea7619c66e5052ac1bbea57d088fcffaa46e3a41"}
Jul 22 12:37:44.060846 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:44.060826    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 12:37:44.061999 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:44.061974    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp" event={"ID":"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb","Type":"ContainerStarted","Data":"342aaad67bc320c7c073a154e0578e7d6329de59e5c70bf2f478cfe2843be6ee"}
Jul 22 12:37:44.076615 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:44.076560    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9nhtx" podStartSLOduration=3.873525829 podStartE2EDuration="27.076541828s" totalImagesPullingTime="23.203015999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:37:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:37:44.076285506 +0000 UTC m=+26.716531772" watchObservedRunningTime="2026-07-22 12:37:44.076541828 +0000 UTC m=+26.716788067"
Jul 22 12:37:45.453243 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:45.453210    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kjbch"
Jul 22 12:37:45.453950 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:45.453930    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kjbch"
Jul 22 12:37:45.896537 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:45.896508    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:45.896726 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:45.896635    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:45.896726 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:45.896507    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:45.896860 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:45.896745    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgwsm" podUID="c5271282-15aa-43a3-9c6c-f7a482d0ad03"
Jul 22 12:37:45.896860 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:45.896508    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:45.896860 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:45.896832    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:46.070087 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:46.070060    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 12:37:46.070581 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:46.070540    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp" event={"ID":"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb","Type":"ContainerStarted","Data":"43e52d5650a692e6ea8d7d7aa86ee1b866d82b85e89010041e297b80d14e1b53"}
Jul 22 12:37:46.071204 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:46.071184    2556 scope.go:117] "RemoveContainer" containerID="0e3d22d52f33ff2ad682abca122934e3ac09f8b529e31055bc608d942e3fe3a4"
Jul 22 12:37:46.071353 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:46.071336    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kjbch"
Jul 22 12:37:46.161666 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:46.161634    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjbch_a214fc4b-db41-4fd7-b2ac-59aaa1720409/konnectivity-agent/0.log" limit=1024
Jul 22 12:37:47.552968 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:47.552795    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f5xrr"]
Jul 22 12:37:47.553600 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:47.553027    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:47.553600 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:47.553108    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:47.571397 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:47.571367    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jvncr"]
Jul 22 12:37:47.571527 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:47.571481    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:47.571619 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:47.571599    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:47.571983 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:47.571964    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cgwsm"]
Jul 22 12:37:47.572059 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:47.572046    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:47.572132 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:47.572116    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgwsm" podUID="c5271282-15aa-43a3-9c6c-f7a482d0ad03"
Jul 22 12:37:48.077297 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:48.077260    2556 generic.go:356] "Generic (PLEG): container finished" podID="564b611d-b20e-44d0-9291-6d6b96855346" containerID="eb0f310dc23116df68a8d24cc49b544f52c87c89080d5502adeaf3b67aa3dd29" exitCode=0
Jul 22 12:37:48.077547 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:48.077355    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s698q" event={"ID":"564b611d-b20e-44d0-9291-6d6b96855346","Type":"ContainerDied","Data":"eb0f310dc23116df68a8d24cc49b544f52c87c89080d5502adeaf3b67aa3dd29"}
Jul 22 12:37:48.081128 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:48.081111    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 12:37:48.081434 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:48.081413    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp" event={"ID":"ef7c0e9e-ae44-495c-a75e-b9045efb5cdb","Type":"ContainerStarted","Data":"419379a46a8779c565955f317cf7050728f673f52c97e8f1cc0a41056d380737"}
Jul 22 12:37:48.081648 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:48.081636    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:48.081715 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:48.081697    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:48.081769 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:48.081746    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:48.098022 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:48.098004    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:48.098146 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:48.098134    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:37:48.130247 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:48.130197    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp" podStartSLOduration=9.250967142 podStartE2EDuration="30.130182359s" totalImagesPullingTime="20.879215217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:37:48.129945082 +0000 UTC m=+30.770191346" watchObservedRunningTime="2026-07-22 12:37:48.130182359 +0000 UTC m=+30.770428578"
Jul 22 12:37:48.896207 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:48.896165    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:48.896207 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:48.896191    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:48.896649 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:48.896367    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:48.896649 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:48.896498    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:49.896539 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:49.896498    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:49.896984 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:49.896645    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgwsm" podUID="c5271282-15aa-43a3-9c6c-f7a482d0ad03"
Jul 22 12:37:50.088984 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:50.088345    2556 generic.go:356] "Generic (PLEG): container finished" podID="564b611d-b20e-44d0-9291-6d6b96855346" containerID="bf78cae67fb23557e8f246133940e493b95097c76646e51a6659dd0164bd7250" exitCode=0
Jul 22 12:37:50.088984 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:50.088405    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s698q" event={"ID":"564b611d-b20e-44d0-9291-6d6b96855346","Type":"ContainerDied","Data":"bf78cae67fb23557e8f246133940e493b95097c76646e51a6659dd0164bd7250"}
Jul 22 12:37:50.105558 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:50.105510    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp" podUID="ef7c0e9e-ae44-495c-a75e-b9045efb5cdb" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 22 12:37:50.605345 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:50.605316    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs\") pod \"network-metrics-daemon-jvncr\" (UID: \"8b097cfe-19a9-4eee-980f-3a19a58f6d0d\") " pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:50.605345 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:50.605354    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret\") pod \"global-pull-secret-syncer-f5xrr\" (UID: \"053dcfaf-ab25-4783-ad4a-4aa9693b8f6c\") " pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:50.605538 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:50.605410    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kphd8\" (UniqueName: \"kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8\") pod \"network-check-target-cgwsm\" (UID: \"c5271282-15aa-43a3-9c6c-f7a482d0ad03\") " pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:50.605538 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:50.605462    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:37:50.605538 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:50.605510    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 12:37:50.605538 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:50.605524    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 12:37:50.605538 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:50.605522    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 12:37:50.605538 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:50.605536    2556 projected.go:196] Error preparing data for projected volume kube-api-access-kphd8 for pod openshift-network-diagnostics/network-check-target-cgwsm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:37:50.605793 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:50.605532    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs podName:8b097cfe-19a9-4eee-980f-3a19a58f6d0d nodeName:}" failed. No retries permitted until 2026-07-22 12:38:22.605511348 +0000 UTC m=+65.245757582 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs") pod "network-metrics-daemon-jvncr" (UID: "8b097cfe-19a9-4eee-980f-3a19a58f6d0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:37:50.605793 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:50.605586    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret podName:053dcfaf-ab25-4783-ad4a-4aa9693b8f6c nodeName:}" failed. No retries permitted until 2026-07-22 12:38:22.605570986 +0000 UTC m=+65.245817210 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret") pod "global-pull-secret-syncer-f5xrr" (UID: "053dcfaf-ab25-4783-ad4a-4aa9693b8f6c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 12:37:50.605793 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:50.605604    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8 podName:c5271282-15aa-43a3-9c6c-f7a482d0ad03 nodeName:}" failed. No retries permitted until 2026-07-22 12:38:22.605596149 +0000 UTC m=+65.245842385 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kphd8" (UniqueName: "kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8") pod "network-check-target-cgwsm" (UID: "c5271282-15aa-43a3-9c6c-f7a482d0ad03") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:37:50.896410 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:50.896345    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:50.896544 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:50.896352    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:50.896544 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:50.896440    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:50.896544 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:50.896526    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:51.896123 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:51.896089    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:51.896296 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:51.896215    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cgwsm" podUID="c5271282-15aa-43a3-9c6c-f7a482d0ad03"
Jul 22 12:37:52.094911 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:52.094870    2556 generic.go:356] "Generic (PLEG): container finished" podID="564b611d-b20e-44d0-9291-6d6b96855346" containerID="97ba9d98859c14a660757ab943fbf6c81c866df870e95af37b6d9e0edd0131d2" exitCode=0
Jul 22 12:37:52.095280 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:52.094938    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s698q" event={"ID":"564b611d-b20e-44d0-9291-6d6b96855346","Type":"ContainerDied","Data":"97ba9d98859c14a660757ab943fbf6c81c866df870e95af37b6d9e0edd0131d2"}
Jul 22 12:37:52.895938 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:52.895902    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:52.896097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:52.895944    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:52.896097 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:52.896025    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f5xrr" podUID="053dcfaf-ab25-4783-ad4a-4aa9693b8f6c"
Jul 22 12:37:52.896216 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:52.896134    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jvncr" podUID="8b097cfe-19a9-4eee-980f-3a19a58f6d0d"
Jul 22 12:37:53.198410 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.198339    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-160.ec2.internal" event="NodeReady"
Jul 22 12:37:53.198833 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.198491    2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 12:37:53.254793 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.254761    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qsxlb"]
Jul 22 12:37:53.275404 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.275371    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wd2pd"]
Jul 22 12:37:53.275575 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.275518    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:37:53.278593 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.278569    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 12:37:53.278749 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.278665    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 12:37:53.279005 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.278989    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ntb22\""
Jul 22 12:37:53.301458 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.301436    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qsxlb"]
Jul 22 12:37:53.301568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.301469    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wd2pd"]
Jul 22 12:37:53.301632 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.301564    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wd2pd"
Jul 22 12:37:53.304519 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.304354    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 12:37:53.304519 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.304354    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z644t\""
Jul 22 12:37:53.304519 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.304389    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 12:37:53.305024 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.305004    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 12:37:53.411832 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.411795    2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjbch_a214fc4b-db41-4fd7-b2ac-59aaa1720409/konnectivity-agent/0.log" limit=1024
Jul 22 12:37:53.425396 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.425364    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/def9b785-e1bd-4ef9-8542-e4bba57d302c-cert\") pod \"ingress-canary-wd2pd\" (UID: \"def9b785-e1bd-4ef9-8542-e4bba57d302c\") " pod="openshift-ingress-canary/ingress-canary-wd2pd"
Jul 22 12:37:53.425555 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.425423    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gcxq\" (UniqueName: \"kubernetes.io/projected/def9b785-e1bd-4ef9-8542-e4bba57d302c-kube-api-access-2gcxq\") pod \"ingress-canary-wd2pd\" (UID: \"def9b785-e1bd-4ef9-8542-e4bba57d302c\") " pod="openshift-ingress-canary/ingress-canary-wd2pd"
Jul 22 12:37:53.425555 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.425446    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-tmp-dir\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:37:53.425555 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.425466    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:37:53.425737 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.425567    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-config-volume\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:37:53.425737 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.425600    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mpl5\" (UniqueName: \"kubernetes.io/projected/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-kube-api-access-6mpl5\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:37:53.526901 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.526873    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-config-volume\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:37:53.527076 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.526910    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mpl5\" (UniqueName: \"kubernetes.io/projected/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-kube-api-access-6mpl5\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:37:53.527076 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.526965    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/def9b785-e1bd-4ef9-8542-e4bba57d302c-cert\") pod \"ingress-canary-wd2pd\" (UID: \"def9b785-e1bd-4ef9-8542-e4bba57d302c\") " pod="openshift-ingress-canary/ingress-canary-wd2pd"
Jul 22 12:37:53.527076 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.527002    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gcxq\" (UniqueName: \"kubernetes.io/projected/def9b785-e1bd-4ef9-8542-e4bba57d302c-kube-api-access-2gcxq\") pod \"ingress-canary-wd2pd\" (UID: \"def9b785-e1bd-4ef9-8542-e4bba57d302c\") " pod="openshift-ingress-canary/ingress-canary-wd2pd"
Jul 22 12:37:53.527076 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.527023    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-tmp-dir\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:37:53.527076 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.527047    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:37:53.527373 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.527354    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-tmp-dir\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:37:53.527468 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.527448    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-config-volume\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:37:53.527606 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:53.527590    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 12:37:53.527667 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:53.527646    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls podName:c6a5585b-fbfa-40ab-af2c-a35ad338a96e nodeName:}" failed. No retries permitted until 2026-07-22 12:37:54.027634188 +0000 UTC m=+36.667880407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls") pod "dns-default-qsxlb" (UID: "c6a5585b-fbfa-40ab-af2c-a35ad338a96e") : secret "dns-default-metrics-tls" not found
Jul 22 12:37:53.532701 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.532188    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/def9b785-e1bd-4ef9-8542-e4bba57d302c-cert\") pod \"ingress-canary-wd2pd\" (UID: \"def9b785-e1bd-4ef9-8542-e4bba57d302c\") " pod="openshift-ingress-canary/ingress-canary-wd2pd"
Jul 22 12:37:53.536630 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.536607    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mpl5\" (UniqueName: \"kubernetes.io/projected/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-kube-api-access-6mpl5\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:37:53.536769 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.536749    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gcxq\" (UniqueName: \"kubernetes.io/projected/def9b785-e1bd-4ef9-8542-e4bba57d302c-kube-api-access-2gcxq\") pod \"ingress-canary-wd2pd\" (UID: \"def9b785-e1bd-4ef9-8542-e4bba57d302c\") " pod="openshift-ingress-canary/ingress-canary-wd2pd"
Jul 22 12:37:53.611766 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.611726    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wd2pd"
Jul 22 12:37:53.824024 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.823942    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wd2pd"]
Jul 22 12:37:53.830517 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:37:53.830486    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef9b785_e1bd_4ef9_8542_e4bba57d302c.slice/crio-0da96a6c842b29a0ce8da8d55a9e6709892b352a13064b5534e26b424356ae6d WatchSource:0}: Error finding container 0da96a6c842b29a0ce8da8d55a9e6709892b352a13064b5534e26b424356ae6d: Status 404 returned error can't find the container with id 0da96a6c842b29a0ce8da8d55a9e6709892b352a13064b5534e26b424356ae6d
Jul 22 12:37:53.895930 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.895902    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:37:53.898821 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.898790    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 12:37:53.898821 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.898825    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 12:37:53.899099 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:53.899072    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5w6qj\""
Jul 22 12:37:54.032377 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:54.032341    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:37:54.032552 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:54.032493    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 12:37:54.032615 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:54.032567    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls podName:c6a5585b-fbfa-40ab-af2c-a35ad338a96e nodeName:}" failed. No retries permitted until 2026-07-22 12:37:55.03255053 +0000 UTC m=+37.672796763 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls") pod "dns-default-qsxlb" (UID: "c6a5585b-fbfa-40ab-af2c-a35ad338a96e") : secret "dns-default-metrics-tls" not found
Jul 22 12:37:54.101397 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:54.101312    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wd2pd" event={"ID":"def9b785-e1bd-4ef9-8542-e4bba57d302c","Type":"ContainerStarted","Data":"0da96a6c842b29a0ce8da8d55a9e6709892b352a13064b5534e26b424356ae6d"}
Jul 22 12:37:54.895886 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:54.895850    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:37:54.896644 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:54.896285    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:37:54.898843 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:54.898821    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 12:37:54.899032 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:54.899012    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j8xb2\""
Jul 22 12:37:54.900208 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:54.900186    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 12:37:55.042033 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:55.041997    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:37:55.042194 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:55.042156    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 12:37:55.042257 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:55.042231    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls podName:c6a5585b-fbfa-40ab-af2c-a35ad338a96e nodeName:}" failed. No retries permitted until 2026-07-22 12:37:57.042210647 +0000 UTC m=+39.682456881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls") pod "dns-default-qsxlb" (UID: "c6a5585b-fbfa-40ab-af2c-a35ad338a96e") : secret "dns-default-metrics-tls" not found
Jul 22 12:37:57.057339 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:57.057291    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:37:57.057959 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:57.057435    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 12:37:57.057959 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:37:57.057501    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls podName:c6a5585b-fbfa-40ab-af2c-a35ad338a96e nodeName:}" failed. No retries permitted until 2026-07-22 12:38:01.057483472 +0000 UTC m=+43.697729693 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls") pod "dns-default-qsxlb" (UID: "c6a5585b-fbfa-40ab-af2c-a35ad338a96e") : secret "dns-default-metrics-tls" not found
Jul 22 12:37:58.114130 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:58.113941    2556 generic.go:356] "Generic (PLEG): container finished" podID="564b611d-b20e-44d0-9291-6d6b96855346" containerID="62a63ed170e23f7fd6cee7595df51b6e64994b28bbd1ff1502fdb75c96bedbb4" exitCode=0
Jul 22 12:37:58.114573 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:58.114018    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s698q" event={"ID":"564b611d-b20e-44d0-9291-6d6b96855346","Type":"ContainerDied","Data":"62a63ed170e23f7fd6cee7595df51b6e64994b28bbd1ff1502fdb75c96bedbb4"}
Jul 22 12:37:58.115644 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:58.115623    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wd2pd" event={"ID":"def9b785-e1bd-4ef9-8542-e4bba57d302c","Type":"ContainerStarted","Data":"c18032d0cea25f85a40e572aa2e5c9f8d3a6cc0c0c5de96c6c1f3a216d7db68d"}
Jul 22 12:37:58.153954 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:58.153897    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wd2pd" podStartSLOduration=1.665358364 podStartE2EDuration="5.153876035s" totalImagesPullingTime="3.488517671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:37:58.153558332 +0000 UTC m=+40.793804594" watchObservedRunningTime="2026-07-22 12:37:58.153876035 +0000 UTC m=+40.794122282"
Jul 22 12:37:59.120786 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:59.120749    2556 generic.go:356] "Generic (PLEG): container finished" podID="564b611d-b20e-44d0-9291-6d6b96855346" containerID="081fcb47e5dd7cd597bc1c94b6852862d4f29d9e8c6ad5a4313dc7c610c4380c" exitCode=0
Jul 22 12:37:59.121188 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:37:59.120845    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s698q" event={"ID":"564b611d-b20e-44d0-9291-6d6b96855346","Type":"ContainerDied","Data":"081fcb47e5dd7cd597bc1c94b6852862d4f29d9e8c6ad5a4313dc7c610c4380c"}
Jul 22 12:38:00.126199 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:00.126158    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s698q" event={"ID":"564b611d-b20e-44d0-9291-6d6b96855346","Type":"ContainerStarted","Data":"3d31b4f0ad37fddc98c64baab29757c460445a66a84d842f754992a97d112d0a"}
Jul 22 12:38:00.149800 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:00.149752    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s698q" podStartSLOduration=8.103595425 podStartE2EDuration="42.149735373s" totalImagesPullingTime="34.046139948s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:37:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:38:00.148242347 +0000 UTC m=+42.788488599" watchObservedRunningTime="2026-07-22 12:38:00.149735373 +0000 UTC m=+42.789981613"
Jul 22 12:38:01.084030 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:01.083984    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:38:01.084194 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:01.084137    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 12:38:01.084238 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:01.084206    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls podName:c6a5585b-fbfa-40ab-af2c-a35ad338a96e nodeName:}" failed. No retries permitted until 2026-07-22 12:38:09.084190907 +0000 UTC m=+51.724437125 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls") pod "dns-default-qsxlb" (UID: "c6a5585b-fbfa-40ab-af2c-a35ad338a96e") : secret "dns-default-metrics-tls" not found
Jul 22 12:38:09.136761 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:09.136728    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:38:09.137251 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:09.136881    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 12:38:09.137251 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:09.136948    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls podName:c6a5585b-fbfa-40ab-af2c-a35ad338a96e nodeName:}" failed. No retries permitted until 2026-07-22 12:38:25.136928992 +0000 UTC m=+67.777175214 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls") pod "dns-default-qsxlb" (UID: "c6a5585b-fbfa-40ab-af2c-a35ad338a96e") : secret "dns-default-metrics-tls" not found
Jul 22 12:38:20.098651 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:20.098620    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vbkcp"
Jul 22 12:38:22.635594 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:22.635546    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kphd8\" (UniqueName: \"kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8\") pod \"network-check-target-cgwsm\" (UID: \"c5271282-15aa-43a3-9c6c-f7a482d0ad03\") " pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:38:22.635594 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:22.635606    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs\") pod \"network-metrics-daemon-jvncr\" (UID: \"8b097cfe-19a9-4eee-980f-3a19a58f6d0d\") " pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:38:22.636093 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:22.635643    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret\") pod \"global-pull-secret-syncer-f5xrr\" (UID: \"053dcfaf-ab25-4783-ad4a-4aa9693b8f6c\") " pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:38:22.638687 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:22.638659    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 12:38:22.638741 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:22.638672    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 12:38:22.638842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:22.638823    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 12:38:22.646047 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:22.646020    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 12:38:22.646152 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:22.646088    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs podName:8b097cfe-19a9-4eee-980f-3a19a58f6d0d nodeName:}" failed. No retries permitted until 2026-07-22 12:39:26.646067394 +0000 UTC m=+129.286313630 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs") pod "network-metrics-daemon-jvncr" (UID: "8b097cfe-19a9-4eee-980f-3a19a58f6d0d") : secret "metrics-daemon-secret" not found
Jul 22 12:38:22.648167 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:22.648148    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 12:38:22.649560 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:22.649540    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/053dcfaf-ab25-4783-ad4a-4aa9693b8f6c-original-pull-secret\") pod \"global-pull-secret-syncer-f5xrr\" (UID: \"053dcfaf-ab25-4783-ad4a-4aa9693b8f6c\") " pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:38:22.658491 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:22.658467    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kphd8\" (UniqueName: \"kubernetes.io/projected/c5271282-15aa-43a3-9c6c-f7a482d0ad03-kube-api-access-kphd8\") pod \"network-check-target-cgwsm\" (UID: \"c5271282-15aa-43a3-9c6c-f7a482d0ad03\") " pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:38:22.710811 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:22.710778    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5w6qj\""
Jul 22 12:38:22.718144 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:22.718124    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:38:22.816154 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:22.816124    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f5xrr"
Jul 22 12:38:22.843377 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:22.843350    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cgwsm"]
Jul 22 12:38:22.846201 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:38:22.846174    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5271282_15aa_43a3_9c6c_f7a482d0ad03.slice/crio-b70ae740f348d158d9d218e5e5736e738f6d2c7d09696ea8f4aba478bd893210 WatchSource:0}: Error finding container b70ae740f348d158d9d218e5e5736e738f6d2c7d09696ea8f4aba478bd893210: Status 404 returned error can't find the container with id b70ae740f348d158d9d218e5e5736e738f6d2c7d09696ea8f4aba478bd893210
Jul 22 12:38:22.949648 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:22.949614    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f5xrr"]
Jul 22 12:38:22.952892 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:38:22.952865    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod053dcfaf_ab25_4783_ad4a_4aa9693b8f6c.slice/crio-542d60271133ca6049e24117694a970d3d76dc6b4681f57944aee07dbc07818b WatchSource:0}: Error finding container 542d60271133ca6049e24117694a970d3d76dc6b4681f57944aee07dbc07818b: Status 404 returned error can't find the container with id 542d60271133ca6049e24117694a970d3d76dc6b4681f57944aee07dbc07818b
Jul 22 12:38:23.180515 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:23.180433    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f5xrr" event={"ID":"053dcfaf-ab25-4783-ad4a-4aa9693b8f6c","Type":"ContainerStarted","Data":"542d60271133ca6049e24117694a970d3d76dc6b4681f57944aee07dbc07818b"}
Jul 22 12:38:23.181484 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:23.181462    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cgwsm" event={"ID":"c5271282-15aa-43a3-9c6c-f7a482d0ad03","Type":"ContainerStarted","Data":"b70ae740f348d158d9d218e5e5736e738f6d2c7d09696ea8f4aba478bd893210"}
Jul 22 12:38:25.155533 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:25.155495    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:38:25.156030 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:25.155652    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 12:38:25.156030 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:25.155741    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls podName:c6a5585b-fbfa-40ab-af2c-a35ad338a96e nodeName:}" failed. No retries permitted until 2026-07-22 12:38:57.155725656 +0000 UTC m=+99.795971877 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls") pod "dns-default-qsxlb" (UID: "c6a5585b-fbfa-40ab-af2c-a35ad338a96e") : secret "dns-default-metrics-tls" not found
Jul 22 12:38:28.196187 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:28.196151    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cgwsm" event={"ID":"c5271282-15aa-43a3-9c6c-f7a482d0ad03","Type":"ContainerStarted","Data":"09bfe7f82cee264c0b88a99b19e582e7ef26f2de6e7bb26821abfdbcb71a2f59"}
Jul 22 12:38:28.196613 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:28.196268    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:38:28.217550 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:28.217490    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cgwsm" podStartSLOduration=66.004286754 podStartE2EDuration="1m11.217475653s" totalImagesPullingTime="5.213188899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:38:28.216804654 +0000 UTC m=+70.857050915" watchObservedRunningTime="2026-07-22 12:38:28.217475653 +0000 UTC m=+70.857721893"
Jul 22 12:38:29.200122 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:29.200083    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f5xrr" event={"ID":"053dcfaf-ab25-4783-ad4a-4aa9693b8f6c","Type":"ContainerStarted","Data":"b740b4db5d705af31cc68c60e3863c3aa133e19eab8a3964434a930e375359ea"}
Jul 22 12:38:29.215971 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:29.215923    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f5xrr" podStartSLOduration=65.787491885 podStartE2EDuration="1m11.21590748s" totalImagesPullingTime="5.428415595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:38:29.215733431 +0000 UTC m=+71.855979688" watchObservedRunningTime="2026-07-22 12:38:29.21590748 +0000 UTC m=+71.856153757"
Jul 22 12:38:46.380364 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.380329    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-89cqz"]
Jul 22 12:38:46.384479 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.384450    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79d56886cb-d5nq9"]
Jul 22 12:38:46.384611 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.384567    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:38:46.387066 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.387048    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.389731 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.389708    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 22 12:38:46.389854 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.389744    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 22 12:38:46.389854 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.389830    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 22 12:38:46.389977 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.389961    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 22 12:38:46.390819 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.390801    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 22 12:38:46.390972 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.390943    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 22 12:38:46.390972 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.390954    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-nlrgr\""
Jul 22 12:38:46.391189 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.391168    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-69gxc\""
Jul 22 12:38:46.391633 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.391312    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 22 12:38:46.396180 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.396155    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 22 12:38:46.396882 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.396861    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-89cqz"]
Jul 22 12:38:46.397308 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.397289    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 22 12:38:46.402839 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.402809    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/46567b42-5787-4eec-8af8-ebafb6f6a45f-ca-trust-extracted\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.402928 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.402865    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e-config\") pod \"console-operator-565b7b569d-89cqz\" (UID: \"3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e\") " pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:38:46.402983 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.402927    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.402983 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.402973    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46567b42-5787-4eec-8af8-ebafb6f6a45f-trusted-ca\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.403063 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.403013    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e-trusted-ca\") pod \"console-operator-565b7b569d-89cqz\" (UID: \"3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e\") " pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:38:46.403063 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.403034    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-bound-sa-token\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.403063 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.403049    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtk7g\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-kube-api-access-qtk7g\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.403199 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.403070    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e-serving-cert\") pod \"console-operator-565b7b569d-89cqz\" (UID: \"3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e\") " pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:38:46.403199 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.403128    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz97k\" (UniqueName: \"kubernetes.io/projected/3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e-kube-api-access-pz97k\") pod \"console-operator-565b7b569d-89cqz\" (UID: \"3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e\") " pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:38:46.403199 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.403160    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/46567b42-5787-4eec-8af8-ebafb6f6a45f-image-registry-private-configuration\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.403199 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.403190    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-certificates\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.403338 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.403216    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/46567b42-5787-4eec-8af8-ebafb6f6a45f-installation-pull-secrets\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.404956 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.404936    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79d56886cb-d5nq9"]
Jul 22 12:38:46.483222 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.483185    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-2nnm8"]
Jul 22 12:38:46.486032 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.486010    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.488748 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.488728    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 22 12:38:46.489119 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.489105    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 22 12:38:46.489246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.489229    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 12:38:46.489527 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.489510    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 12:38:46.489661 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.489643    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7grq6\""
Jul 22 12:38:46.495179 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.495162    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 22 12:38:46.499756 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.499739    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-2nnm8"]
Jul 22 12:38:46.503950 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.503933    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46567b42-5787-4eec-8af8-ebafb6f6a45f-trusted-ca\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.504036 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.503958    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e-trusted-ca\") pod \"console-operator-565b7b569d-89cqz\" (UID: \"3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e\") " pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:38:46.504036 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.503974    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-bound-sa-token\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.504036 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.503989    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtk7g\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-kube-api-access-qtk7g\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.504036 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.504006    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e-serving-cert\") pod \"console-operator-565b7b569d-89cqz\" (UID: \"3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e\") " pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:38:46.504218 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.504052    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/202073f3-d747-4118-ba9a-6fda23b5198f-snapshots\") pod \"insights-operator-555d9d7885-2nnm8\" (UID: \"202073f3-d747-4118-ba9a-6fda23b5198f\") " pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.504218 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.504097    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz97k\" (UniqueName: \"kubernetes.io/projected/3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e-kube-api-access-pz97k\") pod \"console-operator-565b7b569d-89cqz\" (UID: \"3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e\") " pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:38:46.504218 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.504130    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/46567b42-5787-4eec-8af8-ebafb6f6a45f-image-registry-private-configuration\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.504218 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.504184    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/202073f3-d747-4118-ba9a-6fda23b5198f-tmp\") pod \"insights-operator-555d9d7885-2nnm8\" (UID: \"202073f3-d747-4118-ba9a-6fda23b5198f\") " pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.504409 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.504236    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-certificates\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.504409 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.504266    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/46567b42-5787-4eec-8af8-ebafb6f6a45f-installation-pull-secrets\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.504409 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.504328    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/46567b42-5787-4eec-8af8-ebafb6f6a45f-ca-trust-extracted\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.504409 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.504363    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/202073f3-d747-4118-ba9a-6fda23b5198f-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-2nnm8\" (UID: \"202073f3-d747-4118-ba9a-6fda23b5198f\") " pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.504409 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.504398    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/202073f3-d747-4118-ba9a-6fda23b5198f-service-ca-bundle\") pod \"insights-operator-555d9d7885-2nnm8\" (UID: \"202073f3-d747-4118-ba9a-6fda23b5198f\") " pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.504638 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.504425    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/202073f3-d747-4118-ba9a-6fda23b5198f-serving-cert\") pod \"insights-operator-555d9d7885-2nnm8\" (UID: \"202073f3-d747-4118-ba9a-6fda23b5198f\") " pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.504638 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.504449    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg2fn\" (UniqueName: \"kubernetes.io/projected/202073f3-d747-4118-ba9a-6fda23b5198f-kube-api-access-cg2fn\") pod \"insights-operator-555d9d7885-2nnm8\" (UID: \"202073f3-d747-4118-ba9a-6fda23b5198f\") " pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.504638 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.504497    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e-config\") pod \"console-operator-565b7b569d-89cqz\" (UID: \"3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e\") " pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:38:46.504638 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.504535    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.504942 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:46.504653    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 12:38:46.504942 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:46.504669    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d56886cb-d5nq9: secret "image-registry-tls" not found
Jul 22 12:38:46.504942 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.504731    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/46567b42-5787-4eec-8af8-ebafb6f6a45f-ca-trust-extracted\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.504942 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:46.504763    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls podName:46567b42-5787-4eec-8af8-ebafb6f6a45f nodeName:}" failed. No retries permitted until 2026-07-22 12:38:47.004744636 +0000 UTC m=+89.644990858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls") pod "image-registry-79d56886cb-d5nq9" (UID: "46567b42-5787-4eec-8af8-ebafb6f6a45f") : secret "image-registry-tls" not found
Jul 22 12:38:46.505223 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.505010    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46567b42-5787-4eec-8af8-ebafb6f6a45f-trusted-ca\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.505223 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.505092    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e-trusted-ca\") pod \"console-operator-565b7b569d-89cqz\" (UID: \"3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e\") " pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:38:46.505419 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.505396    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-certificates\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.505726 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.505703    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e-config\") pod \"console-operator-565b7b569d-89cqz\" (UID: \"3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e\") " pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:38:46.509936 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.509906    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/46567b42-5787-4eec-8af8-ebafb6f6a45f-image-registry-private-configuration\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.510028 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.509954    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e-serving-cert\") pod \"console-operator-565b7b569d-89cqz\" (UID: \"3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e\") " pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:38:46.510755 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.510735    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/46567b42-5787-4eec-8af8-ebafb6f6a45f-installation-pull-secrets\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.518352 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.518324    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtk7g\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-kube-api-access-qtk7g\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.522429 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.522405    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-bound-sa-token\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:46.525381 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.525361    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz97k\" (UniqueName: \"kubernetes.io/projected/3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e-kube-api-access-pz97k\") pod \"console-operator-565b7b569d-89cqz\" (UID: \"3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e\") " pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:38:46.605135 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.605107    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/202073f3-d747-4118-ba9a-6fda23b5198f-snapshots\") pod \"insights-operator-555d9d7885-2nnm8\" (UID: \"202073f3-d747-4118-ba9a-6fda23b5198f\") " pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.605323 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.605153    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/202073f3-d747-4118-ba9a-6fda23b5198f-tmp\") pod \"insights-operator-555d9d7885-2nnm8\" (UID: \"202073f3-d747-4118-ba9a-6fda23b5198f\") " pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.605323 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.605196    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/202073f3-d747-4118-ba9a-6fda23b5198f-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-2nnm8\" (UID: \"202073f3-d747-4118-ba9a-6fda23b5198f\") " pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.605323 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.605224    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/202073f3-d747-4118-ba9a-6fda23b5198f-service-ca-bundle\") pod \"insights-operator-555d9d7885-2nnm8\" (UID: \"202073f3-d747-4118-ba9a-6fda23b5198f\") " pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.605323 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.605243    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/202073f3-d747-4118-ba9a-6fda23b5198f-serving-cert\") pod \"insights-operator-555d9d7885-2nnm8\" (UID: \"202073f3-d747-4118-ba9a-6fda23b5198f\") " pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.605323 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.605265    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg2fn\" (UniqueName: \"kubernetes.io/projected/202073f3-d747-4118-ba9a-6fda23b5198f-kube-api-access-cg2fn\") pod \"insights-operator-555d9d7885-2nnm8\" (UID: \"202073f3-d747-4118-ba9a-6fda23b5198f\") " pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.605823 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.605789    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/202073f3-d747-4118-ba9a-6fda23b5198f-tmp\") pod \"insights-operator-555d9d7885-2nnm8\" (UID: \"202073f3-d747-4118-ba9a-6fda23b5198f\") " pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.605951 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.605847    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/202073f3-d747-4118-ba9a-6fda23b5198f-service-ca-bundle\") pod \"insights-operator-555d9d7885-2nnm8\" (UID: \"202073f3-d747-4118-ba9a-6fda23b5198f\") " pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.605951 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.605904    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/202073f3-d747-4118-ba9a-6fda23b5198f-snapshots\") pod \"insights-operator-555d9d7885-2nnm8\" (UID: \"202073f3-d747-4118-ba9a-6fda23b5198f\") " pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.606100 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.606083    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/202073f3-d747-4118-ba9a-6fda23b5198f-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-2nnm8\" (UID: \"202073f3-d747-4118-ba9a-6fda23b5198f\") " pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.607631 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.607601    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/202073f3-d747-4118-ba9a-6fda23b5198f-serving-cert\") pod \"insights-operator-555d9d7885-2nnm8\" (UID: \"202073f3-d747-4118-ba9a-6fda23b5198f\") " pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.615084 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.615066    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg2fn\" (UniqueName: \"kubernetes.io/projected/202073f3-d747-4118-ba9a-6fda23b5198f-kube-api-access-cg2fn\") pod \"insights-operator-555d9d7885-2nnm8\" (UID: \"202073f3-d747-4118-ba9a-6fda23b5198f\") " pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.694840 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.694768    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:38:46.795155 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.795121    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-2nnm8"
Jul 22 12:38:46.820986 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.820943    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-89cqz"]
Jul 22 12:38:46.823522 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:38:46.823495    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f5ea1e0_8d3b_4303_883d_8ddd3d5c8d0e.slice/crio-44887bb04b73e1d47122b3f7e2fa1a02740c6d41ffc4ffe5539264e10257859f WatchSource:0}: Error finding container 44887bb04b73e1d47122b3f7e2fa1a02740c6d41ffc4ffe5539264e10257859f: Status 404 returned error can't find the container with id 44887bb04b73e1d47122b3f7e2fa1a02740c6d41ffc4ffe5539264e10257859f
Jul 22 12:38:46.918696 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:46.918651    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-2nnm8"]
Jul 22 12:38:46.921366 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:38:46.921341    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod202073f3_d747_4118_ba9a_6fda23b5198f.slice/crio-83fd13540c4615df41c0ed02c2e72e1dd51f1ad44534bf2b0cc02657489ca8c3 WatchSource:0}: Error finding container 83fd13540c4615df41c0ed02c2e72e1dd51f1ad44534bf2b0cc02657489ca8c3: Status 404 returned error can't find the container with id 83fd13540c4615df41c0ed02c2e72e1dd51f1ad44534bf2b0cc02657489ca8c3
Jul 22 12:38:47.008756 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:47.008670    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:47.008871 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:47.008823    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 12:38:47.008871 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:47.008840    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d56886cb-d5nq9: secret "image-registry-tls" not found
Jul 22 12:38:47.008950 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:47.008897    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls podName:46567b42-5787-4eec-8af8-ebafb6f6a45f nodeName:}" failed. No retries permitted until 2026-07-22 12:38:48.00887778 +0000 UTC m=+90.649123999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls") pod "image-registry-79d56886cb-d5nq9" (UID: "46567b42-5787-4eec-8af8-ebafb6f6a45f") : secret "image-registry-tls" not found
Jul 22 12:38:47.241874 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:47.241835    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-2nnm8" event={"ID":"202073f3-d747-4118-ba9a-6fda23b5198f","Type":"ContainerStarted","Data":"83fd13540c4615df41c0ed02c2e72e1dd51f1ad44534bf2b0cc02657489ca8c3"}
Jul 22 12:38:47.242933 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:47.242909    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-89cqz" event={"ID":"3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e","Type":"ContainerStarted","Data":"44887bb04b73e1d47122b3f7e2fa1a02740c6d41ffc4ffe5539264e10257859f"}
Jul 22 12:38:48.015857 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:48.015819    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:48.016294 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:48.015986    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 12:38:48.016294 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:48.016010    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d56886cb-d5nq9: secret "image-registry-tls" not found
Jul 22 12:38:48.016294 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:48.016069    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls podName:46567b42-5787-4eec-8af8-ebafb6f6a45f nodeName:}" failed. No retries permitted until 2026-07-22 12:38:50.016052265 +0000 UTC m=+92.656298484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls") pod "image-registry-79d56886cb-d5nq9" (UID: "46567b42-5787-4eec-8af8-ebafb6f6a45f") : secret "image-registry-tls" not found
Jul 22 12:38:50.034400 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.034306    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:50.034791 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:50.034458    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 12:38:50.034791 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:50.034479    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d56886cb-d5nq9: secret "image-registry-tls" not found
Jul 22 12:38:50.034791 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:50.034532    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls podName:46567b42-5787-4eec-8af8-ebafb6f6a45f nodeName:}" failed. No retries permitted until 2026-07-22 12:38:54.034517896 +0000 UTC m=+96.674764115 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls") pod "image-registry-79d56886cb-d5nq9" (UID: "46567b42-5787-4eec-8af8-ebafb6f6a45f") : secret "image-registry-tls" not found
Jul 22 12:38:50.256971 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.256929    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-2nnm8" event={"ID":"202073f3-d747-4118-ba9a-6fda23b5198f","Type":"ContainerStarted","Data":"59735810e1066050eb3b8cfd7cbc4769929ad0bfb964967abd08cc195d33e443"}
Jul 22 12:38:50.258543 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.258524    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/0.log"
Jul 22 12:38:50.258660 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.258558    2556 generic.go:356] "Generic (PLEG): container finished" podID="3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e" containerID="fd9fb6f787a534c7a973a8d3233bd5c8ef2bb646b52e7101f6b86c03ae42a4de" exitCode=255
Jul 22 12:38:50.258660 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.258602    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-89cqz" event={"ID":"3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e","Type":"ContainerDied","Data":"fd9fb6f787a534c7a973a8d3233bd5c8ef2bb646b52e7101f6b86c03ae42a4de"}
Jul 22 12:38:50.258821 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.258809    2556 scope.go:117] "RemoveContainer" containerID="fd9fb6f787a534c7a973a8d3233bd5c8ef2bb646b52e7101f6b86c03ae42a4de"
Jul 22 12:38:50.275307 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.275263    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-2nnm8" podStartSLOduration=1.418234814 podStartE2EDuration="4.275250356s" totalImagesPullingTime="2.857015542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:38:50.274540434 +0000 UTC m=+92.914786701" watchObservedRunningTime="2026-07-22 12:38:50.275250356 +0000 UTC m=+92.915496597"
Jul 22 12:38:50.745580 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.745509    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ksc9h"]
Jul 22 12:38:50.748449 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.748432    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:50.751202 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.751179    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 12:38:50.751295 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.751249    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dmzhg\""
Jul 22 12:38:50.751782 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.751765    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 12:38:50.768399 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.768369    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ksc9h"]
Jul 22 12:38:50.841309 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.841276    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:50.841448 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.841316    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbzvh\" (UniqueName: \"kubernetes.io/projected/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-api-access-nbzvh\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:50.841448 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.841336    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8c7b90fe-1503-4530-81f4-40e14ac76906-crio-socket\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:50.841448 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.841354    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:50.841448 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.841406    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c7b90fe-1503-4530-81f4-40e14ac76906-data-volume\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:50.941940 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.941895    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:50.941940 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.941937    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbzvh\" (UniqueName: \"kubernetes.io/projected/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-api-access-nbzvh\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:50.942202 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.941955    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8c7b90fe-1503-4530-81f4-40e14ac76906-crio-socket\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:50.942202 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.941972    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:50.942202 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:50.942046    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 12:38:50.942202 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:50.942047    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 12:38:50.942202 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.942064    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8c7b90fe-1503-4530-81f4-40e14ac76906-crio-socket\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:50.942202 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.942104    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c7b90fe-1503-4530-81f4-40e14ac76906-data-volume\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:50.942202 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:50.942113    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls podName:8c7b90fe-1503-4530-81f4-40e14ac76906 nodeName:}" failed. No retries permitted until 2026-07-22 12:38:51.442096552 +0000 UTC m=+94.082342774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ksc9h" (UID: "8c7b90fe-1503-4530-81f4-40e14ac76906") : secret "insights-runtime-extractor-tls" not found
Jul 22 12:38:50.942202 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:50.942142    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-rbac-proxy-cm podName:8c7b90fe-1503-4530-81f4-40e14ac76906 nodeName:}" failed. No retries permitted until 2026-07-22 12:38:51.442127162 +0000 UTC m=+94.082373381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ksc9h" (UID: "8c7b90fe-1503-4530-81f4-40e14ac76906") : configmap "kube-rbac-proxy" not found
Jul 22 12:38:50.942514 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.942327    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c7b90fe-1503-4530-81f4-40e14ac76906-data-volume\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:50.951021 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:50.950998    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbzvh\" (UniqueName: \"kubernetes.io/projected/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-api-access-nbzvh\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:51.258538 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.258503    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2"]
Jul 22 12:38:51.261559 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.261537    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2"
Jul 22 12:38:51.263839 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.263823    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/1.log"
Jul 22 12:38:51.264234 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.264216    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 22 12:38:51.264340 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.264286    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/0.log"
Jul 22 12:38:51.264340 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.264301    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tkzdg\""
Jul 22 12:38:51.264340 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.264317    2556 generic.go:356] "Generic (PLEG): container finished" podID="3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e" containerID="584bd009d78579188c3cf11975293d0e449625f8a245a0174db39374c7c62da3" exitCode=255
Jul 22 12:38:51.264474 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.264360    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 22 12:38:51.264474 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.264375    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-89cqz" event={"ID":"3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e","Type":"ContainerDied","Data":"584bd009d78579188c3cf11975293d0e449625f8a245a0174db39374c7c62da3"}
Jul 22 12:38:51.264474 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.264429    2556 scope.go:117] "RemoveContainer" containerID="fd9fb6f787a534c7a973a8d3233bd5c8ef2bb646b52e7101f6b86c03ae42a4de"
Jul 22 12:38:51.264620 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.264600    2556 scope.go:117] "RemoveContainer" containerID="584bd009d78579188c3cf11975293d0e449625f8a245a0174db39374c7c62da3"
Jul 22 12:38:51.264813 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:51.264789    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-89cqz_openshift-console-operator(3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e)\"" pod="openshift-console-operator/console-operator-565b7b569d-89cqz" podUID="3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e"
Jul 22 12:38:51.269948 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.269927    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2"]
Jul 22 12:38:51.345163 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.345120    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-ppbq2\" (UID: \"a34dcc90-9f0b-4076-b343-79a57fd6e3a6\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2"
Jul 22 12:38:51.345355 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.345185    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-ppbq2\" (UID: \"a34dcc90-9f0b-4076-b343-79a57fd6e3a6\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2"
Jul 22 12:38:51.446643 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.446604    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:51.446643 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.446643    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-ppbq2\" (UID: \"a34dcc90-9f0b-4076-b343-79a57fd6e3a6\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2"
Jul 22 12:38:51.446902 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.446669    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:51.446902 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.446729    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-ppbq2\" (UID: \"a34dcc90-9f0b-4076-b343-79a57fd6e3a6\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2"
Jul 22 12:38:51.446902 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:51.446775    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 12:38:51.446902 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:51.446782    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 12:38:51.446902 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:51.446837    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls podName:8c7b90fe-1503-4530-81f4-40e14ac76906 nodeName:}" failed. No retries permitted until 2026-07-22 12:38:52.446823022 +0000 UTC m=+95.087069243 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ksc9h" (UID: "8c7b90fe-1503-4530-81f4-40e14ac76906") : secret "insights-runtime-extractor-tls" not found
Jul 22 12:38:51.446902 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:51.446837    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 12:38:51.446902 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:51.446851    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-networking-console-plugin-cert podName:a34dcc90-9f0b-4076-b343-79a57fd6e3a6 nodeName:}" failed. No retries permitted until 2026-07-22 12:38:51.946845082 +0000 UTC m=+94.587091300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-ppbq2" (UID: "a34dcc90-9f0b-4076-b343-79a57fd6e3a6") : secret "networking-console-plugin-cert" not found
Jul 22 12:38:51.446902 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:51.446894    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-rbac-proxy-cm podName:8c7b90fe-1503-4530-81f4-40e14ac76906 nodeName:}" failed. No retries permitted until 2026-07-22 12:38:52.446875365 +0000 UTC m=+95.087121603 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ksc9h" (UID: "8c7b90fe-1503-4530-81f4-40e14ac76906") : configmap "kube-rbac-proxy" not found
Jul 22 12:38:51.447298 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.447281    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-ppbq2\" (UID: \"a34dcc90-9f0b-4076-b343-79a57fd6e3a6\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2"
Jul 22 12:38:51.951066 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:51.951027    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-ppbq2\" (UID: \"a34dcc90-9f0b-4076-b343-79a57fd6e3a6\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2"
Jul 22 12:38:51.951246 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:51.951177    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 12:38:51.951246 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:51.951239    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-networking-console-plugin-cert podName:a34dcc90-9f0b-4076-b343-79a57fd6e3a6 nodeName:}" failed. No retries permitted until 2026-07-22 12:38:52.95122538 +0000 UTC m=+95.591471598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-ppbq2" (UID: "a34dcc90-9f0b-4076-b343-79a57fd6e3a6") : secret "networking-console-plugin-cert" not found
Jul 22 12:38:52.269942 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:52.269860    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/1.log"
Jul 22 12:38:52.271245 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:52.271215    2556 scope.go:117] "RemoveContainer" containerID="584bd009d78579188c3cf11975293d0e449625f8a245a0174db39374c7c62da3"
Jul 22 12:38:52.271443 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:52.271422    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-89cqz_openshift-console-operator(3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e)\"" pod="openshift-console-operator/console-operator-565b7b569d-89cqz" podUID="3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e"
Jul 22 12:38:52.455433 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:52.455403    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:52.455606 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:52.455445    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:52.455606 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:52.455552    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 12:38:52.455606 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:52.455566    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 12:38:52.455729 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:52.455614    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls podName:8c7b90fe-1503-4530-81f4-40e14ac76906 nodeName:}" failed. No retries permitted until 2026-07-22 12:38:54.45559958 +0000 UTC m=+97.095845799 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ksc9h" (UID: "8c7b90fe-1503-4530-81f4-40e14ac76906") : secret "insights-runtime-extractor-tls" not found
Jul 22 12:38:52.455729 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:52.455629    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-rbac-proxy-cm podName:8c7b90fe-1503-4530-81f4-40e14ac76906 nodeName:}" failed. No retries permitted until 2026-07-22 12:38:54.455622111 +0000 UTC m=+97.095868330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ksc9h" (UID: "8c7b90fe-1503-4530-81f4-40e14ac76906") : configmap "kube-rbac-proxy" not found
Jul 22 12:38:52.679241 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:52.679216    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bpdhv_aec9d056-2cee-42b8-bb4e-f333e1269945/dns-node-resolver/0.log"
Jul 22 12:38:52.943521 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:52.943447    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-q66cb"]
Jul 22 12:38:52.947835 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:52.947820    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-q66cb"
Jul 22 12:38:52.950794 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:52.950766    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 22 12:38:52.950914 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:52.950780    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 22 12:38:52.951059 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:52.951037    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 22 12:38:52.951132 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:52.951056    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 22 12:38:52.951132 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:52.951056    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xxhvk\""
Jul 22 12:38:52.956192 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:52.956173    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-q66cb"]
Jul 22 12:38:52.960324 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:52.960305    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-ppbq2\" (UID: \"a34dcc90-9f0b-4076-b343-79a57fd6e3a6\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2"
Jul 22 12:38:52.960449 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:52.960435    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 12:38:52.960499 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:52.960490    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-networking-console-plugin-cert podName:a34dcc90-9f0b-4076-b343-79a57fd6e3a6 nodeName:}" failed. No retries permitted until 2026-07-22 12:38:54.960476618 +0000 UTC m=+97.600722839 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-ppbq2" (UID: "a34dcc90-9f0b-4076-b343-79a57fd6e3a6") : secret "networking-console-plugin-cert" not found
Jul 22 12:38:53.061595 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:53.061564    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/159a8397-dfbe-4612-b07c-9c66ec3c5a68-signing-cabundle\") pod \"service-ca-58598695f7-q66cb\" (UID: \"159a8397-dfbe-4612-b07c-9c66ec3c5a68\") " pod="openshift-service-ca/service-ca-58598695f7-q66cb"
Jul 22 12:38:53.061782 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:53.061603    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/159a8397-dfbe-4612-b07c-9c66ec3c5a68-signing-key\") pod \"service-ca-58598695f7-q66cb\" (UID: \"159a8397-dfbe-4612-b07c-9c66ec3c5a68\") " pod="openshift-service-ca/service-ca-58598695f7-q66cb"
Jul 22 12:38:53.061782 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:53.061705    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfcj4\" (UniqueName: \"kubernetes.io/projected/159a8397-dfbe-4612-b07c-9c66ec3c5a68-kube-api-access-zfcj4\") pod \"service-ca-58598695f7-q66cb\" (UID: \"159a8397-dfbe-4612-b07c-9c66ec3c5a68\") " pod="openshift-service-ca/service-ca-58598695f7-q66cb"
Jul 22 12:38:53.162613 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:53.162563    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfcj4\" (UniqueName: \"kubernetes.io/projected/159a8397-dfbe-4612-b07c-9c66ec3c5a68-kube-api-access-zfcj4\") pod \"service-ca-58598695f7-q66cb\" (UID: \"159a8397-dfbe-4612-b07c-9c66ec3c5a68\") " pod="openshift-service-ca/service-ca-58598695f7-q66cb"
Jul 22 12:38:53.162774 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:53.162665    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/159a8397-dfbe-4612-b07c-9c66ec3c5a68-signing-cabundle\") pod \"service-ca-58598695f7-q66cb\" (UID: \"159a8397-dfbe-4612-b07c-9c66ec3c5a68\") " pod="openshift-service-ca/service-ca-58598695f7-q66cb"
Jul 22 12:38:53.162813 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:53.162764    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/159a8397-dfbe-4612-b07c-9c66ec3c5a68-signing-key\") pod \"service-ca-58598695f7-q66cb\" (UID: \"159a8397-dfbe-4612-b07c-9c66ec3c5a68\") " pod="openshift-service-ca/service-ca-58598695f7-q66cb"
Jul 22 12:38:53.163247 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:53.163221    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/159a8397-dfbe-4612-b07c-9c66ec3c5a68-signing-cabundle\") pod \"service-ca-58598695f7-q66cb\" (UID: \"159a8397-dfbe-4612-b07c-9c66ec3c5a68\") " pod="openshift-service-ca/service-ca-58598695f7-q66cb"
Jul 22 12:38:53.165174 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:53.165157    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/159a8397-dfbe-4612-b07c-9c66ec3c5a68-signing-key\") pod \"service-ca-58598695f7-q66cb\" (UID: \"159a8397-dfbe-4612-b07c-9c66ec3c5a68\") " pod="openshift-service-ca/service-ca-58598695f7-q66cb"
Jul 22 12:38:53.172034 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:53.172014    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfcj4\" (UniqueName: \"kubernetes.io/projected/159a8397-dfbe-4612-b07c-9c66ec3c5a68-kube-api-access-zfcj4\") pod \"service-ca-58598695f7-q66cb\" (UID: \"159a8397-dfbe-4612-b07c-9c66ec3c5a68\") " pod="openshift-service-ca/service-ca-58598695f7-q66cb"
Jul 22 12:38:53.257424 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:53.257346    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-q66cb"
Jul 22 12:38:53.387584 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:53.387549    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-q66cb"]
Jul 22 12:38:53.390255 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:38:53.390219    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod159a8397_dfbe_4612_b07c_9c66ec3c5a68.slice/crio-5232f23ee403eca16bd493ed1c885cfe35115aab8993b055eb14bb9c5a8c72bf WatchSource:0}: Error finding container 5232f23ee403eca16bd493ed1c885cfe35115aab8993b055eb14bb9c5a8c72bf: Status 404 returned error can't find the container with id 5232f23ee403eca16bd493ed1c885cfe35115aab8993b055eb14bb9c5a8c72bf
Jul 22 12:38:53.479505 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:53.479473    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-br64g_8ffd5eeb-b641-4040-ba1b-14a54f34aef2/node-ca/0.log"
Jul 22 12:38:54.069872 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:54.069842    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:38:54.070086 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:54.069963    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 12:38:54.070086 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:54.069975    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79d56886cb-d5nq9: secret "image-registry-tls" not found
Jul 22 12:38:54.070086 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:54.070030    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls podName:46567b42-5787-4eec-8af8-ebafb6f6a45f nodeName:}" failed. No retries permitted until 2026-07-22 12:39:02.070015461 +0000 UTC m=+104.710261683 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls") pod "image-registry-79d56886cb-d5nq9" (UID: "46567b42-5787-4eec-8af8-ebafb6f6a45f") : secret "image-registry-tls" not found
Jul 22 12:38:54.279937 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:54.279898    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-q66cb" event={"ID":"159a8397-dfbe-4612-b07c-9c66ec3c5a68","Type":"ContainerStarted","Data":"5232f23ee403eca16bd493ed1c885cfe35115aab8993b055eb14bb9c5a8c72bf"}
Jul 22 12:38:54.473097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:54.473003    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:54.473547 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:54.473132    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 12:38:54.473547 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:54.473154    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:54.473547 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:54.473201    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-rbac-proxy-cm podName:8c7b90fe-1503-4530-81f4-40e14ac76906 nodeName:}" failed. No retries permitted until 2026-07-22 12:38:58.473184193 +0000 UTC m=+101.113430490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ksc9h" (UID: "8c7b90fe-1503-4530-81f4-40e14ac76906") : configmap "kube-rbac-proxy" not found
Jul 22 12:38:54.473547 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:54.473282    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 12:38:54.473547 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:54.473338    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls podName:8c7b90fe-1503-4530-81f4-40e14ac76906 nodeName:}" failed. No retries permitted until 2026-07-22 12:38:58.473321741 +0000 UTC m=+101.113567973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ksc9h" (UID: "8c7b90fe-1503-4530-81f4-40e14ac76906") : secret "insights-runtime-extractor-tls" not found
Jul 22 12:38:54.680407 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:54.680379    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wd2pd_def9b785-e1bd-4ef9-8542-e4bba57d302c/serve-healthcheck-canary/0.log"
Jul 22 12:38:54.978518 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:54.978481    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-ppbq2\" (UID: \"a34dcc90-9f0b-4076-b343-79a57fd6e3a6\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2"
Jul 22 12:38:54.978701 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:54.978624    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 12:38:54.978761 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:54.978702    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-networking-console-plugin-cert podName:a34dcc90-9f0b-4076-b343-79a57fd6e3a6 nodeName:}" failed. No retries permitted until 2026-07-22 12:38:58.978668148 +0000 UTC m=+101.618914366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-ppbq2" (UID: "a34dcc90-9f0b-4076-b343-79a57fd6e3a6") : secret "networking-console-plugin-cert" not found
Jul 22 12:38:56.287101 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:56.287064    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-q66cb" event={"ID":"159a8397-dfbe-4612-b07c-9c66ec3c5a68","Type":"ContainerStarted","Data":"bb411f3ca14216bfabb30b9c6f98432c0089aa1c745ae7a4a9071f485565c0f7"}
Jul 22 12:38:56.305179 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:56.305131    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-q66cb" podStartSLOduration=2.015031755 podStartE2EDuration="4.305113036s" totalImagesPullingTime="2.290081281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:38:56.304999779 +0000 UTC m=+98.945246021" watchObservedRunningTime="2026-07-22 12:38:56.305113036 +0000 UTC m=+98.945359273"
Jul 22 12:38:56.695696 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:56.695583    2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:38:56.695696 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:56.695653    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:38:56.696091 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:56.696077    2556 scope.go:117] "RemoveContainer" containerID="584bd009d78579188c3cf11975293d0e449625f8a245a0174db39374c7c62da3"
Jul 22 12:38:56.696283 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:56.696260    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-89cqz_openshift-console-operator(3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e)\"" pod="openshift-console-operator/console-operator-565b7b569d-89cqz" podUID="3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e"
Jul 22 12:38:57.196715 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:57.196658    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:38:57.196884 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:57.196806    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 12:38:57.196884 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:57.196875    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls podName:c6a5585b-fbfa-40ab-af2c-a35ad338a96e nodeName:}" failed. No retries permitted until 2026-07-22 12:40:01.196856701 +0000 UTC m=+163.837102921 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls") pod "dns-default-qsxlb" (UID: "c6a5585b-fbfa-40ab-af2c-a35ad338a96e") : secret "dns-default-metrics-tls" not found
Jul 22 12:38:58.506200 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:58.506169    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:58.506583 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:58.506218    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:38:58.506583 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:58.506336    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 12:38:58.506583 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:58.506352    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 12:38:58.506583 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:58.506392    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-rbac-proxy-cm podName:8c7b90fe-1503-4530-81f4-40e14ac76906 nodeName:}" failed. No retries permitted until 2026-07-22 12:39:06.506378341 +0000 UTC m=+109.146624563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ksc9h" (UID: "8c7b90fe-1503-4530-81f4-40e14ac76906") : configmap "kube-rbac-proxy" not found
Jul 22 12:38:58.506583 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:58.506425    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls podName:8c7b90fe-1503-4530-81f4-40e14ac76906 nodeName:}" failed. No retries permitted until 2026-07-22 12:39:06.506406919 +0000 UTC m=+109.146653145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ksc9h" (UID: "8c7b90fe-1503-4530-81f4-40e14ac76906") : secret "insights-runtime-extractor-tls" not found
Jul 22 12:38:59.011302 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:59.011267    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-ppbq2\" (UID: \"a34dcc90-9f0b-4076-b343-79a57fd6e3a6\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2"
Jul 22 12:38:59.011488 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:59.011422    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 12:38:59.011531 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:38:59.011487    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-networking-console-plugin-cert podName:a34dcc90-9f0b-4076-b343-79a57fd6e3a6 nodeName:}" failed. No retries permitted until 2026-07-22 12:39:07.011472003 +0000 UTC m=+109.651718223 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-ppbq2" (UID: "a34dcc90-9f0b-4076-b343-79a57fd6e3a6") : secret "networking-console-plugin-cert" not found
Jul 22 12:38:59.203013 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:38:59.202979    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cgwsm"
Jul 22 12:39:02.136502 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:02.136467    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:39:02.139039 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:02.139017    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls\") pod \"image-registry-79d56886cb-d5nq9\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") " pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:39:02.301736 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:02.301702    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:39:02.443061 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:02.443025    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79d56886cb-d5nq9"]
Jul 22 12:39:02.446787 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:39:02.446763    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46567b42_5787_4eec_8af8_ebafb6f6a45f.slice/crio-9080e202a69fee71c234b2bab187164265116fee8811b13dff2d65e656cecc71 WatchSource:0}: Error finding container 9080e202a69fee71c234b2bab187164265116fee8811b13dff2d65e656cecc71: Status 404 returned error can't find the container with id 9080e202a69fee71c234b2bab187164265116fee8811b13dff2d65e656cecc71
Jul 22 12:39:03.309441 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:03.309403    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79d56886cb-d5nq9" event={"ID":"46567b42-5787-4eec-8af8-ebafb6f6a45f","Type":"ContainerStarted","Data":"57987e8bcdb21a279223e846e3372af224d0f76e4e144f74038a096a44a6491c"}
Jul 22 12:39:03.309972 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:03.309477    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79d56886cb-d5nq9" event={"ID":"46567b42-5787-4eec-8af8-ebafb6f6a45f","Type":"ContainerStarted","Data":"9080e202a69fee71c234b2bab187164265116fee8811b13dff2d65e656cecc71"}
Jul 22 12:39:03.309972 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:03.309561    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:39:03.336335 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:03.336289    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79d56886cb-d5nq9" podStartSLOduration=17.336274707 podStartE2EDuration="17.336274707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:38:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:39:03.335299422 +0000 UTC m=+105.975545669" watchObservedRunningTime="2026-07-22 12:39:03.336274707 +0000 UTC m=+105.976520948"
Jul 22 12:39:06.575314 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:06.575279    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:39:06.575822 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:06.575326    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:39:06.575822 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:39:06.575468    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 12:39:06.575822 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:39:06.575571    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls podName:8c7b90fe-1503-4530-81f4-40e14ac76906 nodeName:}" failed. No retries permitted until 2026-07-22 12:39:22.575549831 +0000 UTC m=+125.215796072 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ksc9h" (UID: "8c7b90fe-1503-4530-81f4-40e14ac76906") : secret "insights-runtime-extractor-tls" not found
Jul 22 12:39:06.575994 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:06.575867    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8c7b90fe-1503-4530-81f4-40e14ac76906-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:39:07.079412 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:07.079374    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-ppbq2\" (UID: \"a34dcc90-9f0b-4076-b343-79a57fd6e3a6\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2"
Jul 22 12:39:07.082041 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:07.082017    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a34dcc90-9f0b-4076-b343-79a57fd6e3a6-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-ppbq2\" (UID: \"a34dcc90-9f0b-4076-b343-79a57fd6e3a6\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2"
Jul 22 12:39:07.171904 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:07.171875    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2"
Jul 22 12:39:07.297039 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:07.296966    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2"]
Jul 22 12:39:07.299492 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:39:07.299461    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda34dcc90_9f0b_4076_b343_79a57fd6e3a6.slice/crio-e564e2e80cbbf0bda7681a8f5459e4833befc0926645dfdb03dcad2a7eef5f74 WatchSource:0}: Error finding container e564e2e80cbbf0bda7681a8f5459e4833befc0926645dfdb03dcad2a7eef5f74: Status 404 returned error can't find the container with id e564e2e80cbbf0bda7681a8f5459e4833befc0926645dfdb03dcad2a7eef5f74
Jul 22 12:39:07.322192 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:07.322164    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2" event={"ID":"a34dcc90-9f0b-4076-b343-79a57fd6e3a6","Type":"ContainerStarted","Data":"e564e2e80cbbf0bda7681a8f5459e4833befc0926645dfdb03dcad2a7eef5f74"}
Jul 22 12:39:08.896011 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:08.895973    2556 scope.go:117] "RemoveContainer" containerID="584bd009d78579188c3cf11975293d0e449625f8a245a0174db39374c7c62da3"
Jul 22 12:39:09.330379 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:09.330351    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 12:39:09.330777 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:09.330761    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/1.log"
Jul 22 12:39:09.330896 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:09.330798    2556 generic.go:356] "Generic (PLEG): container finished" podID="3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e" containerID="81a9a304aa185ae5566aacad90cae06f923594cbdd0899d03ba946f7d6b64df6" exitCode=255
Jul 22 12:39:09.330896 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:09.330874    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-89cqz" event={"ID":"3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e","Type":"ContainerDied","Data":"81a9a304aa185ae5566aacad90cae06f923594cbdd0899d03ba946f7d6b64df6"}
Jul 22 12:39:09.331004 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:09.330944    2556 scope.go:117] "RemoveContainer" containerID="584bd009d78579188c3cf11975293d0e449625f8a245a0174db39374c7c62da3"
Jul 22 12:39:09.331246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:09.331230    2556 scope.go:117] "RemoveContainer" containerID="81a9a304aa185ae5566aacad90cae06f923594cbdd0899d03ba946f7d6b64df6"
Jul 22 12:39:09.331415 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:39:09.331394    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-89cqz_openshift-console-operator(3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e)\"" pod="openshift-console-operator/console-operator-565b7b569d-89cqz" podUID="3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e"
Jul 22 12:39:09.332418 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:09.332386    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2" event={"ID":"a34dcc90-9f0b-4076-b343-79a57fd6e3a6","Type":"ContainerStarted","Data":"e9a2f6e640e534ba9320f1a4c0c6cb36e45a39b548bba2b0c081cd9b91e69147"}
Jul 22 12:39:09.370738 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:09.370699    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-ppbq2" podStartSLOduration=17.152045272 podStartE2EDuration="18.370665855s" totalImagesPullingTime="1.218620583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:39:09.37031061 +0000 UTC m=+112.010556851" watchObservedRunningTime="2026-07-22 12:39:09.370665855 +0000 UTC m=+112.010912095"
Jul 22 12:39:10.337016 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:10.336990    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 12:39:14.545749 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.545718    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79d56886cb-d5nq9"]
Jul 22 12:39:14.589106 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.589077    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d7c7864bb-b8bbp"]
Jul 22 12:39:14.591729 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.591708    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.606838 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.606814    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d7c7864bb-b8bbp"]
Jul 22 12:39:14.737159 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.737130    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20354fab-3de4-4bac-ab80-8882442c7948-trusted-ca\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.737331 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.737168    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb5jx\" (UniqueName: \"kubernetes.io/projected/20354fab-3de4-4bac-ab80-8882442c7948-kube-api-access-tb5jx\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.737331 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.737192    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20354fab-3de4-4bac-ab80-8882442c7948-ca-trust-extracted\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.737331 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.737246    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20354fab-3de4-4bac-ab80-8882442c7948-registry-certificates\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.737331 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.737286    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20354fab-3de4-4bac-ab80-8882442c7948-installation-pull-secrets\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.737331 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.737325    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20354fab-3de4-4bac-ab80-8882442c7948-bound-sa-token\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.737483 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.737353    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20354fab-3de4-4bac-ab80-8882442c7948-registry-tls\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.737483 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.737372    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20354fab-3de4-4bac-ab80-8882442c7948-image-registry-private-configuration\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.838084 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.838001    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20354fab-3de4-4bac-ab80-8882442c7948-registry-tls\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.838084 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.838036    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20354fab-3de4-4bac-ab80-8882442c7948-image-registry-private-configuration\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.838084 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.838071    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20354fab-3de4-4bac-ab80-8882442c7948-trusted-ca\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.838084 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.838089    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb5jx\" (UniqueName: \"kubernetes.io/projected/20354fab-3de4-4bac-ab80-8882442c7948-kube-api-access-tb5jx\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.838420 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.838227    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20354fab-3de4-4bac-ab80-8882442c7948-ca-trust-extracted\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.838420 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.838280    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20354fab-3de4-4bac-ab80-8882442c7948-registry-certificates\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.838420 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.838341    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20354fab-3de4-4bac-ab80-8882442c7948-installation-pull-secrets\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.838420 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.838381    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20354fab-3de4-4bac-ab80-8882442c7948-bound-sa-token\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.838664 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.838616    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20354fab-3de4-4bac-ab80-8882442c7948-ca-trust-extracted\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.839079 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.839055    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20354fab-3de4-4bac-ab80-8882442c7948-registry-certificates\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.839450 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.839426    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20354fab-3de4-4bac-ab80-8882442c7948-trusted-ca\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.840855 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.840834    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20354fab-3de4-4bac-ab80-8882442c7948-installation-pull-secrets\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.840938 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.840852    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20354fab-3de4-4bac-ab80-8882442c7948-image-registry-private-configuration\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.840938 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.840869    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20354fab-3de4-4bac-ab80-8882442c7948-registry-tls\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.848826 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.848803    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20354fab-3de4-4bac-ab80-8882442c7948-bound-sa-token\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.849442 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.849423    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb5jx\" (UniqueName: \"kubernetes.io/projected/20354fab-3de4-4bac-ab80-8882442c7948-kube-api-access-tb5jx\") pod \"image-registry-5d7c7864bb-b8bbp\" (UID: \"20354fab-3de4-4bac-ab80-8882442c7948\") " pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:14.900883 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:14.900858    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:15.028966 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:15.028935    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d7c7864bb-b8bbp"]
Jul 22 12:39:15.031919 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:39:15.031892    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20354fab_3de4_4bac_ab80_8882442c7948.slice/crio-d504faf3e5b2b6aaf6d8c4925d25ef195ef09b3117808c89e4993e5d6edcb5a1 WatchSource:0}: Error finding container d504faf3e5b2b6aaf6d8c4925d25ef195ef09b3117808c89e4993e5d6edcb5a1: Status 404 returned error can't find the container with id d504faf3e5b2b6aaf6d8c4925d25ef195ef09b3117808c89e4993e5d6edcb5a1
Jul 22 12:39:15.354022 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:15.353989    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp" event={"ID":"20354fab-3de4-4bac-ab80-8882442c7948","Type":"ContainerStarted","Data":"d900e9b603fd7c02b50795ee1976b2e6b49d54d6a00afac53d42437675d5b560"}
Jul 22 12:39:15.354208 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:15.354043    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp" event={"ID":"20354fab-3de4-4bac-ab80-8882442c7948","Type":"ContainerStarted","Data":"d504faf3e5b2b6aaf6d8c4925d25ef195ef09b3117808c89e4993e5d6edcb5a1"}
Jul 22 12:39:15.354208 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:15.354133    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:15.410338 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:15.410290    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp" podStartSLOduration=1.410273277 podStartE2EDuration="1.410273277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:39:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:39:15.409928516 +0000 UTC m=+118.050174781" watchObservedRunningTime="2026-07-22 12:39:15.410273277 +0000 UTC m=+118.050519517"
Jul 22 12:39:16.695505 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:16.695455    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:39:16.695995 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:16.695546    2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:39:16.695995 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:16.695861    2556 scope.go:117] "RemoveContainer" containerID="81a9a304aa185ae5566aacad90cae06f923594cbdd0899d03ba946f7d6b64df6"
Jul 22 12:39:16.696067 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:39:16.696010    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-89cqz_openshift-console-operator(3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e)\"" pod="openshift-console-operator/console-operator-565b7b569d-89cqz" podUID="3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e"
Jul 22 12:39:22.595283 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:22.595234    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:39:22.597627 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:22.597607    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8c7b90fe-1503-4530-81f4-40e14ac76906-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ksc9h\" (UID: \"8c7b90fe-1503-4530-81f4-40e14ac76906\") " pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:39:22.860546 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:22.860470    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dmzhg\""
Jul 22 12:39:22.867633 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:22.867614    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ksc9h"
Jul 22 12:39:22.994301 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:22.994267    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ksc9h"]
Jul 22 12:39:22.997227 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:39:22.997200    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7b90fe_1503_4530_81f4_40e14ac76906.slice/crio-137ff91ed4f216b5ae447a5ec7afb332e8c3cd5651bcdb444d45ecfc7573d55e WatchSource:0}: Error finding container 137ff91ed4f216b5ae447a5ec7afb332e8c3cd5651bcdb444d45ecfc7573d55e: Status 404 returned error can't find the container with id 137ff91ed4f216b5ae447a5ec7afb332e8c3cd5651bcdb444d45ecfc7573d55e
Jul 22 12:39:23.378371 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:23.378327    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ksc9h" event={"ID":"8c7b90fe-1503-4530-81f4-40e14ac76906","Type":"ContainerStarted","Data":"137ff91ed4f216b5ae447a5ec7afb332e8c3cd5651bcdb444d45ecfc7573d55e"}
Jul 22 12:39:24.552141 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:24.552093    2556 patch_prober.go:28] interesting pod/image-registry-79d56886cb-d5nq9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 22 12:39:24.552575 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:24.552164    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-79d56886cb-d5nq9" podUID="46567b42-5787-4eec-8af8-ebafb6f6a45f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 12:39:26.733008 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:26.732969    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs\") pod \"network-metrics-daemon-jvncr\" (UID: \"8b097cfe-19a9-4eee-980f-3a19a58f6d0d\") " pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:39:26.735921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:26.735896    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b097cfe-19a9-4eee-980f-3a19a58f6d0d-metrics-certs\") pod \"network-metrics-daemon-jvncr\" (UID: \"8b097cfe-19a9-4eee-980f-3a19a58f6d0d\") " pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:39:27.012122 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:27.012058    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j8xb2\""
Jul 22 12:39:27.020115 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:27.020099    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jvncr"
Jul 22 12:39:27.877574 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:27.877547    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jvncr"]
Jul 22 12:39:27.880183 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:39:27.880144    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b097cfe_19a9_4eee_980f_3a19a58f6d0d.slice/crio-f4527950a3f242971ca8edb488102fb6b7005ae9d197d3c2efdd4522775342bb WatchSource:0}: Error finding container f4527950a3f242971ca8edb488102fb6b7005ae9d197d3c2efdd4522775342bb: Status 404 returned error can't find the container with id f4527950a3f242971ca8edb488102fb6b7005ae9d197d3c2efdd4522775342bb
Jul 22 12:39:28.401913 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:28.401830    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ksc9h" event={"ID":"8c7b90fe-1503-4530-81f4-40e14ac76906","Type":"ContainerStarted","Data":"d0c7eb72a4bcd777f8decf07cef407f11448a97db522585f69847939f7450b0d"}
Jul 22 12:39:28.403931 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:28.403894    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jvncr" event={"ID":"8b097cfe-19a9-4eee-980f-3a19a58f6d0d","Type":"ContainerStarted","Data":"f4527950a3f242971ca8edb488102fb6b7005ae9d197d3c2efdd4522775342bb"}
Jul 22 12:39:29.409521 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:29.409482    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jvncr" event={"ID":"8b097cfe-19a9-4eee-980f-3a19a58f6d0d","Type":"ContainerStarted","Data":"4cf89e86b851fa81454c7170c5935ba4a62cf5b5e13d1d486dfb91f9e746afb3"}
Jul 22 12:39:29.409948 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:29.409547    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jvncr" event={"ID":"8b097cfe-19a9-4eee-980f-3a19a58f6d0d","Type":"ContainerStarted","Data":"9b44529fc9fab6e4b8212dad686d99fc4599652b8542d718dcf1a84cfa4e9afd"}
Jul 22 12:39:29.427696 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:29.427625    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jvncr" podStartSLOduration=131.296081717 podStartE2EDuration="2m12.4276102s" totalImagesPullingTime="1.131528483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:39:29.427210421 +0000 UTC m=+132.067456662" watchObservedRunningTime="2026-07-22 12:39:29.4276102 +0000 UTC m=+132.067856442"
Jul 22 12:39:29.896073 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:29.896040    2556 scope.go:117] "RemoveContainer" containerID="81a9a304aa185ae5566aacad90cae06f923594cbdd0899d03ba946f7d6b64df6"
Jul 22 12:39:31.424455 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:31.424435    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 12:39:31.424791 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:31.424516    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-89cqz" event={"ID":"3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e","Type":"ContainerStarted","Data":"65c9037f4946d48a4fc2ef3d70024e36bc7857d9c6fa9bde26358c95055bd7df"}
Jul 22 12:39:31.424854 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:31.424814    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:39:31.426223 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:31.426197    2556 patch_prober.go:28] interesting pod/console-operator-565b7b569d-89cqz container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.133.0.8:8443/readyz\": dial tcp 10.133.0.8:8443: connect: connection refused" start-of-body=
Jul 22 12:39:31.426314 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:31.426256    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-89cqz" podUID="3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e" containerName="console-operator" probeResult="failure" output="Get \"https://10.133.0.8:8443/readyz\": dial tcp 10.133.0.8:8443: connect: connection refused"
Jul 22 12:39:31.447105 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:31.447061    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-89cqz" podStartSLOduration=42.489687883 podStartE2EDuration="45.447044891s" totalImagesPullingTime="2.957357008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:39:31.446171849 +0000 UTC m=+134.086418102" watchObservedRunningTime="2026-07-22 12:39:31.447044891 +0000 UTC m=+134.087291159"
Jul 22 12:39:32.429991 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:32.429955    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ksc9h" event={"ID":"8c7b90fe-1503-4530-81f4-40e14ac76906","Type":"ContainerStarted","Data":"07d74784b750487df5cbca49afd2ee0ddb66e5678c41ce0005f0121c6838415d"}
Jul 22 12:39:32.434019 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:32.433996    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-89cqz"
Jul 22 12:39:32.532175 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:32.532146    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-kt2xp"]
Jul 22 12:39:32.535242 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:32.535226    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-kt2xp"
Jul 22 12:39:32.538480 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:32.538457    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 22 12:39:32.538480 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:32.538457    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-265nl\""
Jul 22 12:39:32.538654 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:32.538522    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 22 12:39:32.550035 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:32.550015    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-kt2xp"]
Jul 22 12:39:32.682697 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:32.682615    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc54r\" (UniqueName: \"kubernetes.io/projected/fb6be504-30f3-42cc-a1c4-2e8f7b877b10-kube-api-access-qc54r\") pod \"downloads-5bc67dcd46-kt2xp\" (UID: \"fb6be504-30f3-42cc-a1c4-2e8f7b877b10\") " pod="openshift-console/downloads-5bc67dcd46-kt2xp"
Jul 22 12:39:32.783689 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:32.783654    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc54r\" (UniqueName: \"kubernetes.io/projected/fb6be504-30f3-42cc-a1c4-2e8f7b877b10-kube-api-access-qc54r\") pod \"downloads-5bc67dcd46-kt2xp\" (UID: \"fb6be504-30f3-42cc-a1c4-2e8f7b877b10\") " pod="openshift-console/downloads-5bc67dcd46-kt2xp"
Jul 22 12:39:32.793533 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:32.793496    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc54r\" (UniqueName: \"kubernetes.io/projected/fb6be504-30f3-42cc-a1c4-2e8f7b877b10-kube-api-access-qc54r\") pod \"downloads-5bc67dcd46-kt2xp\" (UID: \"fb6be504-30f3-42cc-a1c4-2e8f7b877b10\") " pod="openshift-console/downloads-5bc67dcd46-kt2xp"
Jul 22 12:39:32.844321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:32.844282    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-kt2xp"
Jul 22 12:39:32.991786 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:32.991737    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-kt2xp"]
Jul 22 12:39:32.995580 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:39:32.995551    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb6be504_30f3_42cc_a1c4_2e8f7b877b10.slice/crio-47ea5c7ee141d71e52035213a24299cf8825d4387482e901458c0d6bf7f0afec WatchSource:0}: Error finding container 47ea5c7ee141d71e52035213a24299cf8825d4387482e901458c0d6bf7f0afec: Status 404 returned error can't find the container with id 47ea5c7ee141d71e52035213a24299cf8825d4387482e901458c0d6bf7f0afec
Jul 22 12:39:33.434800 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:33.434754    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-kt2xp" event={"ID":"fb6be504-30f3-42cc-a1c4-2e8f7b877b10","Type":"ContainerStarted","Data":"47ea5c7ee141d71e52035213a24299cf8825d4387482e901458c0d6bf7f0afec"}
Jul 22 12:39:34.374895 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.374018    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm"]
Jul 22 12:39:34.385058 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.382655    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm"
Jul 22 12:39:34.391483 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.389042    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-w8lsf\""
Jul 22 12:39:34.391483 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.390948    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm"]
Jul 22 12:39:34.391483 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.391048    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 22 12:39:34.391483 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.391308    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 22 12:39:34.392250 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.392214    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 12:39:34.392528 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.392510    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 12:39:34.392963 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.392943    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 12:39:34.435791 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.435759    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-787mc"]
Jul 22 12:39:34.440474 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.440015    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.442932 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.442912    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 12:39:34.444778 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.443476    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 12:39:34.444778 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.443735    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 12:39:34.444778 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.443929    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vqfsx\""
Jul 22 12:39:34.498598 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.498567    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d21c7c7-a270-4615-bcfe-9f0dcc12c049-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-fxxsm\" (UID: \"7d21c7c7-a270-4615-bcfe-9f0dcc12c049\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm"
Jul 22 12:39:34.498805 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.498616    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d21c7c7-a270-4615-bcfe-9f0dcc12c049-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-fxxsm\" (UID: \"7d21c7c7-a270-4615-bcfe-9f0dcc12c049\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm"
Jul 22 12:39:34.498805 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.498645    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7zr6\" (UniqueName: \"kubernetes.io/projected/7d21c7c7-a270-4615-bcfe-9f0dcc12c049-kube-api-access-t7zr6\") pod \"openshift-state-metrics-79f6958cdf-fxxsm\" (UID: \"7d21c7c7-a270-4615-bcfe-9f0dcc12c049\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm"
Jul 22 12:39:34.498805 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.498713    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d21c7c7-a270-4615-bcfe-9f0dcc12c049-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-fxxsm\" (UID: \"7d21c7c7-a270-4615-bcfe-9f0dcc12c049\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm"
Jul 22 12:39:34.554701 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.552781    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:39:34.607986 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.600958    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e58265b-a1fc-46d6-be7c-65fb231c8a08-sys\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.607986 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.601018    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.607986 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.601063    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-accelerators-collector-config\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.607986 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.601129    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjb5b\" (UniqueName: \"kubernetes.io/projected/6e58265b-a1fc-46d6-be7c-65fb231c8a08-kube-api-access-fjb5b\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.607986 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.601170    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e58265b-a1fc-46d6-be7c-65fb231c8a08-root\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.607986 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.601203    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d21c7c7-a270-4615-bcfe-9f0dcc12c049-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-fxxsm\" (UID: \"7d21c7c7-a270-4615-bcfe-9f0dcc12c049\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm"
Jul 22 12:39:34.607986 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.601253    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d21c7c7-a270-4615-bcfe-9f0dcc12c049-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-fxxsm\" (UID: \"7d21c7c7-a270-4615-bcfe-9f0dcc12c049\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm"
Jul 22 12:39:34.607986 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.601279    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7zr6\" (UniqueName: \"kubernetes.io/projected/7d21c7c7-a270-4615-bcfe-9f0dcc12c049-kube-api-access-t7zr6\") pod \"openshift-state-metrics-79f6958cdf-fxxsm\" (UID: \"7d21c7c7-a270-4615-bcfe-9f0dcc12c049\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm"
Jul 22 12:39:34.607986 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.601324    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-textfile\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.607986 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.601348    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-tls\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.607986 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.601371    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-wtmp\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.607986 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.601410    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e58265b-a1fc-46d6-be7c-65fb231c8a08-metrics-client-ca\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.607986 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.601459    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d21c7c7-a270-4615-bcfe-9f0dcc12c049-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-fxxsm\" (UID: \"7d21c7c7-a270-4615-bcfe-9f0dcc12c049\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm"
Jul 22 12:39:34.607986 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:39:34.601642    2556 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 22 12:39:34.607986 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:39:34.601724    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d21c7c7-a270-4615-bcfe-9f0dcc12c049-openshift-state-metrics-tls podName:7d21c7c7-a270-4615-bcfe-9f0dcc12c049 nodeName:}" failed. No retries permitted until 2026-07-22 12:39:35.101705513 +0000 UTC m=+137.741951737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7d21c7c7-a270-4615-bcfe-9f0dcc12c049-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-fxxsm" (UID: "7d21c7c7-a270-4615-bcfe-9f0dcc12c049") : secret "openshift-state-metrics-tls" not found
Jul 22 12:39:34.608885 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.602996    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d21c7c7-a270-4615-bcfe-9f0dcc12c049-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-fxxsm\" (UID: \"7d21c7c7-a270-4615-bcfe-9f0dcc12c049\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm"
Jul 22 12:39:34.618700 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.614878    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d21c7c7-a270-4615-bcfe-9f0dcc12c049-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-fxxsm\" (UID: \"7d21c7c7-a270-4615-bcfe-9f0dcc12c049\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm"
Jul 22 12:39:34.626983 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.625947    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7zr6\" (UniqueName: \"kubernetes.io/projected/7d21c7c7-a270-4615-bcfe-9f0dcc12c049-kube-api-access-t7zr6\") pod \"openshift-state-metrics-79f6958cdf-fxxsm\" (UID: \"7d21c7c7-a270-4615-bcfe-9f0dcc12c049\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm"
Jul 22 12:39:34.705889 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.703029    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.705889 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.703094    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-accelerators-collector-config\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.705889 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.703151    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjb5b\" (UniqueName: \"kubernetes.io/projected/6e58265b-a1fc-46d6-be7c-65fb231c8a08-kube-api-access-fjb5b\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.705889 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.703177    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e58265b-a1fc-46d6-be7c-65fb231c8a08-root\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.705889 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.703224    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-textfile\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.705889 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.703248    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-tls\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.705889 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.703270    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-wtmp\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.705889 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.703292    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e58265b-a1fc-46d6-be7c-65fb231c8a08-metrics-client-ca\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.705889 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.703374    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e58265b-a1fc-46d6-be7c-65fb231c8a08-sys\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.705889 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.703452    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e58265b-a1fc-46d6-be7c-65fb231c8a08-sys\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.705889 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.704140    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-textfile\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.705889 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.704651    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-accelerators-collector-config\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.705889 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.704994    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e58265b-a1fc-46d6-be7c-65fb231c8a08-root\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.705889 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.705118    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-wtmp\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.705889 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:39:34.705190    2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 22 12:39:34.705889 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:39:34.705242    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-tls podName:6e58265b-a1fc-46d6-be7c-65fb231c8a08 nodeName:}" failed. No retries permitted until 2026-07-22 12:39:35.205224264 +0000 UTC m=+137.845470507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-tls") pod "node-exporter-787mc" (UID: "6e58265b-a1fc-46d6-be7c-65fb231c8a08") : secret "node-exporter-tls" not found
Jul 22 12:39:34.705889 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.705848    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e58265b-a1fc-46d6-be7c-65fb231c8a08-metrics-client-ca\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.707280 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.707234    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:34.722187 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:34.722141    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjb5b\" (UniqueName: \"kubernetes.io/projected/6e58265b-a1fc-46d6-be7c-65fb231c8a08-kube-api-access-fjb5b\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:35.108635 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.108596    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d21c7c7-a270-4615-bcfe-9f0dcc12c049-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-fxxsm\" (UID: \"7d21c7c7-a270-4615-bcfe-9f0dcc12c049\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm"
Jul 22 12:39:35.112995 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.112957    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d21c7c7-a270-4615-bcfe-9f0dcc12c049-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-fxxsm\" (UID: \"7d21c7c7-a270-4615-bcfe-9f0dcc12c049\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm"
Jul 22 12:39:35.213718 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.213076    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-tls\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:35.213718 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:39:35.213292    2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 22 12:39:35.213718 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:39:35.213355    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-tls podName:6e58265b-a1fc-46d6-be7c-65fb231c8a08 nodeName:}" failed. No retries permitted until 2026-07-22 12:39:36.213335867 +0000 UTC m=+138.853582095 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-tls") pod "node-exporter-787mc" (UID: "6e58265b-a1fc-46d6-be7c-65fb231c8a08") : secret "node-exporter-tls" not found
Jul 22 12:39:35.301496 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.301281    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm"
Jul 22 12:39:35.371074 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.370997    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 12:39:35.376586 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.375449    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.378403 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.378238    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 22 12:39:35.382452 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.379313    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 22 12:39:35.382452 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.379507    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 22 12:39:35.382452 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.379664    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 22 12:39:35.382452 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.379886    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hxsdw\""
Jul 22 12:39:35.382452 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.380027    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 22 12:39:35.382452 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.380229    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 22 12:39:35.382452 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.380409    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 22 12:39:35.382452 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.380561    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 22 12:39:35.382452 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.380865    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 22 12:39:35.392099 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.391532    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 12:39:35.515664 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.515628    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38942e45-eba8-4287-9890-c42c96a2ddf3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.516112 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.515698    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38942e45-eba8-4287-9890-c42c96a2ddf3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.516112 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.515725    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.516112 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.515801    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38942e45-eba8-4287-9890-c42c96a2ddf3-config-out\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.516112 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.515899    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38942e45-eba8-4287-9890-c42c96a2ddf3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.516112 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.515959    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.516112 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.516009    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnx5p\" (UniqueName: \"kubernetes.io/projected/38942e45-eba8-4287-9890-c42c96a2ddf3-kube-api-access-nnx5p\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.516112 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.516031    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.516112 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.516062    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.516112 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.516098    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-config-volume\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.516623 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.516127    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38942e45-eba8-4287-9890-c42c96a2ddf3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.516623 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.516163    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-web-config\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.516623 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.516204    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.617961 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.617157    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38942e45-eba8-4287-9890-c42c96a2ddf3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.617961 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.617223    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.617961 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.617256    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnx5p\" (UniqueName: \"kubernetes.io/projected/38942e45-eba8-4287-9890-c42c96a2ddf3-kube-api-access-nnx5p\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.617961 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.617282    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.617961 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.617330    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.617961 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.617364    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-config-volume\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.617961 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.617406    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38942e45-eba8-4287-9890-c42c96a2ddf3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.617961 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.617431    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-web-config\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.617961 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.617458    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.617961 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.617493    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38942e45-eba8-4287-9890-c42c96a2ddf3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.617961 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.617518    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38942e45-eba8-4287-9890-c42c96a2ddf3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.617961 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.617550    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.617961 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.617595    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38942e45-eba8-4287-9890-c42c96a2ddf3-config-out\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.618690 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.618081    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38942e45-eba8-4287-9890-c42c96a2ddf3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.619660 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.619040    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38942e45-eba8-4287-9890-c42c96a2ddf3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.619660 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.619422    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38942e45-eba8-4287-9890-c42c96a2ddf3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.621477 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.621423    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-config-volume\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.622055 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.622025    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.622479 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.622454    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-web-config\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.622987 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.622965    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.623346 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.623285    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38942e45-eba8-4287-9890-c42c96a2ddf3-config-out\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.623990 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.623928    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.624390 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.624366    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.625170 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.625135    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38942e45-eba8-4287-9890-c42c96a2ddf3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.625838 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.625798    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.627847 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.627807    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnx5p\" (UniqueName: \"kubernetes.io/projected/38942e45-eba8-4287-9890-c42c96a2ddf3-kube-api-access-nnx5p\") pod \"alertmanager-main-0\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:35.696234 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:35.696112    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:39:36.224078 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.224043    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-tls\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:36.227276 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.227251    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e58265b-a1fc-46d6-be7c-65fb231c8a08-node-exporter-tls\") pod \"node-exporter-787mc\" (UID: \"6e58265b-a1fc-46d6-be7c-65fb231c8a08\") " pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:36.254353 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.254314    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-787mc"
Jul 22 12:39:36.362215 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.362188    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d7c7864bb-b8bbp"
Jul 22 12:39:36.424728 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.424421    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f84766c77-c47db"]
Jul 22 12:39:36.430370 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.429791    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.433303 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.433276    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 22 12:39:36.433421 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.433354    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 22 12:39:36.433511 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.433481    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 22 12:39:36.433657 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.433557    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 22 12:39:36.434578 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.433783    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 22 12:39:36.434578 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.433945    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-34uudtvi0ns5j\""
Jul 22 12:39:36.434578 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.434105    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-smgzj\""
Jul 22 12:39:36.442585 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.442562    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f84766c77-c47db"]
Jul 22 12:39:36.526840 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.526799    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/51144f25-a093-4099-bb89-2387561ac66c-secret-thanos-querier-tls\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.526840 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.526841    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51144f25-a093-4099-bb89-2387561ac66c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.527327 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.526865    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51144f25-a093-4099-bb89-2387561ac66c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.527327 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.526947    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/51144f25-a093-4099-bb89-2387561ac66c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.527327 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.526992    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51144f25-a093-4099-bb89-2387561ac66c-metrics-client-ca\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.527327 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.527071    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/51144f25-a093-4099-bb89-2387561ac66c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.527327 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.527106    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51144f25-a093-4099-bb89-2387561ac66c-secret-grpc-tls\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.527536 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.527370    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp79p\" (UniqueName: \"kubernetes.io/projected/51144f25-a093-4099-bb89-2387561ac66c-kube-api-access-hp79p\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.581069 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:39:36.581035    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e58265b_a1fc_46d6_be7c_65fb231c8a08.slice/crio-9dc5937cfd457b0c4a751cef77394d554c532d63b01494b5d0d895eb3bd50819 WatchSource:0}: Error finding container 9dc5937cfd457b0c4a751cef77394d554c532d63b01494b5d0d895eb3bd50819: Status 404 returned error can't find the container with id 9dc5937cfd457b0c4a751cef77394d554c532d63b01494b5d0d895eb3bd50819
Jul 22 12:39:36.628302 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.628266    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51144f25-a093-4099-bb89-2387561ac66c-secret-grpc-tls\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.628435 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.628360    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp79p\" (UniqueName: \"kubernetes.io/projected/51144f25-a093-4099-bb89-2387561ac66c-kube-api-access-hp79p\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.628435 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.628408    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/51144f25-a093-4099-bb89-2387561ac66c-secret-thanos-querier-tls\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.628551 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.628446    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51144f25-a093-4099-bb89-2387561ac66c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.628551 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.628474    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51144f25-a093-4099-bb89-2387561ac66c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.628551 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.628519    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/51144f25-a093-4099-bb89-2387561ac66c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.628551 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.628547    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51144f25-a093-4099-bb89-2387561ac66c-metrics-client-ca\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.628765 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.628604    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/51144f25-a093-4099-bb89-2387561ac66c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.632441 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.632068    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51144f25-a093-4099-bb89-2387561ac66c-metrics-client-ca\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.635503 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.635343    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/51144f25-a093-4099-bb89-2387561ac66c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.641739 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.636975    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51144f25-a093-4099-bb89-2387561ac66c-secret-grpc-tls\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.642479 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.642414    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/51144f25-a093-4099-bb89-2387561ac66c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.644951 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.644512    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51144f25-a093-4099-bb89-2387561ac66c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.645096 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.645057    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/51144f25-a093-4099-bb89-2387561ac66c-secret-thanos-querier-tls\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.645876 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.645833    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51144f25-a093-4099-bb89-2387561ac66c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.648365 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.648307    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp79p\" (UniqueName: \"kubernetes.io/projected/51144f25-a093-4099-bb89-2387561ac66c-kube-api-access-hp79p\") pod \"thanos-querier-7f84766c77-c47db\" (UID: \"51144f25-a093-4099-bb89-2387561ac66c\") " pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.735524 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.735499    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm"]
Jul 22 12:39:36.738149 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:39:36.738122    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d21c7c7_a270_4615_bcfe_9f0dcc12c049.slice/crio-8668c9b001e04db8fd877452153c6410f388f534e4b3ecad084a9a8f59711fed WatchSource:0}: Error finding container 8668c9b001e04db8fd877452153c6410f388f534e4b3ecad084a9a8f59711fed: Status 404 returned error can't find the container with id 8668c9b001e04db8fd877452153c6410f388f534e4b3ecad084a9a8f59711fed
Jul 22 12:39:36.744380 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.744353    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:36.779311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.779233    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 12:39:36.909904 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:36.909804    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f84766c77-c47db"]
Jul 22 12:39:36.914986 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:39:36.914957    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51144f25_a093_4099_bb89_2387561ac66c.slice/crio-2eb5e593e78f67f19af3983150b278bb7c344bfe2e050e834ca013d3bd090340 WatchSource:0}: Error finding container 2eb5e593e78f67f19af3983150b278bb7c344bfe2e050e834ca013d3bd090340: Status 404 returned error can't find the container with id 2eb5e593e78f67f19af3983150b278bb7c344bfe2e050e834ca013d3bd090340
Jul 22 12:39:37.459858 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:37.459759    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f84766c77-c47db" event={"ID":"51144f25-a093-4099-bb89-2387561ac66c","Type":"ContainerStarted","Data":"2eb5e593e78f67f19af3983150b278bb7c344bfe2e050e834ca013d3bd090340"}
Jul 22 12:39:37.461882 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:37.461851    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-787mc" event={"ID":"6e58265b-a1fc-46d6-be7c-65fb231c8a08","Type":"ContainerStarted","Data":"9dc5937cfd457b0c4a751cef77394d554c532d63b01494b5d0d895eb3bd50819"}
Jul 22 12:39:37.465026 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:37.464996    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm" event={"ID":"7d21c7c7-a270-4615-bcfe-9f0dcc12c049","Type":"ContainerStarted","Data":"24af344259c1a6ac917b49bc49043f43694ddb07aefd3feb093ab6adbd641bf6"}
Jul 22 12:39:37.465132 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:37.465062    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm" event={"ID":"7d21c7c7-a270-4615-bcfe-9f0dcc12c049","Type":"ContainerStarted","Data":"90bf2fdd0c8226bfe6622f6e8d456647f7f81397aafc968beaf19c0810177424"}
Jul 22 12:39:37.465132 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:37.465091    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm" event={"ID":"7d21c7c7-a270-4615-bcfe-9f0dcc12c049","Type":"ContainerStarted","Data":"8668c9b001e04db8fd877452153c6410f388f534e4b3ecad084a9a8f59711fed"}
Jul 22 12:39:37.469321 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:37.469294    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ksc9h" event={"ID":"8c7b90fe-1503-4530-81f4-40e14ac76906","Type":"ContainerStarted","Data":"088aae47fb017e371ad950c9bebde96431e7515737f4c7319d83d49440b71fb3"}
Jul 22 12:39:37.472566 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:37.472529    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38942e45-eba8-4287-9890-c42c96a2ddf3","Type":"ContainerStarted","Data":"99a56a9707d970727e65f0a5ad3b97b334c11d62dd71ce2751d69660ece1c9d2"}
Jul 22 12:39:37.490645 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:37.489874    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ksc9h" podStartSLOduration=33.98987046 podStartE2EDuration="47.489854663s" totalImagesPullingTime="13.499984203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:38:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:39:37.489618728 +0000 UTC m=+140.129864970" watchObservedRunningTime="2026-07-22 12:39:37.489854663 +0000 UTC m=+140.130100905"
Jul 22 12:39:39.094974 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.094941    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xmcs8"]
Jul 22 12:39:39.099055 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.099032    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xmcs8"
Jul 22 12:39:39.101926 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.101619    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 22 12:39:39.101926 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.101808    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-bblvr\""
Jul 22 12:39:39.108502 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.108292    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xmcs8"]
Jul 22 12:39:39.153621 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.153586    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/992af211-2ed0-4604-ba11-2ed428cd37bd-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-xmcs8\" (UID: \"992af211-2ed0-4604-ba11-2ed428cd37bd\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xmcs8"
Jul 22 12:39:39.153804 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.153718    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pzgp\" (UniqueName: \"kubernetes.io/projected/992af211-2ed0-4604-ba11-2ed428cd37bd-kube-api-access-9pzgp\") pod \"monitoring-plugin-7b7b7bc8bf-xmcs8\" (UID: \"992af211-2ed0-4604-ba11-2ed428cd37bd\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xmcs8"
Jul 22 12:39:39.255335 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.254937    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/992af211-2ed0-4604-ba11-2ed428cd37bd-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-xmcs8\" (UID: \"992af211-2ed0-4604-ba11-2ed428cd37bd\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xmcs8"
Jul 22 12:39:39.255335 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.255009    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pzgp\" (UniqueName: \"kubernetes.io/projected/992af211-2ed0-4604-ba11-2ed428cd37bd-kube-api-access-9pzgp\") pod \"monitoring-plugin-7b7b7bc8bf-xmcs8\" (UID: \"992af211-2ed0-4604-ba11-2ed428cd37bd\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xmcs8"
Jul 22 12:39:39.258183 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.258153    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/992af211-2ed0-4604-ba11-2ed428cd37bd-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-xmcs8\" (UID: \"992af211-2ed0-4604-ba11-2ed428cd37bd\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xmcs8"
Jul 22 12:39:39.264812 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.264769    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pzgp\" (UniqueName: \"kubernetes.io/projected/992af211-2ed0-4604-ba11-2ed428cd37bd-kube-api-access-9pzgp\") pod \"monitoring-plugin-7b7b7bc8bf-xmcs8\" (UID: \"992af211-2ed0-4604-ba11-2ed428cd37bd\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xmcs8"
Jul 22 12:39:39.414881 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.414811    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xmcs8"
Jul 22 12:39:39.486708 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.486188    2556 generic.go:356] "Generic (PLEG): container finished" podID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerID="bd98ab75000d32aa2e83cd46f70889ef939fb047a6bd364ff4a210c0498d3829" exitCode=0
Jul 22 12:39:39.486708 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.486277    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38942e45-eba8-4287-9890-c42c96a2ddf3","Type":"ContainerDied","Data":"bd98ab75000d32aa2e83cd46f70889ef939fb047a6bd364ff4a210c0498d3829"}
Jul 22 12:39:39.489281 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.489031    2556 generic.go:356] "Generic (PLEG): container finished" podID="6e58265b-a1fc-46d6-be7c-65fb231c8a08" containerID="e8aba718f33f68fc559e88392aef687279399e03049d9250c0b917109b92cb17" exitCode=0
Jul 22 12:39:39.489281 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.489121    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-787mc" event={"ID":"6e58265b-a1fc-46d6-be7c-65fb231c8a08","Type":"ContainerDied","Data":"e8aba718f33f68fc559e88392aef687279399e03049d9250c0b917109b92cb17"}
Jul 22 12:39:39.495065 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.495033    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm" event={"ID":"7d21c7c7-a270-4615-bcfe-9f0dcc12c049","Type":"ContainerStarted","Data":"29421325e2220ada04ec531e0213dc50353e6900404f2dede30759663ac8271b"}
Jul 22 12:39:39.561270 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.561214    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-fxxsm" podStartSLOduration=3.791121887 podStartE2EDuration="5.561195313s" totalImagesPullingTime="1.770073426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:39:39.558247084 +0000 UTC m=+142.198493325" watchObservedRunningTime="2026-07-22 12:39:39.561195313 +0000 UTC m=+142.201441555"
Jul 22 12:39:39.566100 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.566063    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-79d56886cb-d5nq9" podUID="46567b42-5787-4eec-8af8-ebafb6f6a45f" containerName="registry" containerID="cri-o://57987e8bcdb21a279223e846e3372af224d0f76e4e144f74038a096a44a6491c" gracePeriod=30
Jul 22 12:39:39.585104 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.585052    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xmcs8"]
Jul 22 12:39:39.613646 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:39:39.613616    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992af211_2ed0_4604_ba11_2ed428cd37bd.slice/crio-2f93f88328c8e391e0a5d8790306aa59561da193bdac23d392ce56276f6475dd WatchSource:0}: Error finding container 2f93f88328c8e391e0a5d8790306aa59561da193bdac23d392ce56276f6475dd: Status 404 returned error can't find the container with id 2f93f88328c8e391e0a5d8790306aa59561da193bdac23d392ce56276f6475dd
Jul 22 12:39:39.845912 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.845890    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:39:39.862471 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.862445    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46567b42-5787-4eec-8af8-ebafb6f6a45f-trusted-ca\") pod \"46567b42-5787-4eec-8af8-ebafb6f6a45f\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") "
Jul 22 12:39:39.862615 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.862506    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/46567b42-5787-4eec-8af8-ebafb6f6a45f-ca-trust-extracted\") pod \"46567b42-5787-4eec-8af8-ebafb6f6a45f\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") "
Jul 22 12:39:39.862615 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.862554    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls\") pod \"46567b42-5787-4eec-8af8-ebafb6f6a45f\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") "
Jul 22 12:39:39.862615 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.862603    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/46567b42-5787-4eec-8af8-ebafb6f6a45f-image-registry-private-configuration\") pod \"46567b42-5787-4eec-8af8-ebafb6f6a45f\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") "
Jul 22 12:39:39.862816 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.862639    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-bound-sa-token\") pod \"46567b42-5787-4eec-8af8-ebafb6f6a45f\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") "
Jul 22 12:39:39.862816 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.862663    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/46567b42-5787-4eec-8af8-ebafb6f6a45f-installation-pull-secrets\") pod \"46567b42-5787-4eec-8af8-ebafb6f6a45f\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") "
Jul 22 12:39:39.862816 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.862702    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-certificates\") pod \"46567b42-5787-4eec-8af8-ebafb6f6a45f\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") "
Jul 22 12:39:39.862816 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.862760    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtk7g\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-kube-api-access-qtk7g\") pod \"46567b42-5787-4eec-8af8-ebafb6f6a45f\" (UID: \"46567b42-5787-4eec-8af8-ebafb6f6a45f\") "
Jul 22 12:39:39.863007 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.862898    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46567b42-5787-4eec-8af8-ebafb6f6a45f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "46567b42-5787-4eec-8af8-ebafb6f6a45f" (UID: "46567b42-5787-4eec-8af8-ebafb6f6a45f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:39:39.863088 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.863070    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/46567b42-5787-4eec-8af8-ebafb6f6a45f-trusted-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:39:39.863736 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.863710    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "46567b42-5787-4eec-8af8-ebafb6f6a45f" (UID: "46567b42-5787-4eec-8af8-ebafb6f6a45f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:39:39.865613 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.865587    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "46567b42-5787-4eec-8af8-ebafb6f6a45f" (UID: "46567b42-5787-4eec-8af8-ebafb6f6a45f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:39:39.865724 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.865653    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46567b42-5787-4eec-8af8-ebafb6f6a45f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "46567b42-5787-4eec-8af8-ebafb6f6a45f" (UID: "46567b42-5787-4eec-8af8-ebafb6f6a45f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:39:39.867898 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.867864    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-kube-api-access-qtk7g" (OuterVolumeSpecName: "kube-api-access-qtk7g") pod "46567b42-5787-4eec-8af8-ebafb6f6a45f" (UID: "46567b42-5787-4eec-8af8-ebafb6f6a45f"). InnerVolumeSpecName "kube-api-access-qtk7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:39:39.867898 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.867867    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46567b42-5787-4eec-8af8-ebafb6f6a45f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "46567b42-5787-4eec-8af8-ebafb6f6a45f" (UID: "46567b42-5787-4eec-8af8-ebafb6f6a45f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:39:39.868641 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.868621    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "46567b42-5787-4eec-8af8-ebafb6f6a45f" (UID: "46567b42-5787-4eec-8af8-ebafb6f6a45f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:39:39.873583 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.873558    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46567b42-5787-4eec-8af8-ebafb6f6a45f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "46567b42-5787-4eec-8af8-ebafb6f6a45f" (UID: "46567b42-5787-4eec-8af8-ebafb6f6a45f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:39:39.963807 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.963738    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-tls\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:39:39.963807 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.963769    2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/46567b42-5787-4eec-8af8-ebafb6f6a45f-image-registry-private-configuration\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:39:39.963807 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.963784    2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-bound-sa-token\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:39:39.963807 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.963797    2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/46567b42-5787-4eec-8af8-ebafb6f6a45f-installation-pull-secrets\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:39:39.964106 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.963811    2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/46567b42-5787-4eec-8af8-ebafb6f6a45f-registry-certificates\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:39:39.964106 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.963827    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtk7g\" (UniqueName: \"kubernetes.io/projected/46567b42-5787-4eec-8af8-ebafb6f6a45f-kube-api-access-qtk7g\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:39:39.964106 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:39.963840    2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/46567b42-5787-4eec-8af8-ebafb6f6a45f-ca-trust-extracted\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:39:40.501956 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.501917    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xmcs8" event={"ID":"992af211-2ed0-4604-ba11-2ed428cd37bd","Type":"ContainerStarted","Data":"2f93f88328c8e391e0a5d8790306aa59561da193bdac23d392ce56276f6475dd"}
Jul 22 12:39:40.505668 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.505473    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f84766c77-c47db" event={"ID":"51144f25-a093-4099-bb89-2387561ac66c","Type":"ContainerStarted","Data":"76d93fc8a740b4ca0d86fbc25172227c10dc185def450178e07b7cdd2f46206a"}
Jul 22 12:39:40.505668 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.505547    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f84766c77-c47db" event={"ID":"51144f25-a093-4099-bb89-2387561ac66c","Type":"ContainerStarted","Data":"07a28ca75024a4c6aabebad63a408479a8a82c39b9257de00108f65c7565eae8"}
Jul 22 12:39:40.505668 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.505600    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f84766c77-c47db" event={"ID":"51144f25-a093-4099-bb89-2387561ac66c","Type":"ContainerStarted","Data":"113a10270e350363f802556c069a624fc50d0eb4b65beca668997fcac7cff141"}
Jul 22 12:39:40.510974 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.510109    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-787mc" event={"ID":"6e58265b-a1fc-46d6-be7c-65fb231c8a08","Type":"ContainerStarted","Data":"f3f8fcc7811b91c606ce51292cc5291891c6d35c689167e22e975639356aed87"}
Jul 22 12:39:40.510974 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.510153    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-787mc" event={"ID":"6e58265b-a1fc-46d6-be7c-65fb231c8a08","Type":"ContainerStarted","Data":"649d545bd8c02c38338fc9d53b68c3f4083547082a6a5b37702629f0e06f66d2"}
Jul 22 12:39:40.514112 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.512745    2556 generic.go:356] "Generic (PLEG): container finished" podID="46567b42-5787-4eec-8af8-ebafb6f6a45f" containerID="57987e8bcdb21a279223e846e3372af224d0f76e4e144f74038a096a44a6491c" exitCode=0
Jul 22 12:39:40.514112 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.513439    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79d56886cb-d5nq9"
Jul 22 12:39:40.514112 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.513909    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79d56886cb-d5nq9" event={"ID":"46567b42-5787-4eec-8af8-ebafb6f6a45f","Type":"ContainerDied","Data":"57987e8bcdb21a279223e846e3372af224d0f76e4e144f74038a096a44a6491c"}
Jul 22 12:39:40.514112 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.513944    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79d56886cb-d5nq9" event={"ID":"46567b42-5787-4eec-8af8-ebafb6f6a45f","Type":"ContainerDied","Data":"9080e202a69fee71c234b2bab187164265116fee8811b13dff2d65e656cecc71"}
Jul 22 12:39:40.514112 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.513972    2556 scope.go:117] "RemoveContainer" containerID="57987e8bcdb21a279223e846e3372af224d0f76e4e144f74038a096a44a6491c"
Jul 22 12:39:40.531600 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.530860    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-787mc" podStartSLOduration=4.376581712 podStartE2EDuration="6.530845989s" totalImagesPullingTime="2.071641268s" totalInitContainerRuntime="82.623009ms" isStatefulPod=true podCreationTimestamp="2026-07-22 12:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:39:40.530086334 +0000 UTC m=+143.170332610" watchObservedRunningTime="2026-07-22 12:39:40.530845989 +0000 UTC m=+143.171092279"
Jul 22 12:39:40.531600 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.531278    2556 scope.go:117] "RemoveContainer" containerID="57987e8bcdb21a279223e846e3372af224d0f76e4e144f74038a096a44a6491c"
Jul 22 12:39:40.532159 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:39:40.532066    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57987e8bcdb21a279223e846e3372af224d0f76e4e144f74038a096a44a6491c\": container with ID starting with 57987e8bcdb21a279223e846e3372af224d0f76e4e144f74038a096a44a6491c not found: ID does not exist" containerID="57987e8bcdb21a279223e846e3372af224d0f76e4e144f74038a096a44a6491c"
Jul 22 12:39:40.532159 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.532104    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57987e8bcdb21a279223e846e3372af224d0f76e4e144f74038a096a44a6491c"} err="failed to get container status \"57987e8bcdb21a279223e846e3372af224d0f76e4e144f74038a096a44a6491c\": rpc error: code = NotFound desc = could not find container \"57987e8bcdb21a279223e846e3372af224d0f76e4e144f74038a096a44a6491c\": container with ID starting with 57987e8bcdb21a279223e846e3372af224d0f76e4e144f74038a096a44a6491c not found: ID does not exist"
Jul 22 12:39:40.554344 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.554298    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79d56886cb-d5nq9"]
Jul 22 12:39:40.562156 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.562103    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-79d56886cb-d5nq9"]
Jul 22 12:39:40.609183 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.607217    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 12:39:40.609183 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.607508    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46567b42-5787-4eec-8af8-ebafb6f6a45f" containerName="registry"
Jul 22 12:39:40.609183 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.607519    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="46567b42-5787-4eec-8af8-ebafb6f6a45f" containerName="registry"
Jul 22 12:39:40.609183 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.607581    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="46567b42-5787-4eec-8af8-ebafb6f6a45f" containerName="registry"
Jul 22 12:39:40.612105 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.612077    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.616702 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.615467    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 12:39:40.616702 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.615831    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7po04udr06osr\""
Jul 22 12:39:40.616702 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.616179    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 12:39:40.616702 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.616451    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 12:39:40.616702 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.616643    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 12:39:40.617086 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.616855    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 12:39:40.617086 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.617030    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 12:39:40.618022 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.617225    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 12:39:40.618022 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.617509    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 12:39:40.618022 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.617769    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2z5l4\""
Jul 22 12:39:40.619405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.618773    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 12:39:40.619405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.618825    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 12:39:40.619405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.619024    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 12:39:40.619405 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.619224    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 12:39:40.619641 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.619430    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 12:39:40.619641 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.619456    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 12:39:40.621295 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.621206    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 12:39:40.629136 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.629117    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 12:39:40.672057 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.671649    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a54f260a-5c8d-4047-825d-440d58956f81-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672057 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.671715    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvfkk\" (UniqueName: \"kubernetes.io/projected/a54f260a-5c8d-4047-825d-440d58956f81-kube-api-access-nvfkk\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672057 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.671758    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672057 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.671794    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672057 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.671822    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672057 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.671861    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672057 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.671888    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672057 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.671913    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a54f260a-5c8d-4047-825d-440d58956f81-config-out\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672057 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.671938    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672057 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.672000    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672057 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.672039    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672765 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.672070    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672765 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.672096    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672765 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.672127    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672765 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.672182    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672765 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.672209    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-config\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672765 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.672229    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-web-config\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672765 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.672250    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672765 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.672280    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.672765 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.672304    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.773527 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.773498    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.773722 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.773545    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.773722 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.773564    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.773722 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.773584    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a54f260a-5c8d-4047-825d-440d58956f81-config-out\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.773722 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.773609    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.773722 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.773627    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.773722 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.773642    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.773722 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.773659    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.773722 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.773692    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.774110 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.773726    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.774110 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.773775    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.774110 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.773808    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-config\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.774110 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.773831    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-web-config\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.774110 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.773875    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.774110 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.773911    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.774110 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.773936    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.774110 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.773984    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a54f260a-5c8d-4047-825d-440d58956f81-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.774110 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.774007    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvfkk\" (UniqueName: \"kubernetes.io/projected/a54f260a-5c8d-4047-825d-440d58956f81-kube-api-access-nvfkk\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.774110 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.774053    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.774110 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.774084    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.777993 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.777917    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.778550 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.778522    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.780096 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.779401    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.780096 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.779781    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.780096 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.779880    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.780319 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.780183    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.780384 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.780318    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.781105 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.781050    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a54f260a-5c8d-4047-825d-440d58956f81-config-out\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.781699 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.781659    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.782290 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.782249    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-config\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.783765 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.783727    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.784281 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.784241    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-web-config\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.784495 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.784460    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.785536 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.785514    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.785637 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.785515    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.786239 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.786004    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.786239 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.786087    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.787249 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.787151    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a54f260a-5c8d-4047-825d-440d58956f81-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.788758 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.788708    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvfkk\" (UniqueName: \"kubernetes.io/projected/a54f260a-5c8d-4047-825d-440d58956f81-kube-api-access-nvfkk\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.789191 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.789171    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:40.928268 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:40.928223    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:41.875195 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:41.875144    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 12:39:41.877811 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:39:41.877781    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda54f260a_5c8d_4047_825d_440d58956f81.slice/crio-76a25d3cf74d758f29fa5e7f9b7653b499fb61aa034b93ae3cff2165c3f02a0b WatchSource:0}: Error finding container 76a25d3cf74d758f29fa5e7f9b7653b499fb61aa034b93ae3cff2165c3f02a0b: Status 404 returned error can't find the container with id 76a25d3cf74d758f29fa5e7f9b7653b499fb61aa034b93ae3cff2165c3f02a0b
Jul 22 12:39:41.905739 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:41.905357    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46567b42-5787-4eec-8af8-ebafb6f6a45f" path="/var/lib/kubelet/pods/46567b42-5787-4eec-8af8-ebafb6f6a45f/volumes"
Jul 22 12:39:42.528587 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.528553    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f84766c77-c47db" event={"ID":"51144f25-a093-4099-bb89-2387561ac66c","Type":"ContainerStarted","Data":"7168c944d238c88dbd421e30f614a47be0c14a37b7029417213e4c8d54dc4d68"}
Jul 22 12:39:42.528763 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.528633    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f84766c77-c47db" event={"ID":"51144f25-a093-4099-bb89-2387561ac66c","Type":"ContainerStarted","Data":"feab31b979cd49298e6097a3707fe9e8430fb0ecf427f8ed5aef002455085b45"}
Jul 22 12:39:42.528763 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.528708    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f84766c77-c47db" event={"ID":"51144f25-a093-4099-bb89-2387561ac66c","Type":"ContainerStarted","Data":"9a4f934625617e81deb758a5e6cdd16a5e961df658939125a7a6bbd510abd345"}
Jul 22 12:39:42.528763 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.528756    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:42.530368 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.530334    2556 generic.go:356] "Generic (PLEG): container finished" podID="a54f260a-5c8d-4047-825d-440d58956f81" containerID="7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9" exitCode=0
Jul 22 12:39:42.530488 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.530429    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54f260a-5c8d-4047-825d-440d58956f81","Type":"ContainerDied","Data":"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9"}
Jul 22 12:39:42.530558 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.530501    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54f260a-5c8d-4047-825d-440d58956f81","Type":"ContainerStarted","Data":"76a25d3cf74d758f29fa5e7f9b7653b499fb61aa034b93ae3cff2165c3f02a0b"}
Jul 22 12:39:42.534531 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.534504    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38942e45-eba8-4287-9890-c42c96a2ddf3","Type":"ContainerStarted","Data":"678e67b34dc6655107e1cc0c16d7176a3857f0c9c4910d322eb432589a2e76e4"}
Jul 22 12:39:42.534647 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.534580    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38942e45-eba8-4287-9890-c42c96a2ddf3","Type":"ContainerStarted","Data":"e1b097bbc59dad8458f0cf5e33498776bacebc3cac2f2f2ea473c7e3b54af20d"}
Jul 22 12:39:42.534647 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.534628    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38942e45-eba8-4287-9890-c42c96a2ddf3","Type":"ContainerStarted","Data":"be1467b2c5483bcc6a523938db529f480113bf0fc5211a5a7b96f22ae636937f"}
Jul 22 12:39:42.534786 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.534666    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38942e45-eba8-4287-9890-c42c96a2ddf3","Type":"ContainerStarted","Data":"bd5e97a32b7e094b572f00fbb8deb0e3d8e988c938c686fe5e004f9a01a07495"}
Jul 22 12:39:42.534786 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.534737    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38942e45-eba8-4287-9890-c42c96a2ddf3","Type":"ContainerStarted","Data":"1cb45592d4f865cea2b5d4b4be50dc7a6846ecb29662f8b4480505a9faff5d1a"}
Jul 22 12:39:42.534786 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.534776    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38942e45-eba8-4287-9890-c42c96a2ddf3","Type":"ContainerStarted","Data":"fbdf5d5446068925ce78ee1213921b89e5790b3c435505710407271f4df6d4fa"}
Jul 22 12:39:42.536270 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.536125    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xmcs8" event={"ID":"992af211-2ed0-4604-ba11-2ed428cd37bd","Type":"ContainerStarted","Data":"7711d10e43f40cbbf398c3e0421435c62a989d95c58afb34ea9ed78bd8586738"}
Jul 22 12:39:42.536508 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.536488    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xmcs8"
Jul 22 12:39:42.542398 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.542377    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xmcs8"
Jul 22 12:39:42.575525 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.575473    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-xmcs8" podStartSLOduration=1.548916237 podStartE2EDuration="3.575453254s" totalImagesPullingTime="2.026537017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:39:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:39:42.574321727 +0000 UTC m=+145.214567970" watchObservedRunningTime="2026-07-22 12:39:42.575453254 +0000 UTC m=+145.215699496"
Jul 22 12:39:42.575908 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.575871    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f84766c77-c47db" podStartSLOduration=2.949866781 podStartE2EDuration="6.575859368s" totalImagesPullingTime="3.625992587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:39:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:39:42.556809159 +0000 UTC m=+145.197055392" watchObservedRunningTime="2026-07-22 12:39:42.575859368 +0000 UTC m=+145.216105611"
Jul 22 12:39:42.640874 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:42.640824    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.544669802 podStartE2EDuration="7.640806889s" totalImagesPullingTime="4.077618403s" totalInitContainerRuntime="18.518684ms" isStatefulPod=false podCreationTimestamp="2026-07-22 12:39:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:39:42.638470627 +0000 UTC m=+145.278716926" watchObservedRunningTime="2026-07-22 12:39:42.640806889 +0000 UTC m=+145.281053130"
Jul 22 12:39:48.547896 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:48.547866    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f84766c77-c47db"
Jul 22 12:39:53.593727 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:53.592585    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54f260a-5c8d-4047-825d-440d58956f81","Type":"ContainerStarted","Data":"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f"}
Jul 22 12:39:53.593727 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:53.592714    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54f260a-5c8d-4047-825d-440d58956f81","Type":"ContainerStarted","Data":"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07"}
Jul 22 12:39:53.593727 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:53.592765    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54f260a-5c8d-4047-825d-440d58956f81","Type":"ContainerStarted","Data":"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584"}
Jul 22 12:39:53.593727 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:53.592817    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54f260a-5c8d-4047-825d-440d58956f81","Type":"ContainerStarted","Data":"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108"}
Jul 22 12:39:53.593727 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:53.592859    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54f260a-5c8d-4047-825d-440d58956f81","Type":"ContainerStarted","Data":"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6"}
Jul 22 12:39:53.593727 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:53.592900    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54f260a-5c8d-4047-825d-440d58956f81","Type":"ContainerStarted","Data":"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0"}
Jul 22 12:39:53.594945 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:53.594919    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-kt2xp" event={"ID":"fb6be504-30f3-42cc-a1c4-2e8f7b877b10","Type":"ContainerStarted","Data":"cefa7a24f16ace0b901b70e5ec47c1c9ef1c7d52250a97debc45b7ccaa27d10c"}
Jul 22 12:39:53.595093 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:53.595070    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-kt2xp"
Jul 22 12:39:53.614837 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:53.614805    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-kt2xp"
Jul 22 12:39:53.622692 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:53.622617    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.12495758 podStartE2EDuration="13.622599062s" totalImagesPullingTime="10.467526594s" totalInitContainerRuntime="30.114888ms" isStatefulPod=false podCreationTimestamp="2026-07-22 12:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:39:53.621322592 +0000 UTC m=+156.261568833" watchObservedRunningTime="2026-07-22 12:39:53.622599062 +0000 UTC m=+156.262845304"
Jul 22 12:39:55.929083 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:55.929044    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:39:56.288070 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:39:56.288023    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qsxlb" podUID="c6a5585b-fbfa-40ab-af2c-a35ad338a96e"
Jul 22 12:39:56.608671 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:39:56.608600    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:40:01.276804 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:01.276758    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:40:01.279589 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:01.279558    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6a5585b-fbfa-40ab-af2c-a35ad338a96e-metrics-tls\") pod \"dns-default-qsxlb\" (UID: \"c6a5585b-fbfa-40ab-af2c-a35ad338a96e\") " pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:40:01.412773 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:01.412738    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ntb22\""
Jul 22 12:40:01.420088 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:01.420053    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:40:01.634375 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:01.634298    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-kt2xp" podStartSLOduration=9.568993496000001 podStartE2EDuration="29.634276761s" totalImagesPullingTime="20.065283265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:39:53.639347176 +0000 UTC m=+156.279593420" watchObservedRunningTime="2026-07-22 12:40:01.634276761 +0000 UTC m=+164.274523003"
Jul 22 12:40:01.634569 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:01.634550    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qsxlb"]
Jul 22 12:40:01.637981 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:40:01.637954    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a5585b_fbfa_40ab_af2c_a35ad338a96e.slice/crio-f89d44f8f7e5e3eaf795c5dfcc6628800d42ccf9b8381089a8d98bb8b207d6e2 WatchSource:0}: Error finding container f89d44f8f7e5e3eaf795c5dfcc6628800d42ccf9b8381089a8d98bb8b207d6e2: Status 404 returned error can't find the container with id f89d44f8f7e5e3eaf795c5dfcc6628800d42ccf9b8381089a8d98bb8b207d6e2
Jul 22 12:40:02.637599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:02.637565    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qsxlb" event={"ID":"c6a5585b-fbfa-40ab-af2c-a35ad338a96e","Type":"ContainerStarted","Data":"f89d44f8f7e5e3eaf795c5dfcc6628800d42ccf9b8381089a8d98bb8b207d6e2"}
Jul 22 12:40:04.649349 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:04.649322    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qsxlb" event={"ID":"c6a5585b-fbfa-40ab-af2c-a35ad338a96e","Type":"ContainerStarted","Data":"52aff006582c32bf36af8c1bb0a76fc717e540fc9fb60f57c31bedd0e5f0dc95"}
Jul 22 12:40:05.655487 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:05.655455    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qsxlb" event={"ID":"c6a5585b-fbfa-40ab-af2c-a35ad338a96e","Type":"ContainerStarted","Data":"17179c3e8c0e31c9cf6da6305242334c85c921c562e11752b3d9b446333b4a2e"}
Jul 22 12:40:05.655896 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:05.655520    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:40:05.679555 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:05.676056    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qsxlb" podStartSLOduration=129.890490483 podStartE2EDuration="2m12.676034946s" totalImagesPullingTime="2.785544463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:40:05.673396793 +0000 UTC m=+168.313643049" watchObservedRunningTime="2026-07-22 12:40:05.676034946 +0000 UTC m=+168.316281193"
Jul 22 12:40:15.662916 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:15.662887    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qsxlb"
Jul 22 12:40:15.698089 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:15.698059    2556 generic.go:356] "Generic (PLEG): container finished" podID="202073f3-d747-4118-ba9a-6fda23b5198f" containerID="59735810e1066050eb3b8cfd7cbc4769929ad0bfb964967abd08cc195d33e443" exitCode=0
Jul 22 12:40:15.698244 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:15.698137    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-2nnm8" event={"ID":"202073f3-d747-4118-ba9a-6fda23b5198f","Type":"ContainerDied","Data":"59735810e1066050eb3b8cfd7cbc4769929ad0bfb964967abd08cc195d33e443"}
Jul 22 12:40:15.698525 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:15.698510    2556 scope.go:117] "RemoveContainer" containerID="59735810e1066050eb3b8cfd7cbc4769929ad0bfb964967abd08cc195d33e443"
Jul 22 12:40:16.704230 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:16.704197    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-2nnm8" event={"ID":"202073f3-d747-4118-ba9a-6fda23b5198f","Type":"ContainerStarted","Data":"9bc9a09dff4a1fdec601f3f53b277447d3267968b8cda65094c41685122a8b77"}
Jul 22 12:40:40.928487 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:40.928457    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:40:40.992116 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:40.992084    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:40:41.818848 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:41.818821    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:40:54.651814 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:54.651779    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 12:40:54.652223 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:54.652072    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="alertmanager" containerID="cri-o://fbdf5d5446068925ce78ee1213921b89e5790b3c435505710407271f4df6d4fa" gracePeriod=120
Jul 22 12:40:54.652223 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:54.652134    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="kube-rbac-proxy-metric" containerID="cri-o://e1b097bbc59dad8458f0cf5e33498776bacebc3cac2f2f2ea473c7e3b54af20d" gracePeriod=120
Jul 22 12:40:54.652223 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:54.652182    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="kube-rbac-proxy-web" containerID="cri-o://bd5e97a32b7e094b572f00fbb8deb0e3d8e988c938c686fe5e004f9a01a07495" gracePeriod=120
Jul 22 12:40:54.652453 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:54.652170    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="prom-label-proxy" containerID="cri-o://678e67b34dc6655107e1cc0c16d7176a3857f0c9c4910d322eb432589a2e76e4" gracePeriod=120
Jul 22 12:40:54.652595 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:54.652222    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="config-reloader" containerID="cri-o://1cb45592d4f865cea2b5d4b4be50dc7a6846ecb29662f8b4480505a9faff5d1a" gracePeriod=120
Jul 22 12:40:54.652595 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:54.652247    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="kube-rbac-proxy" containerID="cri-o://be1467b2c5483bcc6a523938db529f480113bf0fc5211a5a7b96f22ae636937f" gracePeriod=120
Jul 22 12:40:54.859279 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:54.859243    2556 generic.go:356] "Generic (PLEG): container finished" podID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerID="678e67b34dc6655107e1cc0c16d7176a3857f0c9c4910d322eb432589a2e76e4" exitCode=0
Jul 22 12:40:54.859279 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:54.859272    2556 generic.go:356] "Generic (PLEG): container finished" podID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerID="be1467b2c5483bcc6a523938db529f480113bf0fc5211a5a7b96f22ae636937f" exitCode=0
Jul 22 12:40:54.859279 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:54.859280    2556 generic.go:356] "Generic (PLEG): container finished" podID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerID="1cb45592d4f865cea2b5d4b4be50dc7a6846ecb29662f8b4480505a9faff5d1a" exitCode=0
Jul 22 12:40:54.859279 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:54.859286    2556 generic.go:356] "Generic (PLEG): container finished" podID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerID="fbdf5d5446068925ce78ee1213921b89e5790b3c435505710407271f4df6d4fa" exitCode=0
Jul 22 12:40:54.859554 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:54.859312    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38942e45-eba8-4287-9890-c42c96a2ddf3","Type":"ContainerDied","Data":"678e67b34dc6655107e1cc0c16d7176a3857f0c9c4910d322eb432589a2e76e4"}
Jul 22 12:40:54.859554 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:54.859377    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38942e45-eba8-4287-9890-c42c96a2ddf3","Type":"ContainerDied","Data":"be1467b2c5483bcc6a523938db529f480113bf0fc5211a5a7b96f22ae636937f"}
Jul 22 12:40:54.859554 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:54.859402    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38942e45-eba8-4287-9890-c42c96a2ddf3","Type":"ContainerDied","Data":"1cb45592d4f865cea2b5d4b4be50dc7a6846ecb29662f8b4480505a9faff5d1a"}
Jul 22 12:40:54.859554 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:54.859427    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38942e45-eba8-4287-9890-c42c96a2ddf3","Type":"ContainerDied","Data":"fbdf5d5446068925ce78ee1213921b89e5790b3c435505710407271f4df6d4fa"}
Jul 22 12:40:55.867488 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:55.867460    2556 generic.go:356] "Generic (PLEG): container finished" podID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerID="e1b097bbc59dad8458f0cf5e33498776bacebc3cac2f2f2ea473c7e3b54af20d" exitCode=0
Jul 22 12:40:55.867488 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:55.867482    2556 generic.go:356] "Generic (PLEG): container finished" podID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerID="bd5e97a32b7e094b572f00fbb8deb0e3d8e988c938c686fe5e004f9a01a07495" exitCode=0
Jul 22 12:40:55.867912 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:55.867528    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38942e45-eba8-4287-9890-c42c96a2ddf3","Type":"ContainerDied","Data":"e1b097bbc59dad8458f0cf5e33498776bacebc3cac2f2f2ea473c7e3b54af20d"}
Jul 22 12:40:55.867912 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:55.867612    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38942e45-eba8-4287-9890-c42c96a2ddf3","Type":"ContainerDied","Data":"bd5e97a32b7e094b572f00fbb8deb0e3d8e988c938c686fe5e004f9a01a07495"}
Jul 22 12:40:55.893418 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:55.893397    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:56.060244 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.060211    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38942e45-eba8-4287-9890-c42c96a2ddf3-tls-assets\") pod \"38942e45-eba8-4287-9890-c42c96a2ddf3\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") "
Jul 22 12:40:56.060403 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.060249    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-config-volume\") pod \"38942e45-eba8-4287-9890-c42c96a2ddf3\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") "
Jul 22 12:40:56.060403 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.060276    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38942e45-eba8-4287-9890-c42c96a2ddf3-config-out\") pod \"38942e45-eba8-4287-9890-c42c96a2ddf3\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") "
Jul 22 12:40:56.060403 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.060303    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-kube-rbac-proxy-web\") pod \"38942e45-eba8-4287-9890-c42c96a2ddf3\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") "
Jul 22 12:40:56.060403 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.060333    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38942e45-eba8-4287-9890-c42c96a2ddf3-alertmanager-trusted-ca-bundle\") pod \"38942e45-eba8-4287-9890-c42c96a2ddf3\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") "
Jul 22 12:40:56.060403 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.060361    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"38942e45-eba8-4287-9890-c42c96a2ddf3\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") "
Jul 22 12:40:56.060709 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.060419    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-web-config\") pod \"38942e45-eba8-4287-9890-c42c96a2ddf3\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") "
Jul 22 12:40:56.060709 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.060449    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-main-tls\") pod \"38942e45-eba8-4287-9890-c42c96a2ddf3\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") "
Jul 22 12:40:56.060709 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.060483    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnx5p\" (UniqueName: \"kubernetes.io/projected/38942e45-eba8-4287-9890-c42c96a2ddf3-kube-api-access-nnx5p\") pod \"38942e45-eba8-4287-9890-c42c96a2ddf3\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") "
Jul 22 12:40:56.060709 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.060507    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-kube-rbac-proxy\") pod \"38942e45-eba8-4287-9890-c42c96a2ddf3\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") "
Jul 22 12:40:56.060709 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.060535    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38942e45-eba8-4287-9890-c42c96a2ddf3-metrics-client-ca\") pod \"38942e45-eba8-4287-9890-c42c96a2ddf3\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") "
Jul 22 12:40:56.060709 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.060596    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38942e45-eba8-4287-9890-c42c96a2ddf3-alertmanager-main-db\") pod \"38942e45-eba8-4287-9890-c42c96a2ddf3\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") "
Jul 22 12:40:56.060709 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.060616    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-cluster-tls-config\") pod \"38942e45-eba8-4287-9890-c42c96a2ddf3\" (UID: \"38942e45-eba8-4287-9890-c42c96a2ddf3\") "
Jul 22 12:40:56.061241 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.060792    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38942e45-eba8-4287-9890-c42c96a2ddf3-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "38942e45-eba8-4287-9890-c42c96a2ddf3" (UID: "38942e45-eba8-4287-9890-c42c96a2ddf3"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:40:56.061241 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.060927    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38942e45-eba8-4287-9890-c42c96a2ddf3-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:56.061973 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.061588    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38942e45-eba8-4287-9890-c42c96a2ddf3-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "38942e45-eba8-4287-9890-c42c96a2ddf3" (UID: "38942e45-eba8-4287-9890-c42c96a2ddf3"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:40:56.061973 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.061848    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38942e45-eba8-4287-9890-c42c96a2ddf3-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "38942e45-eba8-4287-9890-c42c96a2ddf3" (UID: "38942e45-eba8-4287-9890-c42c96a2ddf3"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:40:56.063847 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.063815    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "38942e45-eba8-4287-9890-c42c96a2ddf3" (UID: "38942e45-eba8-4287-9890-c42c96a2ddf3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:40:56.063957 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.063908    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38942e45-eba8-4287-9890-c42c96a2ddf3-config-out" (OuterVolumeSpecName: "config-out") pod "38942e45-eba8-4287-9890-c42c96a2ddf3" (UID: "38942e45-eba8-4287-9890-c42c96a2ddf3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:40:56.064027 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.063938    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-config-volume" (OuterVolumeSpecName: "config-volume") pod "38942e45-eba8-4287-9890-c42c96a2ddf3" (UID: "38942e45-eba8-4287-9890-c42c96a2ddf3"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:40:56.064327 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.064298    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38942e45-eba8-4287-9890-c42c96a2ddf3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "38942e45-eba8-4287-9890-c42c96a2ddf3" (UID: "38942e45-eba8-4287-9890-c42c96a2ddf3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:40:56.064512 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.064482    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38942e45-eba8-4287-9890-c42c96a2ddf3-kube-api-access-nnx5p" (OuterVolumeSpecName: "kube-api-access-nnx5p") pod "38942e45-eba8-4287-9890-c42c96a2ddf3" (UID: "38942e45-eba8-4287-9890-c42c96a2ddf3"). InnerVolumeSpecName "kube-api-access-nnx5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:40:56.064788 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.064769    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "38942e45-eba8-4287-9890-c42c96a2ddf3" (UID: "38942e45-eba8-4287-9890-c42c96a2ddf3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:40:56.065346 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.065331    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "38942e45-eba8-4287-9890-c42c96a2ddf3" (UID: "38942e45-eba8-4287-9890-c42c96a2ddf3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:40:56.065727 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.065707    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "38942e45-eba8-4287-9890-c42c96a2ddf3" (UID: "38942e45-eba8-4287-9890-c42c96a2ddf3"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:40:56.068826 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.068808    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "38942e45-eba8-4287-9890-c42c96a2ddf3" (UID: "38942e45-eba8-4287-9890-c42c96a2ddf3"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:40:56.075516 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.075496    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-web-config" (OuterVolumeSpecName: "web-config") pod "38942e45-eba8-4287-9890-c42c96a2ddf3" (UID: "38942e45-eba8-4287-9890-c42c96a2ddf3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:40:56.162043 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.162006    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:56.162043 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.162036    2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-web-config\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:56.162043 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.162046    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-main-tls\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:56.162043 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.162055    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnx5p\" (UniqueName: \"kubernetes.io/projected/38942e45-eba8-4287-9890-c42c96a2ddf3-kube-api-access-nnx5p\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:56.162286 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.162064    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:56.162286 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.162073    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38942e45-eba8-4287-9890-c42c96a2ddf3-metrics-client-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:56.162286 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.162081    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38942e45-eba8-4287-9890-c42c96a2ddf3-alertmanager-main-db\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:56.162286 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.162089    2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-cluster-tls-config\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:56.162286 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.162097    2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38942e45-eba8-4287-9890-c42c96a2ddf3-tls-assets\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:56.162286 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.162104    2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-config-volume\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:56.162286 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.162113    2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38942e45-eba8-4287-9890-c42c96a2ddf3-config-out\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:56.162286 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.162120    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38942e45-eba8-4287-9890-c42c96a2ddf3-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:56.874846 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.874808    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38942e45-eba8-4287-9890-c42c96a2ddf3","Type":"ContainerDied","Data":"99a56a9707d970727e65f0a5ad3b97b334c11d62dd71ce2751d69660ece1c9d2"}
Jul 22 12:40:56.875201 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.874899    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:56.875201 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.874939    2556 scope.go:117] "RemoveContainer" containerID="678e67b34dc6655107e1cc0c16d7176a3857f0c9c4910d322eb432589a2e76e4"
Jul 22 12:40:56.883192 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.883171    2556 scope.go:117] "RemoveContainer" containerID="e1b097bbc59dad8458f0cf5e33498776bacebc3cac2f2f2ea473c7e3b54af20d"
Jul 22 12:40:56.890535 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.890515    2556 scope.go:117] "RemoveContainer" containerID="be1467b2c5483bcc6a523938db529f480113bf0fc5211a5a7b96f22ae636937f"
Jul 22 12:40:56.897388 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.897358    2556 scope.go:117] "RemoveContainer" containerID="bd5e97a32b7e094b572f00fbb8deb0e3d8e988c938c686fe5e004f9a01a07495"
Jul 22 12:40:56.899213 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.899193    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 12:40:56.905225 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.905203    2556 scope.go:117] "RemoveContainer" containerID="1cb45592d4f865cea2b5d4b4be50dc7a6846ecb29662f8b4480505a9faff5d1a"
Jul 22 12:40:56.907276 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.907258    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 12:40:56.912349 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.912331    2556 scope.go:117] "RemoveContainer" containerID="fbdf5d5446068925ce78ee1213921b89e5790b3c435505710407271f4df6d4fa"
Jul 22 12:40:56.919347 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.919330    2556 scope.go:117] "RemoveContainer" containerID="bd98ab75000d32aa2e83cd46f70889ef939fb047a6bd364ff4a210c0498d3829"
Jul 22 12:40:56.938826 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.938806    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 12:40:56.939088 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939076    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="kube-rbac-proxy-metric"
Jul 22 12:40:56.939137 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939089    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="kube-rbac-proxy-metric"
Jul 22 12:40:56.939137 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939105    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="kube-rbac-proxy-web"
Jul 22 12:40:56.939137 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939110    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="kube-rbac-proxy-web"
Jul 22 12:40:56.939137 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939116    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="kube-rbac-proxy"
Jul 22 12:40:56.939137 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939121    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="kube-rbac-proxy"
Jul 22 12:40:56.939137 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939133    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="init-config-reloader"
Jul 22 12:40:56.939137 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939138    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="init-config-reloader"
Jul 22 12:40:56.939338 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939146    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="prom-label-proxy"
Jul 22 12:40:56.939338 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939152    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="prom-label-proxy"
Jul 22 12:40:56.939338 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939158    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="alertmanager"
Jul 22 12:40:56.939338 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939162    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="alertmanager"
Jul 22 12:40:56.939338 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939172    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="config-reloader"
Jul 22 12:40:56.939338 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939177    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="config-reloader"
Jul 22 12:40:56.939338 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939224    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="config-reloader"
Jul 22 12:40:56.939338 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939231    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="alertmanager"
Jul 22 12:40:56.939338 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939238    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="kube-rbac-proxy"
Jul 22 12:40:56.939338 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939243    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="prom-label-proxy"
Jul 22 12:40:56.939338 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939250    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="kube-rbac-proxy-metric"
Jul 22 12:40:56.939338 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.939255    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" containerName="kube-rbac-proxy-web"
Jul 22 12:40:56.943586 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.943567    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:56.946482 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.946466    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 22 12:40:56.946635 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.946609    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 22 12:40:56.946731 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.946670    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 22 12:40:56.946731 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.946704    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 22 12:40:56.946842 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.946798    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hxsdw\""
Jul 22 12:40:56.946967 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.946955    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 22 12:40:56.947214 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.947203    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 22 12:40:56.947496 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.947483    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 22 12:40:56.947559 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.947546    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 22 12:40:56.952918 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.952899    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 22 12:40:56.961448 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:56.961431    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 12:40:57.069983 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.069953    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59lc9\" (UniqueName: \"kubernetes.io/projected/0a99ead0-077f-4105-832e-18e7bdb21c95-kube-api-access-59lc9\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.070136 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.070000    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.070136 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.070027    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a99ead0-077f-4105-832e-18e7bdb21c95-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.070136 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.070055    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.070136 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.070100    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a99ead0-077f-4105-832e-18e7bdb21c95-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.070292 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.070150    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a99ead0-077f-4105-832e-18e7bdb21c95-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.070292 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.070167    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.070292 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.070190    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a99ead0-077f-4105-832e-18e7bdb21c95-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.070292 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.070213    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.070292 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.070274    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.070443 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.070306    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-web-config\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.070443 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.070331    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.070443 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.070360    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a99ead0-077f-4105-832e-18e7bdb21c95-config-out\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.171267 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.171231    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-web-config\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.171267 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.171270    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.171447 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.171298    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a99ead0-077f-4105-832e-18e7bdb21c95-config-out\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.171447 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.171326    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59lc9\" (UniqueName: \"kubernetes.io/projected/0a99ead0-077f-4105-832e-18e7bdb21c95-kube-api-access-59lc9\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.171447 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.171357    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.171447 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.171380    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a99ead0-077f-4105-832e-18e7bdb21c95-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.171447 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.171407    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.171447 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.171438    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a99ead0-077f-4105-832e-18e7bdb21c95-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.171838 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.171482    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a99ead0-077f-4105-832e-18e7bdb21c95-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.171838 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.171505    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.171838 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.171527    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a99ead0-077f-4105-832e-18e7bdb21c95-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.171838 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.171560    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.171838 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.171606    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.172264 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.172230    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a99ead0-077f-4105-832e-18e7bdb21c95-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.172322 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.172289    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a99ead0-077f-4105-832e-18e7bdb21c95-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.173561 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.173233    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a99ead0-077f-4105-832e-18e7bdb21c95-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.174901 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.174869    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.175002 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.174897    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a99ead0-077f-4105-832e-18e7bdb21c95-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.175002 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.174950    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.175320 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.175301    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.175406 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.175306    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a99ead0-077f-4105-832e-18e7bdb21c95-config-out\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.175442 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.175406    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-web-config\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.175442 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.175432    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.176665 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.176647    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.176844 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.176827    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a99ead0-077f-4105-832e-18e7bdb21c95-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.180376 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.180342    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59lc9\" (UniqueName: \"kubernetes.io/projected/0a99ead0-077f-4105-832e-18e7bdb21c95-kube-api-access-59lc9\") pod \"alertmanager-main-0\" (UID: \"0a99ead0-077f-4105-832e-18e7bdb21c95\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.253298 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.253202    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 12:40:57.389371 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.389350    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 12:40:57.391806 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:40:57.391783    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a99ead0_077f_4105_832e_18e7bdb21c95.slice/crio-4cc0420a99ca3addf1a0b8642a2b5044c4b8c63ff92e412cd152fd6ceecc4429 WatchSource:0}: Error finding container 4cc0420a99ca3addf1a0b8642a2b5044c4b8c63ff92e412cd152fd6ceecc4429: Status 404 returned error can't find the container with id 4cc0420a99ca3addf1a0b8642a2b5044c4b8c63ff92e412cd152fd6ceecc4429
Jul 22 12:40:57.880654 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.880606    2556 generic.go:356] "Generic (PLEG): container finished" podID="0a99ead0-077f-4105-832e-18e7bdb21c95" containerID="50c6e3b7b601d5cbeae8c9602cc2f243f66d0f1483713e6ba467caf75e4217f2" exitCode=0
Jul 22 12:40:57.880654 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.880655    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a99ead0-077f-4105-832e-18e7bdb21c95","Type":"ContainerDied","Data":"50c6e3b7b601d5cbeae8c9602cc2f243f66d0f1483713e6ba467caf75e4217f2"}
Jul 22 12:40:57.881142 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.880732    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a99ead0-077f-4105-832e-18e7bdb21c95","Type":"ContainerStarted","Data":"4cc0420a99ca3addf1a0b8642a2b5044c4b8c63ff92e412cd152fd6ceecc4429"}
Jul 22 12:40:57.900935 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:57.900910    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38942e45-eba8-4287-9890-c42c96a2ddf3" path="/var/lib/kubelet/pods/38942e45-eba8-4287-9890-c42c96a2ddf3/volumes"
Jul 22 12:40:58.888271 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:58.888230    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a99ead0-077f-4105-832e-18e7bdb21c95","Type":"ContainerStarted","Data":"05945acb276307545b218dbe7e945c5836d5d67c8ac814ed60f8603153a235a6"}
Jul 22 12:40:58.888732 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:58.888341    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a99ead0-077f-4105-832e-18e7bdb21c95","Type":"ContainerStarted","Data":"9721a0eb8183bd433f1bf2e9b379438c8764809862bf01b815c1fd43c2e0d987"}
Jul 22 12:40:58.888732 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:58.888390    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a99ead0-077f-4105-832e-18e7bdb21c95","Type":"ContainerStarted","Data":"f1dee615db4b2d2be2ac12a00a5245a2721a3eae9dfa3728ab5198f319f2a3a3"}
Jul 22 12:40:58.888732 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:58.888436    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a99ead0-077f-4105-832e-18e7bdb21c95","Type":"ContainerStarted","Data":"4d8f4a7d2cc9133e248671d09951597a5f1d7dc95e394ee923141c39a2447eb0"}
Jul 22 12:40:58.888732 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:58.888478    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a99ead0-077f-4105-832e-18e7bdb21c95","Type":"ContainerStarted","Data":"6593b2fbd81ba7264aa92c8b36062ccb1c80776d0b6dba5bbdf846374036cae5"}
Jul 22 12:40:58.888732 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:58.888521    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a99ead0-077f-4105-832e-18e7bdb21c95","Type":"ContainerStarted","Data":"f11e9beb7080b23c5847ae6d3880bc3ff9f561aa74a40063c6207533fd9f3301"}
Jul 22 12:40:58.916844 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:58.916795    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.902147413 podStartE2EDuration="2.916780383s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.63297ms" isStatefulPod=false podCreationTimestamp="2026-07-22 12:40:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:40:58.914780112 +0000 UTC m=+221.555026355" watchObservedRunningTime="2026-07-22 12:40:58.916780383 +0000 UTC m=+221.557026624"
Jul 22 12:40:58.985953 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:58.985919    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 12:40:58.986313 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:58.986259    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="prometheus" containerID="cri-o://fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0" gracePeriod=600
Jul 22 12:40:58.986429 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:58.986322    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="kube-rbac-proxy-thanos" containerID="cri-o://cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f" gracePeriod=600
Jul 22 12:40:58.986429 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:58.986320    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="kube-rbac-proxy-web" containerID="cri-o://56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584" gracePeriod=600
Jul 22 12:40:58.986429 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:58.986364    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="config-reloader" containerID="cri-o://1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6" gracePeriod=600
Jul 22 12:40:58.986623 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:58.986300    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="thanos-sidecar" containerID="cri-o://831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108" gracePeriod=600
Jul 22 12:40:58.987221 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:58.986275    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="kube-rbac-proxy" containerID="cri-o://6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07" gracePeriod=600
Jul 22 12:40:59.227338 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.227308    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:40:59.389688 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.389658    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-metrics-client-certs\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.389826 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.389709    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-configmap-kubelet-serving-ca-bundle\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.389826 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.389757    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-config\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.389826 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.389788    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.389826 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.389819    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-rulefiles-1\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.390054 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.389847    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a54f260a-5c8d-4047-825d-440d58956f81-tls-assets\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.390054 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.389925    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-db\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.390054 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.389984    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvfkk\" (UniqueName: \"kubernetes.io/projected/a54f260a-5c8d-4047-825d-440d58956f81-kube-api-access-nvfkk\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.390054 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.390017    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-trusted-ca-bundle\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.390054 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.390042    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-prometheus-k8s-tls\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.390351 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.390067    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a54f260a-5c8d-4047-825d-440d58956f81-config-out\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.390351 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.390117    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-configmap-metrics-client-ca\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.390351 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.390155    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-rulefiles-2\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.390351 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.390170    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:40:59.390351 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.390187    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-rulefiles-0\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.390351 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.390219    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:40:59.390351 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.390232    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-configmap-serving-certs-ca-bundle\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.390351 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.390263    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-grpc-tls\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.390351 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.390291    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-kube-rbac-proxy\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.390351 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.390319    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.390351 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.390354    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-thanos-prometheus-http-client-file\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.391074 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.390394    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-web-config\") pod \"a54f260a-5c8d-4047-825d-440d58956f81\" (UID: \"a54f260a-5c8d-4047-825d-440d58956f81\") "
Jul 22 12:40:59.391074 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.390697    2556 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.391074 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.390722    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.391254 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.391230    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:40:59.391465 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.391408    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:40:59.392250 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.392215    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:40:59.392461 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.392426    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:40:59.392773 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.392746    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a54f260a-5c8d-4047-825d-440d58956f81-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:40:59.392925 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.392890    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-config" (OuterVolumeSpecName: "config") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:40:59.393020 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.392937    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:40:59.393158 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.393130    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:40:59.393530 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.393503    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:40:59.394099 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.394073    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:40:59.394330 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.394292    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a54f260a-5c8d-4047-825d-440d58956f81-config-out" (OuterVolumeSpecName: "config-out") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:40:59.394330 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.394294    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a54f260a-5c8d-4047-825d-440d58956f81-kube-api-access-nvfkk" (OuterVolumeSpecName: "kube-api-access-nvfkk") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "kube-api-access-nvfkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:40:59.394732 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.394703    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:40:59.394819 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.394778    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:40:59.395192 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.395165    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:40:59.395492 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.395468    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:40:59.395806 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.395791    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:40:59.405956 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.405938    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-web-config" (OuterVolumeSpecName: "web-config") pod "a54f260a-5c8d-4047-825d-440d58956f81" (UID: "a54f260a-5c8d-4047-825d-440d58956f81"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:40:59.491538 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.491473    2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a54f260a-5c8d-4047-825d-440d58956f81-tls-assets\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.491538 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.491497    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-db\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.491538 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.491508    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvfkk\" (UniqueName: \"kubernetes.io/projected/a54f260a-5c8d-4047-825d-440d58956f81-kube-api-access-nvfkk\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.491538 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.491519    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.491538 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.491529    2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.491538 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.491538    2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a54f260a-5c8d-4047-825d-440d58956f81-config-out\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.491822 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.491558    2556 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-configmap-metrics-client-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.491822 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.491567    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.491822 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.491575    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.491822 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.491583    2556 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a54f260a-5c8d-4047-825d-440d58956f81-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.491822 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.491592    2556 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-grpc-tls\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.491822 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.491600    2556 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-kube-rbac-proxy\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.491822 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.491608    2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.491822 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.491618    2556 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.491822 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.491627    2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-web-config\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.491822 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.491634    2556 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-metrics-client-certs\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.491822 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.491642    2556 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-config\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.491822 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.491650    2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a54f260a-5c8d-4047-825d-440d58956f81-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:40:59.895884 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.895855    2556 generic.go:356] "Generic (PLEG): container finished" podID="a54f260a-5c8d-4047-825d-440d58956f81" containerID="cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f" exitCode=0
Jul 22 12:40:59.895884 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.895878    2556 generic.go:356] "Generic (PLEG): container finished" podID="a54f260a-5c8d-4047-825d-440d58956f81" containerID="6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07" exitCode=0
Jul 22 12:40:59.895884 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.895884    2556 generic.go:356] "Generic (PLEG): container finished" podID="a54f260a-5c8d-4047-825d-440d58956f81" containerID="56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584" exitCode=0
Jul 22 12:40:59.895884 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.895889    2556 generic.go:356] "Generic (PLEG): container finished" podID="a54f260a-5c8d-4047-825d-440d58956f81" containerID="831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108" exitCode=0
Jul 22 12:40:59.895884 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.895895    2556 generic.go:356] "Generic (PLEG): container finished" podID="a54f260a-5c8d-4047-825d-440d58956f81" containerID="1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6" exitCode=0
Jul 22 12:40:59.895884 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.895902    2556 generic.go:356] "Generic (PLEG): container finished" podID="a54f260a-5c8d-4047-825d-440d58956f81" containerID="fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0" exitCode=0
Jul 22 12:40:59.896462 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.896024    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:40:59.900967 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.900940    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54f260a-5c8d-4047-825d-440d58956f81","Type":"ContainerDied","Data":"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f"}
Jul 22 12:40:59.901089 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.901005    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54f260a-5c8d-4047-825d-440d58956f81","Type":"ContainerDied","Data":"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07"}
Jul 22 12:40:59.901089 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.901052    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54f260a-5c8d-4047-825d-440d58956f81","Type":"ContainerDied","Data":"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584"}
Jul 22 12:40:59.901187 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.901098    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54f260a-5c8d-4047-825d-440d58956f81","Type":"ContainerDied","Data":"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108"}
Jul 22 12:40:59.901187 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.901132    2556 scope.go:117] "RemoveContainer" containerID="cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f"
Jul 22 12:40:59.901187 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.901143    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54f260a-5c8d-4047-825d-440d58956f81","Type":"ContainerDied","Data":"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6"}
Jul 22 12:40:59.901319 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.901190    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54f260a-5c8d-4047-825d-440d58956f81","Type":"ContainerDied","Data":"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0"}
Jul 22 12:40:59.901319 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.901233    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a54f260a-5c8d-4047-825d-440d58956f81","Type":"ContainerDied","Data":"76a25d3cf74d758f29fa5e7f9b7653b499fb61aa034b93ae3cff2165c3f02a0b"}
Jul 22 12:40:59.910108 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.910089    2556 scope.go:117] "RemoveContainer" containerID="6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07"
Jul 22 12:40:59.917369 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.917353    2556 scope.go:117] "RemoveContainer" containerID="56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584"
Jul 22 12:40:59.924638 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.924618    2556 scope.go:117] "RemoveContainer" containerID="831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108"
Jul 22 12:40:59.925146 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.925132    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 12:40:59.929961 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.929939    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 12:40:59.932019 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.932006    2556 scope.go:117] "RemoveContainer" containerID="1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6"
Jul 22 12:40:59.938491 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.938475    2556 scope.go:117] "RemoveContainer" containerID="fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0"
Jul 22 12:40:59.945516 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.945498    2556 scope.go:117] "RemoveContainer" containerID="7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9"
Jul 22 12:40:59.952107 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.952092    2556 scope.go:117] "RemoveContainer" containerID="cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f"
Jul 22 12:40:59.952354 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:40:59.952335    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f\": container with ID starting with cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f not found: ID does not exist" containerID="cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f"
Jul 22 12:40:59.952417 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.952362    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f"} err="failed to get container status \"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f\": rpc error: code = NotFound desc = could not find container \"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f\": container with ID starting with cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f not found: ID does not exist"
Jul 22 12:40:59.952417 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.952381    2556 scope.go:117] "RemoveContainer" containerID="6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07"
Jul 22 12:40:59.952630 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:40:59.952613    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07\": container with ID starting with 6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07 not found: ID does not exist" containerID="6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07"
Jul 22 12:40:59.952667 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.952635    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07"} err="failed to get container status \"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07\": rpc error: code = NotFound desc = could not find container \"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07\": container with ID starting with 6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07 not found: ID does not exist"
Jul 22 12:40:59.952667 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.952650    2556 scope.go:117] "RemoveContainer" containerID="56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584"
Jul 22 12:40:59.952905 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:40:59.952887    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584\": container with ID starting with 56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584 not found: ID does not exist" containerID="56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584"
Jul 22 12:40:59.952941 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.952911    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584"} err="failed to get container status \"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584\": rpc error: code = NotFound desc = could not find container \"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584\": container with ID starting with 56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584 not found: ID does not exist"
Jul 22 12:40:59.952941 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.952924    2556 scope.go:117] "RemoveContainer" containerID="831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108"
Jul 22 12:40:59.953162 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:40:59.953146    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108\": container with ID starting with 831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108 not found: ID does not exist" containerID="831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108"
Jul 22 12:40:59.953216 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.953168    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108"} err="failed to get container status \"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108\": rpc error: code = NotFound desc = could not find container \"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108\": container with ID starting with 831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108 not found: ID does not exist"
Jul 22 12:40:59.953216 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.953182    2556 scope.go:117] "RemoveContainer" containerID="1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6"
Jul 22 12:40:59.953396 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:40:59.953374    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6\": container with ID starting with 1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6 not found: ID does not exist" containerID="1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6"
Jul 22 12:40:59.953436 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.953401    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6"} err="failed to get container status \"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6\": rpc error: code = NotFound desc = could not find container \"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6\": container with ID starting with 1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6 not found: ID does not exist"
Jul 22 12:40:59.953436 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.953415    2556 scope.go:117] "RemoveContainer" containerID="fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0"
Jul 22 12:40:59.953643 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:40:59.953627    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0\": container with ID starting with fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0 not found: ID does not exist" containerID="fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0"
Jul 22 12:40:59.953703 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.953646    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0"} err="failed to get container status \"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0\": rpc error: code = NotFound desc = could not find container \"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0\": container with ID starting with fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0 not found: ID does not exist"
Jul 22 12:40:59.953703 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.953661    2556 scope.go:117] "RemoveContainer" containerID="7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9"
Jul 22 12:40:59.953901 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:40:59.953885    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9\": container with ID starting with 7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9 not found: ID does not exist" containerID="7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9"
Jul 22 12:40:59.953940 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.953905    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9"} err="failed to get container status \"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9\": rpc error: code = NotFound desc = could not find container \"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9\": container with ID starting with 7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9 not found: ID does not exist"
Jul 22 12:40:59.953940 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.953920    2556 scope.go:117] "RemoveContainer" containerID="cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f"
Jul 22 12:40:59.954112 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.954096    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f"} err="failed to get container status \"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f\": rpc error: code = NotFound desc = could not find container \"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f\": container with ID starting with cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f not found: ID does not exist"
Jul 22 12:40:59.954149 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.954114    2556 scope.go:117] "RemoveContainer" containerID="6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07"
Jul 22 12:40:59.954311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.954294    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07"} err="failed to get container status \"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07\": rpc error: code = NotFound desc = could not find container \"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07\": container with ID starting with 6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07 not found: ID does not exist"
Jul 22 12:40:59.954349 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.954312    2556 scope.go:117] "RemoveContainer" containerID="56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584"
Jul 22 12:40:59.954476 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.954455    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584"} err="failed to get container status \"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584\": rpc error: code = NotFound desc = could not find container \"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584\": container with ID starting with 56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584 not found: ID does not exist"
Jul 22 12:40:59.954476 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.954476    2556 scope.go:117] "RemoveContainer" containerID="831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108"
Jul 22 12:40:59.954634 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.954618    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108"} err="failed to get container status \"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108\": rpc error: code = NotFound desc = could not find container \"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108\": container with ID starting with 831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108 not found: ID does not exist"
Jul 22 12:40:59.954693 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.954635    2556 scope.go:117] "RemoveContainer" containerID="1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6"
Jul 22 12:40:59.954854 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.954837    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6"} err="failed to get container status \"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6\": rpc error: code = NotFound desc = could not find container \"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6\": container with ID starting with 1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6 not found: ID does not exist"
Jul 22 12:40:59.954854 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.954854    2556 scope.go:117] "RemoveContainer" containerID="fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0"
Jul 22 12:40:59.955080 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.955062    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0"} err="failed to get container status \"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0\": rpc error: code = NotFound desc = could not find container \"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0\": container with ID starting with fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0 not found: ID does not exist"
Jul 22 12:40:59.955122 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.955082    2556 scope.go:117] "RemoveContainer" containerID="7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9"
Jul 22 12:40:59.955272 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.955258    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9"} err="failed to get container status \"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9\": rpc error: code = NotFound desc = could not find container \"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9\": container with ID starting with 7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9 not found: ID does not exist"
Jul 22 12:40:59.955312 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.955272    2556 scope.go:117] "RemoveContainer" containerID="cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f"
Jul 22 12:40:59.955442 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.955427    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f"} err="failed to get container status \"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f\": rpc error: code = NotFound desc = could not find container \"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f\": container with ID starting with cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f not found: ID does not exist"
Jul 22 12:40:59.955481 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.955441    2556 scope.go:117] "RemoveContainer" containerID="6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07"
Jul 22 12:40:59.955637 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.955620    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07"} err="failed to get container status \"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07\": rpc error: code = NotFound desc = could not find container \"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07\": container with ID starting with 6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07 not found: ID does not exist"
Jul 22 12:40:59.955755 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.955637    2556 scope.go:117] "RemoveContainer" containerID="56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584"
Jul 22 12:40:59.955878 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.955858    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584"} err="failed to get container status \"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584\": rpc error: code = NotFound desc = could not find container \"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584\": container with ID starting with 56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584 not found: ID does not exist"
Jul 22 12:40:59.955924 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.955879    2556 scope.go:117] "RemoveContainer" containerID="831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108"
Jul 22 12:40:59.956072 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.956056    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108"} err="failed to get container status \"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108\": rpc error: code = NotFound desc = could not find container \"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108\": container with ID starting with 831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108 not found: ID does not exist"
Jul 22 12:40:59.956112 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.956072    2556 scope.go:117] "RemoveContainer" containerID="1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6"
Jul 22 12:40:59.956281 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.956260    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6"} err="failed to get container status \"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6\": rpc error: code = NotFound desc = could not find container \"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6\": container with ID starting with 1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6 not found: ID does not exist"
Jul 22 12:40:59.956281 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.956280    2556 scope.go:117] "RemoveContainer" containerID="fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0"
Jul 22 12:40:59.956535 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.956511    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0"} err="failed to get container status \"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0\": rpc error: code = NotFound desc = could not find container \"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0\": container with ID starting with fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0 not found: ID does not exist"
Jul 22 12:40:59.956623 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.956536    2556 scope.go:117] "RemoveContainer" containerID="7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9"
Jul 22 12:40:59.956981 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.956957    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9"} err="failed to get container status \"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9\": rpc error: code = NotFound desc = could not find container \"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9\": container with ID starting with 7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9 not found: ID does not exist"
Jul 22 12:40:59.957112 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.956982    2556 scope.go:117] "RemoveContainer" containerID="cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f"
Jul 22 12:40:59.957293 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.957274    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f"} err="failed to get container status \"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f\": rpc error: code = NotFound desc = could not find container \"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f\": container with ID starting with cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f not found: ID does not exist"
Jul 22 12:40:59.957367 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.957294    2556 scope.go:117] "RemoveContainer" containerID="6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07"
Jul 22 12:40:59.957568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.957544    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07"} err="failed to get container status \"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07\": rpc error: code = NotFound desc = could not find container \"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07\": container with ID starting with 6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07 not found: ID does not exist"
Jul 22 12:40:59.957628 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.957571    2556 scope.go:117] "RemoveContainer" containerID="56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584"
Jul 22 12:40:59.957865 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.957847    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584"} err="failed to get container status \"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584\": rpc error: code = NotFound desc = could not find container \"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584\": container with ID starting with 56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584 not found: ID does not exist"
Jul 22 12:40:59.957935 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.957866    2556 scope.go:117] "RemoveContainer" containerID="831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108"
Jul 22 12:40:59.958122 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.958100    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108"} err="failed to get container status \"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108\": rpc error: code = NotFound desc = could not find container \"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108\": container with ID starting with 831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108 not found: ID does not exist"
Jul 22 12:40:59.958167 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.958125    2556 scope.go:117] "RemoveContainer" containerID="1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6"
Jul 22 12:40:59.958366 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.958346    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6"} err="failed to get container status \"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6\": rpc error: code = NotFound desc = could not find container \"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6\": container with ID starting with 1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6 not found: ID does not exist"
Jul 22 12:40:59.958407 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.958367    2556 scope.go:117] "RemoveContainer" containerID="fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0"
Jul 22 12:40:59.958597 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.958580    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0"} err="failed to get container status \"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0\": rpc error: code = NotFound desc = could not find container \"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0\": container with ID starting with fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0 not found: ID does not exist"
Jul 22 12:40:59.958649 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.958597    2556 scope.go:117] "RemoveContainer" containerID="7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9"
Jul 22 12:40:59.958735 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.958719    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 12:40:59.958806 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.958790    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9"} err="failed to get container status \"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9\": rpc error: code = NotFound desc = could not find container \"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9\": container with ID starting with 7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9 not found: ID does not exist"
Jul 22 12:40:59.958863 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.958806    2556 scope.go:117] "RemoveContainer" containerID="cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f"
Jul 22 12:40:59.959040 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959027    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="prometheus"
Jul 22 12:40:59.959091 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959047    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="prometheus"
Jul 22 12:40:59.959091 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959056    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="config-reloader"
Jul 22 12:40:59.959091 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959062    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="config-reloader"
Jul 22 12:40:59.959091 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959075    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="thanos-sidecar"
Jul 22 12:40:59.959091 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959080    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="thanos-sidecar"
Jul 22 12:40:59.959091 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959088    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="init-config-reloader"
Jul 22 12:40:59.959265 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959094    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="init-config-reloader"
Jul 22 12:40:59.959265 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959101    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="kube-rbac-proxy-thanos"
Jul 22 12:40:59.959265 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959106    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="kube-rbac-proxy-thanos"
Jul 22 12:40:59.959265 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959022    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f"} err="failed to get container status \"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f\": rpc error: code = NotFound desc = could not find container \"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f\": container with ID starting with cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f not found: ID does not exist"
Jul 22 12:40:59.959265 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959116    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="kube-rbac-proxy"
Jul 22 12:40:59.959265 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959118    2556 scope.go:117] "RemoveContainer" containerID="6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07"
Jul 22 12:40:59.959265 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959121    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="kube-rbac-proxy"
Jul 22 12:40:59.959265 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959181    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="kube-rbac-proxy-web"
Jul 22 12:40:59.959265 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959188    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="kube-rbac-proxy-web"
Jul 22 12:40:59.959265 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959263    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="kube-rbac-proxy-thanos"
Jul 22 12:40:59.959599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959273    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="prometheus"
Jul 22 12:40:59.959599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959282    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="kube-rbac-proxy-web"
Jul 22 12:40:59.959599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959290    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="kube-rbac-proxy"
Jul 22 12:40:59.959599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959300    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="thanos-sidecar"
Jul 22 12:40:59.959599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959309    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a54f260a-5c8d-4047-825d-440d58956f81" containerName="config-reloader"
Jul 22 12:40:59.959599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959347    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07"} err="failed to get container status \"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07\": rpc error: code = NotFound desc = could not find container \"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07\": container with ID starting with 6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07 not found: ID does not exist"
Jul 22 12:40:59.959599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959362    2556 scope.go:117] "RemoveContainer" containerID="56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584"
Jul 22 12:40:59.959599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959565    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584"} err="failed to get container status \"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584\": rpc error: code = NotFound desc = could not find container \"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584\": container with ID starting with 56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584 not found: ID does not exist"
Jul 22 12:40:59.959599 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959583    2556 scope.go:117] "RemoveContainer" containerID="831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108"
Jul 22 12:40:59.959973 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959759    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108"} err="failed to get container status \"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108\": rpc error: code = NotFound desc = could not find container \"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108\": container with ID starting with 831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108 not found: ID does not exist"
Jul 22 12:40:59.959973 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959772    2556 scope.go:117] "RemoveContainer" containerID="1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6"
Jul 22 12:40:59.960038 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959973    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6"} err="failed to get container status \"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6\": rpc error: code = NotFound desc = could not find container \"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6\": container with ID starting with 1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6 not found: ID does not exist"
Jul 22 12:40:59.960038 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.959985    2556 scope.go:117] "RemoveContainer" containerID="fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0"
Jul 22 12:40:59.960196 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.960179    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0"} err="failed to get container status \"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0\": rpc error: code = NotFound desc = could not find container \"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0\": container with ID starting with fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0 not found: ID does not exist"
Jul 22 12:40:59.960236 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.960197    2556 scope.go:117] "RemoveContainer" containerID="7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9"
Jul 22 12:40:59.960400 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.960379    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9"} err="failed to get container status \"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9\": rpc error: code = NotFound desc = could not find container \"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9\": container with ID starting with 7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9 not found: ID does not exist"
Jul 22 12:40:59.960400 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.960399    2556 scope.go:117] "RemoveContainer" containerID="cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f"
Jul 22 12:40:59.960637 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.960618    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f"} err="failed to get container status \"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f\": rpc error: code = NotFound desc = could not find container \"cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f\": container with ID starting with cc0e08895496564fddd60f028254ef3e399f5580194cde15ce09a4a9480a426f not found: ID does not exist"
Jul 22 12:40:59.960725 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.960641    2556 scope.go:117] "RemoveContainer" containerID="6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07"
Jul 22 12:40:59.960897 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.960879    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07"} err="failed to get container status \"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07\": rpc error: code = NotFound desc = could not find container \"6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07\": container with ID starting with 6a44a13a43ba00ea2a69a9cd1d5a9276bb825ce34c06d7ed63c2b84aa9286f07 not found: ID does not exist"
Jul 22 12:40:59.960965 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.960898    2556 scope.go:117] "RemoveContainer" containerID="56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584"
Jul 22 12:40:59.961107 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.961091    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584"} err="failed to get container status \"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584\": rpc error: code = NotFound desc = could not find container \"56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584\": container with ID starting with 56543c8d7c7b52538e092991c2b317711322c2c25949f6454f288be23a5e2584 not found: ID does not exist"
Jul 22 12:40:59.961148 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.961107    2556 scope.go:117] "RemoveContainer" containerID="831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108"
Jul 22 12:40:59.961299 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.961282    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108"} err="failed to get container status \"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108\": rpc error: code = NotFound desc = could not find container \"831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108\": container with ID starting with 831d91f7e80e56747377710fbe189576b81bb0044523a6ce08d7fcebcb3ed108 not found: ID does not exist"
Jul 22 12:40:59.961359 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.961301    2556 scope.go:117] "RemoveContainer" containerID="1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6"
Jul 22 12:40:59.961485 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.961465    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6"} err="failed to get container status \"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6\": rpc error: code = NotFound desc = could not find container \"1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6\": container with ID starting with 1e043969bf36a77142f2aaf5e83c134e882d6d5aa5367c3999d20df1f70ffcc6 not found: ID does not exist"
Jul 22 12:40:59.961547 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.961486    2556 scope.go:117] "RemoveContainer" containerID="fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0"
Jul 22 12:40:59.961655 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.961638    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0"} err="failed to get container status \"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0\": rpc error: code = NotFound desc = could not find container \"fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0\": container with ID starting with fc71e4b4e757738113a70aeed35c100318871ec6e5a732d61aa66b49db0b4ad0 not found: ID does not exist"
Jul 22 12:40:59.961740 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.961656    2556 scope.go:117] "RemoveContainer" containerID="7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9"
Jul 22 12:40:59.961918 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.961896    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9"} err="failed to get container status \"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9\": rpc error: code = NotFound desc = could not find container \"7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9\": container with ID starting with 7d3c567bb4daf0593e5e77da9675ee99f8bf2e82a5b45b586ec80661c1179ce9 not found: ID does not exist"
Jul 22 12:40:59.963793 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.963779    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:40:59.966712 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.966665    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 12:40:59.966982 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.966964    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 12:40:59.967124 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.966992    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 12:40:59.967124 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.967017    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 12:40:59.967124 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.967021    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 12:40:59.967124 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.967044    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 12:40:59.967124 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.967092    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 12:40:59.967441 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.967257    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7po04udr06osr\""
Jul 22 12:40:59.967441 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.967312    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 12:40:59.967441 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.967420    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 12:40:59.967579 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.967443    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 12:40:59.967579 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.967488    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 12:40:59.967579 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.967553    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2z5l4\""
Jul 22 12:40:59.967795 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.967773    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 12:40:59.967828 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.967793    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 12:40:59.969749 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.969730    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 12:40:59.974041 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.974025    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 12:40:59.981574 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:40:59.981553    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 12:41:00.096795 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.096763    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.096795 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.096795    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.096983 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.096815    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.096983 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.096863    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.096983 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.096904    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.096983 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.096932    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.096983 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.096948    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.096983 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.096966    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9b5n\" (UniqueName: \"kubernetes.io/projected/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-kube-api-access-z9b5n\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.096983 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.096984    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.097195 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.096998    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.097195 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.097016    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.097195 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.097049    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-web-config\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.097195 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.097064    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-config-out\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.097195 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.097077    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.097195 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.097123    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.097195 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.097173    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.097386 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.097197    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-config\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.097386 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.097212    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.097386 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.097229    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.097386 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.097269    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198263 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198183    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198263 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198214    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-config\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198263 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198234    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198263 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198252    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198275    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198301    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198317    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198343    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198376    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198409    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198439    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198459    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198480    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9b5n\" (UniqueName: \"kubernetes.io/projected/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-kube-api-access-z9b5n\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198499    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198521    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198543    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198565    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-web-config\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198588    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-config-out\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198608    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198644    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.198921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.198823    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.199926 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.199426    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.199926 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.199736    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.200366 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.200341    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.201078 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.201058    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.201468 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.201345    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.202816 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.201608    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-config\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.202816 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.201806    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.202816 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.201862    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.202816 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.201890    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-config-out\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.202816 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.201892    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.202816 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.202290    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.202816 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.202731    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.203632 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.203606    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.204067 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.204042    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-web-config\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.204570 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.204544    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.204666 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.204652    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.204751 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.204666    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.205103 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.205085    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.210961 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.210945    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9b5n\" (UniqueName: \"kubernetes.io/projected/36a657c1-02b0-4782-9d4d-b1e31a1a4d96-kube-api-access-z9b5n\") pod \"prometheus-k8s-0\" (UID: \"36a657c1-02b0-4782-9d4d-b1e31a1a4d96\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.273140 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.273116    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:41:00.415859 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.415825    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 12:41:00.419248 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:41:00.419222    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36a657c1_02b0_4782_9d4d_b1e31a1a4d96.slice/crio-d38ebdade46ce88ad528f8b9473a310676533b367b0c903986f4fac360bee24e WatchSource:0}: Error finding container d38ebdade46ce88ad528f8b9473a310676533b367b0c903986f4fac360bee24e: Status 404 returned error can't find the container with id d38ebdade46ce88ad528f8b9473a310676533b367b0c903986f4fac360bee24e
Jul 22 12:41:00.906862 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.906826    2556 generic.go:356] "Generic (PLEG): container finished" podID="36a657c1-02b0-4782-9d4d-b1e31a1a4d96" containerID="2633dadd57c0a9a2d312b3d442171eccbd81da5824dce9ad1a88d203386cedba" exitCode=0
Jul 22 12:41:00.907258 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.906913    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36a657c1-02b0-4782-9d4d-b1e31a1a4d96","Type":"ContainerDied","Data":"2633dadd57c0a9a2d312b3d442171eccbd81da5824dce9ad1a88d203386cedba"}
Jul 22 12:41:00.907258 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:00.907025    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36a657c1-02b0-4782-9d4d-b1e31a1a4d96","Type":"ContainerStarted","Data":"d38ebdade46ce88ad528f8b9473a310676533b367b0c903986f4fac360bee24e"}
Jul 22 12:41:01.900919 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:01.900882    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a54f260a-5c8d-4047-825d-440d58956f81" path="/var/lib/kubelet/pods/a54f260a-5c8d-4047-825d-440d58956f81/volumes"
Jul 22 12:41:01.915242 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:01.915210    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36a657c1-02b0-4782-9d4d-b1e31a1a4d96","Type":"ContainerStarted","Data":"b7f8491213e3a24e42288fde253e67157e6fc00e484317b2e59e786a60edc644"}
Jul 22 12:41:01.915567 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:01.915274    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36a657c1-02b0-4782-9d4d-b1e31a1a4d96","Type":"ContainerStarted","Data":"399276f700b730d873246e12070196da71eea17c8ff1bb1dd5e82fccd4a44dbe"}
Jul 22 12:41:01.915567 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:01.915301    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36a657c1-02b0-4782-9d4d-b1e31a1a4d96","Type":"ContainerStarted","Data":"e428a7dcd5878597377415b5d68eff92d5f1d58e7bd8f76cdcfc7ee0aa438de1"}
Jul 22 12:41:01.915567 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:01.915351    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36a657c1-02b0-4782-9d4d-b1e31a1a4d96","Type":"ContainerStarted","Data":"0349f981c33cd1048fbc2db46c460855fcbd5dff10e7fca939bb741c83fb87a0"}
Jul 22 12:41:01.915567 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:01.915384    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36a657c1-02b0-4782-9d4d-b1e31a1a4d96","Type":"ContainerStarted","Data":"44b27a72c57dc98518c17b4b893383394dfa996cffacac3bf067c47cdff469d5"}
Jul 22 12:41:01.915567 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:01.915407    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36a657c1-02b0-4782-9d4d-b1e31a1a4d96","Type":"ContainerStarted","Data":"310bda832a632382448c941df9d25cc036c96426127bdffed91f77b99bd9ddcd"}
Jul 22 12:41:01.949411 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:01.949360    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.9277079710000002 podStartE2EDuration="2.949343958s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.635987ms" isStatefulPod=false podCreationTimestamp="2026-07-22 12:40:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:41:01.947095497 +0000 UTC m=+224.587341758" watchObservedRunningTime="2026-07-22 12:41:01.949343958 +0000 UTC m=+224.589590200"
Jul 22 12:41:05.273831 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:41:05.273787    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:42:00.273865 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:42:00.273822    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:42:00.289918 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:42:00.289892    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:42:01.168423 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:42:01.168394    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 12:42:17.759526 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:42:17.759493    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 12:42:17.766301 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:42:17.766272    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 12:42:17.768461 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:42:17.768440    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 12:42:17.772331 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:42:17.772314    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 12:42:17.773430 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:42:17.773414    2556 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 12:43:54.403097 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:43:54.403062    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x6kk8"]
Jul 22 12:43:54.405266 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:43:54.405249    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-x6kk8"
Jul 22 12:43:54.408824 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:43:54.408798    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kdpwr\""
Jul 22 12:43:54.409290 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:43:54.409271    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 22 12:43:54.409701 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:43:54.409656    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 22 12:43:54.413795 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:43:54.413775    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x6kk8"]
Jul 22 12:43:54.487180 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:43:54.487147    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/650e0214-bdd3-43d3-a99f-3afb340d6970-bound-sa-token\") pod \"cert-manager-55b4d954d5-x6kk8\" (UID: \"650e0214-bdd3-43d3-a99f-3afb340d6970\") " pod="cert-manager/cert-manager-55b4d954d5-x6kk8"
Jul 22 12:43:54.487180 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:43:54.487184    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzmgb\" (UniqueName: \"kubernetes.io/projected/650e0214-bdd3-43d3-a99f-3afb340d6970-kube-api-access-qzmgb\") pod \"cert-manager-55b4d954d5-x6kk8\" (UID: \"650e0214-bdd3-43d3-a99f-3afb340d6970\") " pod="cert-manager/cert-manager-55b4d954d5-x6kk8"
Jul 22 12:43:54.587999 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:43:54.587957    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/650e0214-bdd3-43d3-a99f-3afb340d6970-bound-sa-token\") pod \"cert-manager-55b4d954d5-x6kk8\" (UID: \"650e0214-bdd3-43d3-a99f-3afb340d6970\") " pod="cert-manager/cert-manager-55b4d954d5-x6kk8"
Jul 22 12:43:54.588177 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:43:54.588012    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzmgb\" (UniqueName: \"kubernetes.io/projected/650e0214-bdd3-43d3-a99f-3afb340d6970-kube-api-access-qzmgb\") pod \"cert-manager-55b4d954d5-x6kk8\" (UID: \"650e0214-bdd3-43d3-a99f-3afb340d6970\") " pod="cert-manager/cert-manager-55b4d954d5-x6kk8"
Jul 22 12:43:54.596702 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:43:54.596660    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/650e0214-bdd3-43d3-a99f-3afb340d6970-bound-sa-token\") pod \"cert-manager-55b4d954d5-x6kk8\" (UID: \"650e0214-bdd3-43d3-a99f-3afb340d6970\") " pod="cert-manager/cert-manager-55b4d954d5-x6kk8"
Jul 22 12:43:54.596972 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:43:54.596952    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzmgb\" (UniqueName: \"kubernetes.io/projected/650e0214-bdd3-43d3-a99f-3afb340d6970-kube-api-access-qzmgb\") pod \"cert-manager-55b4d954d5-x6kk8\" (UID: \"650e0214-bdd3-43d3-a99f-3afb340d6970\") " pod="cert-manager/cert-manager-55b4d954d5-x6kk8"
Jul 22 12:43:54.732623 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:43:54.732541    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-x6kk8"
Jul 22 12:43:54.861827 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:43:54.861800    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x6kk8"]
Jul 22 12:43:54.864623 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:43:54.864594    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod650e0214_bdd3_43d3_a99f_3afb340d6970.slice/crio-fb8494f7cca265034f57578cc0fbf1bd62a4026cb101cf90327cc7a43fcaf57c WatchSource:0}: Error finding container fb8494f7cca265034f57578cc0fbf1bd62a4026cb101cf90327cc7a43fcaf57c: Status 404 returned error can't find the container with id fb8494f7cca265034f57578cc0fbf1bd62a4026cb101cf90327cc7a43fcaf57c
Jul 22 12:43:54.866600 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:43:54.866584    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 12:43:55.597755 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:43:55.597705    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-x6kk8" event={"ID":"650e0214-bdd3-43d3-a99f-3afb340d6970","Type":"ContainerStarted","Data":"fb8494f7cca265034f57578cc0fbf1bd62a4026cb101cf90327cc7a43fcaf57c"}
Jul 22 12:44:09.653648 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:09.653610    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-x6kk8" event={"ID":"650e0214-bdd3-43d3-a99f-3afb340d6970","Type":"ContainerStarted","Data":"6eee84d75a75549887fe0c9376763f52284bc2b2cb6bb7ed8c5eb702ff3b4367"}
Jul 22 12:44:09.670942 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:09.670898    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-x6kk8" podStartSLOduration=1.4984113940000001 podStartE2EDuration="15.670884107s" totalImagesPullingTime="14.172472713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:43:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:44:09.669573447 +0000 UTC m=+412.309819757" watchObservedRunningTime="2026-07-22 12:44:09.670884107 +0000 UTC m=+412.311130348"
Jul 22 12:44:12.701531 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.701500    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"]
Jul 22 12:44:12.703834 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.703817    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"
Jul 22 12:44:12.707537 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.707503    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 12:44:12.707667 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.707518    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 12:44:12.707667 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.707518    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 22 12:44:12.707868 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.707842    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 22 12:44:12.707978 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.707881    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6xndg\""
Jul 22 12:44:12.707978 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.707881    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 22 12:44:12.714795 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.714774    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"]
Jul 22 12:44:12.849344 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.849316    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/12567fb4-ed34-4538-8e7d-efdabb121a70-manager-config\") pod \"lws-controller-manager-d84f87864-8b6vc\" (UID: \"12567fb4-ed34-4538-8e7d-efdabb121a70\") " pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"
Jul 22 12:44:12.849512 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.849371    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx9hl\" (UniqueName: \"kubernetes.io/projected/12567fb4-ed34-4538-8e7d-efdabb121a70-kube-api-access-jx9hl\") pod \"lws-controller-manager-d84f87864-8b6vc\" (UID: \"12567fb4-ed34-4538-8e7d-efdabb121a70\") " pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"
Jul 22 12:44:12.849512 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.849416    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/12567fb4-ed34-4538-8e7d-efdabb121a70-metrics-cert\") pod \"lws-controller-manager-d84f87864-8b6vc\" (UID: \"12567fb4-ed34-4538-8e7d-efdabb121a70\") " pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"
Jul 22 12:44:12.849512 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.849436    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12567fb4-ed34-4538-8e7d-efdabb121a70-cert\") pod \"lws-controller-manager-d84f87864-8b6vc\" (UID: \"12567fb4-ed34-4538-8e7d-efdabb121a70\") " pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"
Jul 22 12:44:12.949901 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.949867    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/12567fb4-ed34-4538-8e7d-efdabb121a70-manager-config\") pod \"lws-controller-manager-d84f87864-8b6vc\" (UID: \"12567fb4-ed34-4538-8e7d-efdabb121a70\") " pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"
Jul 22 12:44:12.950093 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.949926    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx9hl\" (UniqueName: \"kubernetes.io/projected/12567fb4-ed34-4538-8e7d-efdabb121a70-kube-api-access-jx9hl\") pod \"lws-controller-manager-d84f87864-8b6vc\" (UID: \"12567fb4-ed34-4538-8e7d-efdabb121a70\") " pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"
Jul 22 12:44:12.950093 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.949948    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/12567fb4-ed34-4538-8e7d-efdabb121a70-metrics-cert\") pod \"lws-controller-manager-d84f87864-8b6vc\" (UID: \"12567fb4-ed34-4538-8e7d-efdabb121a70\") " pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"
Jul 22 12:44:12.950093 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.949968    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12567fb4-ed34-4538-8e7d-efdabb121a70-cert\") pod \"lws-controller-manager-d84f87864-8b6vc\" (UID: \"12567fb4-ed34-4538-8e7d-efdabb121a70\") " pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"
Jul 22 12:44:12.950664 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.950593    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/12567fb4-ed34-4538-8e7d-efdabb121a70-manager-config\") pod \"lws-controller-manager-d84f87864-8b6vc\" (UID: \"12567fb4-ed34-4538-8e7d-efdabb121a70\") " pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"
Jul 22 12:44:12.952537 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.952481    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/12567fb4-ed34-4538-8e7d-efdabb121a70-metrics-cert\") pod \"lws-controller-manager-d84f87864-8b6vc\" (UID: \"12567fb4-ed34-4538-8e7d-efdabb121a70\") " pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"
Jul 22 12:44:12.952627 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.952540    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12567fb4-ed34-4538-8e7d-efdabb121a70-cert\") pod \"lws-controller-manager-d84f87864-8b6vc\" (UID: \"12567fb4-ed34-4538-8e7d-efdabb121a70\") " pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"
Jul 22 12:44:12.958631 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:12.958604    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx9hl\" (UniqueName: \"kubernetes.io/projected/12567fb4-ed34-4538-8e7d-efdabb121a70-kube-api-access-jx9hl\") pod \"lws-controller-manager-d84f87864-8b6vc\" (UID: \"12567fb4-ed34-4538-8e7d-efdabb121a70\") " pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"
Jul 22 12:44:13.013638 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:13.013617    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"
Jul 22 12:44:13.142785 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:13.142736    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"]
Jul 22 12:44:13.144805 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:44:13.144776    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12567fb4_ed34_4538_8e7d_efdabb121a70.slice/crio-7c29f11834208b071bc64217972ca3ab63a11216b6ef48f33d7ca091d7c42733 WatchSource:0}: Error finding container 7c29f11834208b071bc64217972ca3ab63a11216b6ef48f33d7ca091d7c42733: Status 404 returned error can't find the container with id 7c29f11834208b071bc64217972ca3ab63a11216b6ef48f33d7ca091d7c42733
Jul 22 12:44:13.676951 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:13.676915    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc" event={"ID":"12567fb4-ed34-4538-8e7d-efdabb121a70","Type":"ContainerStarted","Data":"7c29f11834208b071bc64217972ca3ab63a11216b6ef48f33d7ca091d7c42733"}
Jul 22 12:44:15.686130 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:15.686096    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc" event={"ID":"12567fb4-ed34-4538-8e7d-efdabb121a70","Type":"ContainerStarted","Data":"961220e36cd66faaf266d02bf676059aed7474b787d012a0ced1f6229bc10d5d"}
Jul 22 12:44:15.686418 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:15.686161    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"
Jul 22 12:44:15.707436 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:15.707390    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc" podStartSLOduration=1.23781459 podStartE2EDuration="3.707372236s" totalImagesPullingTime="2.469557646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:44:15.706580078 +0000 UTC m=+418.346826338" watchObservedRunningTime="2026-07-22 12:44:15.707372236 +0000 UTC m=+418.347618477"
Jul 22 12:44:18.196578 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.196546    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"]
Jul 22 12:44:18.198927 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.198911    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:18.202899 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.202880    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 12:44:18.203007 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.202937    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-22wzv\""
Jul 22 12:44:18.203325 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.203307    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 12:44:18.203395 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.203381    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 12:44:18.204317 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.204290    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 12:44:18.214485 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.214466    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"]
Jul 22 12:44:18.298647 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.298617    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d28b833-e189-403c-a273-bf70485a73f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-d99b87cc7-dnvgz\" (UID: \"3d28b833-e189-403c-a273-bf70485a73f5\") " pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:18.298647 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.298650    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8crwn\" (UniqueName: \"kubernetes.io/projected/3d28b833-e189-403c-a273-bf70485a73f5-kube-api-access-8crwn\") pod \"opendatahub-operator-controller-manager-d99b87cc7-dnvgz\" (UID: \"3d28b833-e189-403c-a273-bf70485a73f5\") " pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:18.298862 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.298701    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d28b833-e189-403c-a273-bf70485a73f5-tmp\") pod \"opendatahub-operator-controller-manager-d99b87cc7-dnvgz\" (UID: \"3d28b833-e189-403c-a273-bf70485a73f5\") " pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:18.298862 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.298820    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3d28b833-e189-403c-a273-bf70485a73f5-manifests\") pod \"opendatahub-operator-controller-manager-d99b87cc7-dnvgz\" (UID: \"3d28b833-e189-403c-a273-bf70485a73f5\") " pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:18.298862 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.298851    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3d28b833-e189-403c-a273-bf70485a73f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d99b87cc7-dnvgz\" (UID: \"3d28b833-e189-403c-a273-bf70485a73f5\") " pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:18.399996 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.399952    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3d28b833-e189-403c-a273-bf70485a73f5-manifests\") pod \"opendatahub-operator-controller-manager-d99b87cc7-dnvgz\" (UID: \"3d28b833-e189-403c-a273-bf70485a73f5\") " pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:18.400142 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.400004    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3d28b833-e189-403c-a273-bf70485a73f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d99b87cc7-dnvgz\" (UID: \"3d28b833-e189-403c-a273-bf70485a73f5\") " pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:18.400142 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.400063    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d28b833-e189-403c-a273-bf70485a73f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-d99b87cc7-dnvgz\" (UID: \"3d28b833-e189-403c-a273-bf70485a73f5\") " pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:18.400142 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.400092    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8crwn\" (UniqueName: \"kubernetes.io/projected/3d28b833-e189-403c-a273-bf70485a73f5-kube-api-access-8crwn\") pod \"opendatahub-operator-controller-manager-d99b87cc7-dnvgz\" (UID: \"3d28b833-e189-403c-a273-bf70485a73f5\") " pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:18.400142 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.400123    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d28b833-e189-403c-a273-bf70485a73f5-tmp\") pod \"opendatahub-operator-controller-manager-d99b87cc7-dnvgz\" (UID: \"3d28b833-e189-403c-a273-bf70485a73f5\") " pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:18.400438 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.400416    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3d28b833-e189-403c-a273-bf70485a73f5-manifests\") pod \"opendatahub-operator-controller-manager-d99b87cc7-dnvgz\" (UID: \"3d28b833-e189-403c-a273-bf70485a73f5\") " pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:18.402450 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.402425    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d28b833-e189-403c-a273-bf70485a73f5-tmp\") pod \"opendatahub-operator-controller-manager-d99b87cc7-dnvgz\" (UID: \"3d28b833-e189-403c-a273-bf70485a73f5\") " pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:18.402691 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.402659    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3d28b833-e189-403c-a273-bf70485a73f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d99b87cc7-dnvgz\" (UID: \"3d28b833-e189-403c-a273-bf70485a73f5\") " pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:18.402763 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.402748    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d28b833-e189-403c-a273-bf70485a73f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-d99b87cc7-dnvgz\" (UID: \"3d28b833-e189-403c-a273-bf70485a73f5\") " pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:18.414306 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.414286    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8crwn\" (UniqueName: \"kubernetes.io/projected/3d28b833-e189-403c-a273-bf70485a73f5-kube-api-access-8crwn\") pod \"opendatahub-operator-controller-manager-d99b87cc7-dnvgz\" (UID: \"3d28b833-e189-403c-a273-bf70485a73f5\") " pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:18.509298 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.509225    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:18.646084 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.646054    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"]
Jul 22 12:44:18.648776 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:44:18.648747    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d28b833_e189_403c_a273_bf70485a73f5.slice/crio-38011873fd959bb18fac2dbff81e7f17b97020b8409d033df1fb85be3126a3e2 WatchSource:0}: Error finding container 38011873fd959bb18fac2dbff81e7f17b97020b8409d033df1fb85be3126a3e2: Status 404 returned error can't find the container with id 38011873fd959bb18fac2dbff81e7f17b97020b8409d033df1fb85be3126a3e2
Jul 22 12:44:18.702219 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:18.702181    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz" event={"ID":"3d28b833-e189-403c-a273-bf70485a73f5","Type":"ContainerStarted","Data":"38011873fd959bb18fac2dbff81e7f17b97020b8409d033df1fb85be3126a3e2"}
Jul 22 12:44:21.721758 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:21.721724    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz" event={"ID":"3d28b833-e189-403c-a273-bf70485a73f5","Type":"ContainerStarted","Data":"ada74d77923e1555044ad1790c74a139903e04497ed3ac690fbeeb6b391302bb"}
Jul 22 12:44:22.727890 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:22.727854    2556 generic.go:356] "Generic (PLEG): container finished" podID="3d28b833-e189-403c-a273-bf70485a73f5" containerID="ada74d77923e1555044ad1790c74a139903e04497ed3ac690fbeeb6b391302bb" exitCode=0
Jul 22 12:44:22.728216 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:22.727904    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz" event={"ID":"3d28b833-e189-403c-a273-bf70485a73f5","Type":"ContainerDied","Data":"ada74d77923e1555044ad1790c74a139903e04497ed3ac690fbeeb6b391302bb"}
Jul 22 12:44:23.734555 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:23.734517    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz" event={"ID":"3d28b833-e189-403c-a273-bf70485a73f5","Type":"ContainerStarted","Data":"fb07c96774a8601ffa67115e9690a5fd73dac8abba11d85e11076ee0fb9b0e40"}
Jul 22 12:44:23.734957 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:23.734637    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:23.760961 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:23.760904    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz" podStartSLOduration=1.433834509 podStartE2EDuration="5.760883537s" totalImagesPullingTime="3.282279755s" totalInitContainerRuntime="1.044769273s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:44:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:44:23.758823301 +0000 UTC m=+426.399069561" watchObservedRunningTime="2026-07-22 12:44:23.760883537 +0000 UTC m=+426.401129778"
Jul 22 12:44:26.692555 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:26.692523    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d84f87864-8b6vc"
Jul 22 12:44:34.741082 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:34.741046    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d99b87cc7-dnvgz"
Jul 22 12:44:45.482805 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.482769    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"]
Jul 22 12:44:45.485401 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.485386    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.492400 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.492385    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 22 12:44:45.492479 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.492410    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 12:44:45.493881 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.493862    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 22 12:44:45.495356 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.495339    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 12:44:45.495542 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.495529    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 22 12:44:45.497776 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.497761    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 22 12:44:45.499800 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.499786    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6pb2j\""
Jul 22 12:44:45.518907 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.518881    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"]
Jul 22 12:44:45.546311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.546283    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c0d6b03-17c9-4668-805f-65c733666a58-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.546412 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.546311    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3c0d6b03-17c9-4668-805f-65c733666a58-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.546412 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.546329    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92szq\" (UniqueName: \"kubernetes.io/projected/3c0d6b03-17c9-4668-805f-65c733666a58-kube-api-access-92szq\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.546412 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.546363    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3c0d6b03-17c9-4668-805f-65c733666a58-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.546412 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.546387    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3c0d6b03-17c9-4668-805f-65c733666a58-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.546560 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.546416    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3c0d6b03-17c9-4668-805f-65c733666a58-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.546560 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.546464    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c0d6b03-17c9-4668-805f-65c733666a58-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.647538 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.647500    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c0d6b03-17c9-4668-805f-65c733666a58-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.647538 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.647537    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3c0d6b03-17c9-4668-805f-65c733666a58-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.647823 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.647563    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92szq\" (UniqueName: \"kubernetes.io/projected/3c0d6b03-17c9-4668-805f-65c733666a58-kube-api-access-92szq\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.647823 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.647595    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3c0d6b03-17c9-4668-805f-65c733666a58-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.647823 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.647615    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3c0d6b03-17c9-4668-805f-65c733666a58-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.647823 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.647647    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3c0d6b03-17c9-4668-805f-65c733666a58-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.647823 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.647731    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c0d6b03-17c9-4668-805f-65c733666a58-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.648588 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.648560    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3c0d6b03-17c9-4668-805f-65c733666a58-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.650128 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.650102    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3c0d6b03-17c9-4668-805f-65c733666a58-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.650230 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.650164    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3c0d6b03-17c9-4668-805f-65c733666a58-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.650484 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.650457    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c0d6b03-17c9-4668-805f-65c733666a58-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.650590 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.650576    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3c0d6b03-17c9-4668-805f-65c733666a58-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.659076 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.659056    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c0d6b03-17c9-4668-805f-65c733666a58-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.660277 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.660258    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92szq\" (UniqueName: \"kubernetes.io/projected/3c0d6b03-17c9-4668-805f-65c733666a58-kube-api-access-92szq\") pod \"istiod-openshift-gateway-94bb8fbfd-9dwnn\" (UID: \"3c0d6b03-17c9-4668-805f-65c733666a58\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.794877 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.794837    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:45.939411 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:45.939389    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"]
Jul 22 12:44:45.941186 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:44:45.941159    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c0d6b03_17c9_4668_805f_65c733666a58.slice/crio-25e75a899959225fb0a3c1658a7f3e74551727ade5f5d0f2236e2813802d4cf8 WatchSource:0}: Error finding container 25e75a899959225fb0a3c1658a7f3e74551727ade5f5d0f2236e2813802d4cf8: Status 404 returned error can't find the container with id 25e75a899959225fb0a3c1658a7f3e74551727ade5f5d0f2236e2813802d4cf8
Jul 22 12:44:46.840696 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:46.840652    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn" event={"ID":"3c0d6b03-17c9-4668-805f-65c733666a58","Type":"ContainerStarted","Data":"25e75a899959225fb0a3c1658a7f3e74551727ade5f5d0f2236e2813802d4cf8"}
Jul 22 12:44:48.274006 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:48.273956    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 12:44:48.274368 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:48.274030    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 12:44:48.852275 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:48.852242    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn" event={"ID":"3c0d6b03-17c9-4668-805f-65c733666a58","Type":"ContainerStarted","Data":"2d2befb1647578f9f0babdae11168a78ee3b2b556420804742a9f5bd7ee2e095"}
Jul 22 12:44:48.852454 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:48.852337    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:49.858419 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:49.858386    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn"
Jul 22 12:44:49.883469 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:44:49.883424    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9dwnn" podStartSLOduration=2.552870511 podStartE2EDuration="4.883407334s" totalImagesPullingTime="2.330536823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:44:48.927898173 +0000 UTC m=+451.568144438" watchObservedRunningTime="2026-07-22 12:44:49.883407334 +0000 UTC m=+452.523653574"
Jul 22 12:46:36.971576 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:36.971476    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq"]
Jul 22 12:46:36.975134 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:36.975112    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq"
Jul 22 12:46:36.978079 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:36.978054    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 12:46:36.978204 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:36.978182    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gfdhd\""
Jul 22 12:46:36.978412 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:36.978399    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 12:46:36.990264 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:36.990240    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq"]
Jul 22 12:46:37.035056 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:37.035016    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6b2eb22-e04e-4983-8cb9-8ecff2000319-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ltrlq\" (UID: \"f6b2eb22-e04e-4983-8cb9-8ecff2000319\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq"
Jul 22 12:46:37.035056 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:37.035055    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67srl\" (UniqueName: \"kubernetes.io/projected/f6b2eb22-e04e-4983-8cb9-8ecff2000319-kube-api-access-67srl\") pod \"kuadrant-operator-controller-manager-86878c769f-ltrlq\" (UID: \"f6b2eb22-e04e-4983-8cb9-8ecff2000319\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq"
Jul 22 12:46:37.136359 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:37.136322    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6b2eb22-e04e-4983-8cb9-8ecff2000319-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ltrlq\" (UID: \"f6b2eb22-e04e-4983-8cb9-8ecff2000319\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq"
Jul 22 12:46:37.136359 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:37.136362    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67srl\" (UniqueName: \"kubernetes.io/projected/f6b2eb22-e04e-4983-8cb9-8ecff2000319-kube-api-access-67srl\") pod \"kuadrant-operator-controller-manager-86878c769f-ltrlq\" (UID: \"f6b2eb22-e04e-4983-8cb9-8ecff2000319\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq"
Jul 22 12:46:37.136754 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:37.136736    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6b2eb22-e04e-4983-8cb9-8ecff2000319-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ltrlq\" (UID: \"f6b2eb22-e04e-4983-8cb9-8ecff2000319\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq"
Jul 22 12:46:37.150471 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:37.150442    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67srl\" (UniqueName: \"kubernetes.io/projected/f6b2eb22-e04e-4983-8cb9-8ecff2000319-kube-api-access-67srl\") pod \"kuadrant-operator-controller-manager-86878c769f-ltrlq\" (UID: \"f6b2eb22-e04e-4983-8cb9-8ecff2000319\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq"
Jul 22 12:46:37.284921 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:37.284882    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq"
Jul 22 12:46:37.431492 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:37.431434    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq"]
Jul 22 12:46:37.437056 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:46:37.437023    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6b2eb22_e04e_4983_8cb9_8ecff2000319.slice/crio-c58bcc80b7e987521fda70fe042ceb29bb7fae886db2742324a012cd37453a3e WatchSource:0}: Error finding container c58bcc80b7e987521fda70fe042ceb29bb7fae886db2742324a012cd37453a3e: Status 404 returned error can't find the container with id c58bcc80b7e987521fda70fe042ceb29bb7fae886db2742324a012cd37453a3e
Jul 22 12:46:38.336130 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:38.336094    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq" event={"ID":"f6b2eb22-e04e-4983-8cb9-8ecff2000319","Type":"ContainerStarted","Data":"c58bcc80b7e987521fda70fe042ceb29bb7fae886db2742324a012cd37453a3e"}
Jul 22 12:46:42.357359 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:42.357322    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq" event={"ID":"f6b2eb22-e04e-4983-8cb9-8ecff2000319","Type":"ContainerStarted","Data":"c802d11964b0e32df9ed516bfe682a22559803426ed19b54061e50a09a1d696e"}
Jul 22 12:46:42.357822 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:42.357397    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq"
Jul 22 12:46:42.387534 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:42.387477    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq" podStartSLOduration=1.815675475 podStartE2EDuration="6.387436679s" totalImagesPullingTime="4.571761204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:46:42.386067069 +0000 UTC m=+565.026313310" watchObservedRunningTime="2026-07-22 12:46:42.387436679 +0000 UTC m=+565.027682919"
Jul 22 12:46:53.365348 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:46:53.365320    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq"
Jul 22 12:47:17.793396 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:17.793365    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 12:47:17.795269 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:17.795247    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 12:47:17.796741 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:17.796725    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 12:47:17.798509 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:17.798488    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 12:47:53.494536 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:53.494500    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7646889cfb-c8wmw"]
Jul 22 12:47:53.497088 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:53.497071    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646889cfb-c8wmw"
Jul 22 12:47:53.502193 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:53.502172    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 12:47:53.502322 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:53.502184    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ns5lk\""
Jul 22 12:47:53.508242 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:53.508224    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 12:47:53.511348 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:53.511329    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7646889cfb-c8wmw"]
Jul 22 12:47:53.605849 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:53.605821    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31c76ca9-8d72-4ddc-a13e-a065675270d5-webhook-cert\") pod \"maas-controller-7646889cfb-c8wmw\" (UID: \"31c76ca9-8d72-4ddc-a13e-a065675270d5\") " pod="opendatahub/maas-controller-7646889cfb-c8wmw"
Jul 22 12:47:53.605849 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:53.605852    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwrcz\" (UniqueName: \"kubernetes.io/projected/31c76ca9-8d72-4ddc-a13e-a065675270d5-kube-api-access-vwrcz\") pod \"maas-controller-7646889cfb-c8wmw\" (UID: \"31c76ca9-8d72-4ddc-a13e-a065675270d5\") " pod="opendatahub/maas-controller-7646889cfb-c8wmw"
Jul 22 12:47:53.706651 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:53.706621    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31c76ca9-8d72-4ddc-a13e-a065675270d5-webhook-cert\") pod \"maas-controller-7646889cfb-c8wmw\" (UID: \"31c76ca9-8d72-4ddc-a13e-a065675270d5\") " pod="opendatahub/maas-controller-7646889cfb-c8wmw"
Jul 22 12:47:53.706651 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:53.706651    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwrcz\" (UniqueName: \"kubernetes.io/projected/31c76ca9-8d72-4ddc-a13e-a065675270d5-kube-api-access-vwrcz\") pod \"maas-controller-7646889cfb-c8wmw\" (UID: \"31c76ca9-8d72-4ddc-a13e-a065675270d5\") " pod="opendatahub/maas-controller-7646889cfb-c8wmw"
Jul 22 12:47:53.709201 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:53.709177    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31c76ca9-8d72-4ddc-a13e-a065675270d5-webhook-cert\") pod \"maas-controller-7646889cfb-c8wmw\" (UID: \"31c76ca9-8d72-4ddc-a13e-a065675270d5\") " pod="opendatahub/maas-controller-7646889cfb-c8wmw"
Jul 22 12:47:53.717426 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:53.717404    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwrcz\" (UniqueName: \"kubernetes.io/projected/31c76ca9-8d72-4ddc-a13e-a065675270d5-kube-api-access-vwrcz\") pod \"maas-controller-7646889cfb-c8wmw\" (UID: \"31c76ca9-8d72-4ddc-a13e-a065675270d5\") " pod="opendatahub/maas-controller-7646889cfb-c8wmw"
Jul 22 12:47:53.806733 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:53.806703    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646889cfb-c8wmw"
Jul 22 12:47:53.941003 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:53.940979    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7646889cfb-c8wmw"]
Jul 22 12:47:53.943354 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:47:53.943325    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c76ca9_8d72_4ddc_a13e_a065675270d5.slice/crio-11b8650ea75bf9f010426356ec134efa2b5a81f3b467af4a7cb3b33a9b9c8b6c WatchSource:0}: Error finding container 11b8650ea75bf9f010426356ec134efa2b5a81f3b467af4a7cb3b33a9b9c8b6c: Status 404 returned error can't find the container with id 11b8650ea75bf9f010426356ec134efa2b5a81f3b467af4a7cb3b33a9b9c8b6c
Jul 22 12:47:54.686698 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:54.686644    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646889cfb-c8wmw" event={"ID":"31c76ca9-8d72-4ddc-a13e-a065675270d5","Type":"ContainerStarted","Data":"11b8650ea75bf9f010426356ec134efa2b5a81f3b467af4a7cb3b33a9b9c8b6c"}
Jul 22 12:47:56.697857 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:56.697815    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646889cfb-c8wmw" event={"ID":"31c76ca9-8d72-4ddc-a13e-a065675270d5","Type":"ContainerStarted","Data":"63ea2bd8d660a1cfe1d9b229f25e9248586c44e2b7c9758790c770cf37fa44ff"}
Jul 22 12:47:56.698241 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:56.697929    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7646889cfb-c8wmw"
Jul 22 12:47:56.722780 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:47:56.722734    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7646889cfb-c8wmw" podStartSLOduration=1.6868365349999999 podStartE2EDuration="3.722719708s" totalImagesPullingTime="2.035883173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:47:56.721508785 +0000 UTC m=+639.361755035" watchObservedRunningTime="2026-07-22 12:47:56.722719708 +0000 UTC m=+639.362965947"
Jul 22 12:48:07.704771 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:07.704733    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7646889cfb-c8wmw"
Jul 22 12:48:55.599563 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.599526    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"]
Jul 22 12:48:55.603510 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.603493    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.607638 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.607597    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 22 12:48:55.607790 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.607652    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 12:48:55.607790 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.607597    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 12:48:55.607790 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.607738    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sg465\""
Jul 22 12:48:55.611889 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.611868    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"]
Jul 22 12:48:55.756598 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.756569    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f799b733-a369-4bbb-8c62-a39e14abb707-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh\" (UID: \"f799b733-a369-4bbb-8c62-a39e14abb707\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.756803 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.756625    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw27h\" (UniqueName: \"kubernetes.io/projected/f799b733-a369-4bbb-8c62-a39e14abb707-kube-api-access-jw27h\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh\" (UID: \"f799b733-a369-4bbb-8c62-a39e14abb707\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.756803 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.756655    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f799b733-a369-4bbb-8c62-a39e14abb707-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh\" (UID: \"f799b733-a369-4bbb-8c62-a39e14abb707\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.756803 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.756786    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f799b733-a369-4bbb-8c62-a39e14abb707-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh\" (UID: \"f799b733-a369-4bbb-8c62-a39e14abb707\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.756966 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.756827    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f799b733-a369-4bbb-8c62-a39e14abb707-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh\" (UID: \"f799b733-a369-4bbb-8c62-a39e14abb707\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.756966 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.756860    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f799b733-a369-4bbb-8c62-a39e14abb707-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh\" (UID: \"f799b733-a369-4bbb-8c62-a39e14abb707\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.857637 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.857557    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f799b733-a369-4bbb-8c62-a39e14abb707-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh\" (UID: \"f799b733-a369-4bbb-8c62-a39e14abb707\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.857637 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.857615    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw27h\" (UniqueName: \"kubernetes.io/projected/f799b733-a369-4bbb-8c62-a39e14abb707-kube-api-access-jw27h\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh\" (UID: \"f799b733-a369-4bbb-8c62-a39e14abb707\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.857637 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.857633    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f799b733-a369-4bbb-8c62-a39e14abb707-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh\" (UID: \"f799b733-a369-4bbb-8c62-a39e14abb707\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.857903 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.857667    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f799b733-a369-4bbb-8c62-a39e14abb707-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh\" (UID: \"f799b733-a369-4bbb-8c62-a39e14abb707\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.857903 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.857814    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f799b733-a369-4bbb-8c62-a39e14abb707-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh\" (UID: \"f799b733-a369-4bbb-8c62-a39e14abb707\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.857903 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.857858    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f799b733-a369-4bbb-8c62-a39e14abb707-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh\" (UID: \"f799b733-a369-4bbb-8c62-a39e14abb707\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.858078 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.858059    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f799b733-a369-4bbb-8c62-a39e14abb707-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh\" (UID: \"f799b733-a369-4bbb-8c62-a39e14abb707\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.858228 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.858210    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f799b733-a369-4bbb-8c62-a39e14abb707-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh\" (UID: \"f799b733-a369-4bbb-8c62-a39e14abb707\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.858287 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.858235    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f799b733-a369-4bbb-8c62-a39e14abb707-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh\" (UID: \"f799b733-a369-4bbb-8c62-a39e14abb707\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.860013 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.859989    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f799b733-a369-4bbb-8c62-a39e14abb707-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh\" (UID: \"f799b733-a369-4bbb-8c62-a39e14abb707\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.860283 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.860267    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f799b733-a369-4bbb-8c62-a39e14abb707-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh\" (UID: \"f799b733-a369-4bbb-8c62-a39e14abb707\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.866182 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.866159    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw27h\" (UniqueName: \"kubernetes.io/projected/f799b733-a369-4bbb-8c62-a39e14abb707-kube-api-access-jw27h\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh\" (UID: \"f799b733-a369-4bbb-8c62-a39e14abb707\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:55.914559 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:55.914534    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:48:56.047641 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:56.047492    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"]
Jul 22 12:48:56.050027 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:48:56.049997    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf799b733_a369_4bbb_8c62_a39e14abb707.slice/crio-7e18198822b2c2ec13811f37ed76edb298b04ee08d58805d00c40cc337882884 WatchSource:0}: Error finding container 7e18198822b2c2ec13811f37ed76edb298b04ee08d58805d00c40cc337882884: Status 404 returned error can't find the container with id 7e18198822b2c2ec13811f37ed76edb298b04ee08d58805d00c40cc337882884
Jul 22 12:48:56.051633 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:56.051614    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 12:48:56.970172 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:56.970115    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh" event={"ID":"f799b733-a369-4bbb-8c62-a39e14abb707","Type":"ContainerStarted","Data":"7e18198822b2c2ec13811f37ed76edb298b04ee08d58805d00c40cc337882884"}
Jul 22 12:48:57.976751 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:57.976711    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh" event={"ID":"f799b733-a369-4bbb-8c62-a39e14abb707","Type":"ContainerStarted","Data":"5ed9a0900cc4f7c63272146fdaed01150b4548c876a5491aff724cf371b4b007"}
Jul 22 12:48:57.997213 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:48:57.997171    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh" podStartSLOduration=1.860394056 podStartE2EDuration="2.997155055s" totalImagesPullingTime="1.136760999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:48:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:48:57.995827156 +0000 UTC m=+700.636073408" watchObservedRunningTime="2026-07-22 12:48:57.997155055 +0000 UTC m=+700.637401485"
Jul 22 12:49:05.915248 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:05.915213    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:49:05.915809 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:05.915502    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:49:05.927571 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:05.927546    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:49:06.024515 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:06.024485    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh"
Jul 22 12:49:44.215257 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.215180    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"]
Jul 22 12:49:44.219193 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.219176    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.221949 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.221931    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 22 12:49:44.228135 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.228112    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"]
Jul 22 12:49:44.288530 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.288500    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3521d2c-0a00-48f6-96a7-8ae02a8e0518-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc\" (UID: \"b3521d2c-0a00-48f6-96a7-8ae02a8e0518\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.288663 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.288536    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8jpc\" (UniqueName: \"kubernetes.io/projected/b3521d2c-0a00-48f6-96a7-8ae02a8e0518-kube-api-access-t8jpc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc\" (UID: \"b3521d2c-0a00-48f6-96a7-8ae02a8e0518\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.288663 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.288567    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3521d2c-0a00-48f6-96a7-8ae02a8e0518-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc\" (UID: \"b3521d2c-0a00-48f6-96a7-8ae02a8e0518\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.288774 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.288667    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3521d2c-0a00-48f6-96a7-8ae02a8e0518-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc\" (UID: \"b3521d2c-0a00-48f6-96a7-8ae02a8e0518\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.288774 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.288740    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3521d2c-0a00-48f6-96a7-8ae02a8e0518-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc\" (UID: \"b3521d2c-0a00-48f6-96a7-8ae02a8e0518\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.288836 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.288798    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3521d2c-0a00-48f6-96a7-8ae02a8e0518-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc\" (UID: \"b3521d2c-0a00-48f6-96a7-8ae02a8e0518\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.389470 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.389437    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8jpc\" (UniqueName: \"kubernetes.io/projected/b3521d2c-0a00-48f6-96a7-8ae02a8e0518-kube-api-access-t8jpc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc\" (UID: \"b3521d2c-0a00-48f6-96a7-8ae02a8e0518\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.389634 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.389477    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3521d2c-0a00-48f6-96a7-8ae02a8e0518-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc\" (UID: \"b3521d2c-0a00-48f6-96a7-8ae02a8e0518\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.389634 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.389513    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3521d2c-0a00-48f6-96a7-8ae02a8e0518-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc\" (UID: \"b3521d2c-0a00-48f6-96a7-8ae02a8e0518\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.389634 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.389541    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3521d2c-0a00-48f6-96a7-8ae02a8e0518-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc\" (UID: \"b3521d2c-0a00-48f6-96a7-8ae02a8e0518\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.389634 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.389581    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3521d2c-0a00-48f6-96a7-8ae02a8e0518-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc\" (UID: \"b3521d2c-0a00-48f6-96a7-8ae02a8e0518\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.389870 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.389643    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3521d2c-0a00-48f6-96a7-8ae02a8e0518-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc\" (UID: \"b3521d2c-0a00-48f6-96a7-8ae02a8e0518\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.389870 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.389861    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3521d2c-0a00-48f6-96a7-8ae02a8e0518-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc\" (UID: \"b3521d2c-0a00-48f6-96a7-8ae02a8e0518\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.389943 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.389924    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3521d2c-0a00-48f6-96a7-8ae02a8e0518-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc\" (UID: \"b3521d2c-0a00-48f6-96a7-8ae02a8e0518\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.389978 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.389961    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3521d2c-0a00-48f6-96a7-8ae02a8e0518-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc\" (UID: \"b3521d2c-0a00-48f6-96a7-8ae02a8e0518\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.392213 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.392186    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3521d2c-0a00-48f6-96a7-8ae02a8e0518-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc\" (UID: \"b3521d2c-0a00-48f6-96a7-8ae02a8e0518\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.392356 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.392339    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3521d2c-0a00-48f6-96a7-8ae02a8e0518-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc\" (UID: \"b3521d2c-0a00-48f6-96a7-8ae02a8e0518\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.398015 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.397990    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8jpc\" (UniqueName: \"kubernetes.io/projected/b3521d2c-0a00-48f6-96a7-8ae02a8e0518-kube-api-access-t8jpc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc\" (UID: \"b3521d2c-0a00-48f6-96a7-8ae02a8e0518\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.529213 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.529184    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:44.666300 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:44.666275    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"]
Jul 22 12:49:44.668517 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:49:44.668491    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3521d2c_0a00_48f6_96a7_8ae02a8e0518.slice/crio-26fd38cfb065e04916d8e2681d258543e1cc2e960dc87d23eb40a205062800b8 WatchSource:0}: Error finding container 26fd38cfb065e04916d8e2681d258543e1cc2e960dc87d23eb40a205062800b8: Status 404 returned error can't find the container with id 26fd38cfb065e04916d8e2681d258543e1cc2e960dc87d23eb40a205062800b8
Jul 22 12:49:45.199409 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:45.199323    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc" event={"ID":"b3521d2c-0a00-48f6-96a7-8ae02a8e0518","Type":"ContainerStarted","Data":"9906223d28ddbbc45503884ecafa5d0658b2e631deb1252faf2e5ec9168fe76b"}
Jul 22 12:49:45.199409 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:45.199373    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc" event={"ID":"b3521d2c-0a00-48f6-96a7-8ae02a8e0518","Type":"ContainerStarted","Data":"26fd38cfb065e04916d8e2681d258543e1cc2e960dc87d23eb40a205062800b8"}
Jul 22 12:49:45.219366 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:45.219318    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc" podStartSLOduration=0.974259455 podStartE2EDuration="1.21930395s" totalImagesPullingTime="245.044495ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:49:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:49:45.218035609 +0000 UTC m=+747.858281850" watchObservedRunningTime="2026-07-22 12:49:45.21930395 +0000 UTC m=+747.859550189"
Jul 22 12:49:54.530306 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:54.530259    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:54.530864 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:54.530327    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:54.542602 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:54.542580    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:49:55.256875 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:49:55.256848    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc"
Jul 22 12:51:24.934957 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:24.934925    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7646889cfb-c8wmw"]
Jul 22 12:51:24.935518 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:24.935109    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7646889cfb-c8wmw" podUID="31c76ca9-8d72-4ddc-a13e-a065675270d5" containerName="manager" containerID="cri-o://63ea2bd8d660a1cfe1d9b229f25e9248586c44e2b7c9758790c770cf37fa44ff" gracePeriod=30
Jul 22 12:51:25.187778 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:25.187723    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646889cfb-c8wmw"
Jul 22 12:51:25.333613 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:25.333586    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31c76ca9-8d72-4ddc-a13e-a065675270d5-webhook-cert\") pod \"31c76ca9-8d72-4ddc-a13e-a065675270d5\" (UID: \"31c76ca9-8d72-4ddc-a13e-a065675270d5\") "
Jul 22 12:51:25.333783 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:25.333645    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwrcz\" (UniqueName: \"kubernetes.io/projected/31c76ca9-8d72-4ddc-a13e-a065675270d5-kube-api-access-vwrcz\") pod \"31c76ca9-8d72-4ddc-a13e-a065675270d5\" (UID: \"31c76ca9-8d72-4ddc-a13e-a065675270d5\") "
Jul 22 12:51:25.335803 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:25.335772    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31c76ca9-8d72-4ddc-a13e-a065675270d5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "31c76ca9-8d72-4ddc-a13e-a065675270d5" (UID: "31c76ca9-8d72-4ddc-a13e-a065675270d5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:51:25.335914 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:25.335799    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31c76ca9-8d72-4ddc-a13e-a065675270d5-kube-api-access-vwrcz" (OuterVolumeSpecName: "kube-api-access-vwrcz") pod "31c76ca9-8d72-4ddc-a13e-a065675270d5" (UID: "31c76ca9-8d72-4ddc-a13e-a065675270d5"). InnerVolumeSpecName "kube-api-access-vwrcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:51:25.434346 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:25.434317    2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31c76ca9-8d72-4ddc-a13e-a065675270d5-webhook-cert\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:51:25.434346 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:25.434340    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwrcz\" (UniqueName: \"kubernetes.io/projected/31c76ca9-8d72-4ddc-a13e-a065675270d5-kube-api-access-vwrcz\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:51:25.673621 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:25.673583    2556 generic.go:356] "Generic (PLEG): container finished" podID="31c76ca9-8d72-4ddc-a13e-a065675270d5" containerID="63ea2bd8d660a1cfe1d9b229f25e9248586c44e2b7c9758790c770cf37fa44ff" exitCode=0
Jul 22 12:51:25.673797 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:25.673633    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646889cfb-c8wmw"
Jul 22 12:51:25.673797 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:25.673669    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646889cfb-c8wmw" event={"ID":"31c76ca9-8d72-4ddc-a13e-a065675270d5","Type":"ContainerDied","Data":"63ea2bd8d660a1cfe1d9b229f25e9248586c44e2b7c9758790c770cf37fa44ff"}
Jul 22 12:51:25.673797 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:25.673735    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646889cfb-c8wmw" event={"ID":"31c76ca9-8d72-4ddc-a13e-a065675270d5","Type":"ContainerDied","Data":"11b8650ea75bf9f010426356ec134efa2b5a81f3b467af4a7cb3b33a9b9c8b6c"}
Jul 22 12:51:25.673797 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:25.673758    2556 scope.go:117] "RemoveContainer" containerID="63ea2bd8d660a1cfe1d9b229f25e9248586c44e2b7c9758790c770cf37fa44ff"
Jul 22 12:51:25.683161 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:25.683146    2556 scope.go:117] "RemoveContainer" containerID="63ea2bd8d660a1cfe1d9b229f25e9248586c44e2b7c9758790c770cf37fa44ff"
Jul 22 12:51:25.683399 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:51:25.683382    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63ea2bd8d660a1cfe1d9b229f25e9248586c44e2b7c9758790c770cf37fa44ff\": container with ID starting with 63ea2bd8d660a1cfe1d9b229f25e9248586c44e2b7c9758790c770cf37fa44ff not found: ID does not exist" containerID="63ea2bd8d660a1cfe1d9b229f25e9248586c44e2b7c9758790c770cf37fa44ff"
Jul 22 12:51:25.683445 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:25.683408    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63ea2bd8d660a1cfe1d9b229f25e9248586c44e2b7c9758790c770cf37fa44ff"} err="failed to get container status \"63ea2bd8d660a1cfe1d9b229f25e9248586c44e2b7c9758790c770cf37fa44ff\": rpc error: code = NotFound desc = could not find container \"63ea2bd8d660a1cfe1d9b229f25e9248586c44e2b7c9758790c770cf37fa44ff\": container with ID starting with 63ea2bd8d660a1cfe1d9b229f25e9248586c44e2b7c9758790c770cf37fa44ff not found: ID does not exist"
Jul 22 12:51:25.695170 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:25.695149    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7646889cfb-c8wmw"]
Jul 22 12:51:25.700267 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:25.700248    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7646889cfb-c8wmw"]
Jul 22 12:51:25.908386 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:51:25.908354    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31c76ca9-8d72-4ddc-a13e-a065675270d5" path="/var/lib/kubelet/pods/31c76ca9-8d72-4ddc-a13e-a065675270d5/volumes"
Jul 22 12:52:17.824480 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:17.824410    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 12:52:17.825006 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:17.824761    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 12:52:17.828360 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:17.828341    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 12:52:17.828799 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:17.828777    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 12:52:26.527404 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:26.527369    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7646889cfb-8nxht"]
Jul 22 12:52:26.527789 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:26.527746    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31c76ca9-8d72-4ddc-a13e-a065675270d5" containerName="manager"
Jul 22 12:52:26.527789 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:26.527757    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="31c76ca9-8d72-4ddc-a13e-a065675270d5" containerName="manager"
Jul 22 12:52:26.527860 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:26.527828    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="31c76ca9-8d72-4ddc-a13e-a065675270d5" containerName="manager"
Jul 22 12:52:26.531851 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:26.531827    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646889cfb-8nxht"
Jul 22 12:52:26.534616 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:26.534600    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 12:52:26.534759 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:26.534710    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ns5lk\""
Jul 22 12:52:26.534829 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:26.534808    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 12:52:26.546539 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:26.546520    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7646889cfb-8nxht"]
Jul 22 12:52:26.585309 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:26.585284    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/080ef658-7956-4b15-8884-d3fe068c236e-webhook-cert\") pod \"maas-controller-7646889cfb-8nxht\" (UID: \"080ef658-7956-4b15-8884-d3fe068c236e\") " pod="opendatahub/maas-controller-7646889cfb-8nxht"
Jul 22 12:52:26.585449 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:26.585329    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdmft\" (UniqueName: \"kubernetes.io/projected/080ef658-7956-4b15-8884-d3fe068c236e-kube-api-access-gdmft\") pod \"maas-controller-7646889cfb-8nxht\" (UID: \"080ef658-7956-4b15-8884-d3fe068c236e\") " pod="opendatahub/maas-controller-7646889cfb-8nxht"
Jul 22 12:52:26.685824 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:26.685794    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/080ef658-7956-4b15-8884-d3fe068c236e-webhook-cert\") pod \"maas-controller-7646889cfb-8nxht\" (UID: \"080ef658-7956-4b15-8884-d3fe068c236e\") " pod="opendatahub/maas-controller-7646889cfb-8nxht"
Jul 22 12:52:26.685988 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:26.685848    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdmft\" (UniqueName: \"kubernetes.io/projected/080ef658-7956-4b15-8884-d3fe068c236e-kube-api-access-gdmft\") pod \"maas-controller-7646889cfb-8nxht\" (UID: \"080ef658-7956-4b15-8884-d3fe068c236e\") " pod="opendatahub/maas-controller-7646889cfb-8nxht"
Jul 22 12:52:26.688349 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:26.688323    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/080ef658-7956-4b15-8884-d3fe068c236e-webhook-cert\") pod \"maas-controller-7646889cfb-8nxht\" (UID: \"080ef658-7956-4b15-8884-d3fe068c236e\") " pod="opendatahub/maas-controller-7646889cfb-8nxht"
Jul 22 12:52:26.695406 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:26.695378    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdmft\" (UniqueName: \"kubernetes.io/projected/080ef658-7956-4b15-8884-d3fe068c236e-kube-api-access-gdmft\") pod \"maas-controller-7646889cfb-8nxht\" (UID: \"080ef658-7956-4b15-8884-d3fe068c236e\") " pod="opendatahub/maas-controller-7646889cfb-8nxht"
Jul 22 12:52:26.842533 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:26.842436    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646889cfb-8nxht"
Jul 22 12:52:27.182117 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:27.182095    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7646889cfb-8nxht"]
Jul 22 12:52:27.184104 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:52:27.184074    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080ef658_7956_4b15_8884_d3fe068c236e.slice/crio-d560703398f3decfb2a54fa6bef7e7b9f3ca079fae5197ae0e64241f47758567 WatchSource:0}: Error finding container d560703398f3decfb2a54fa6bef7e7b9f3ca079fae5197ae0e64241f47758567: Status 404 returned error can't find the container with id d560703398f3decfb2a54fa6bef7e7b9f3ca079fae5197ae0e64241f47758567
Jul 22 12:52:27.965511 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:27.965417    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646889cfb-8nxht" event={"ID":"080ef658-7956-4b15-8884-d3fe068c236e","Type":"ContainerStarted","Data":"3a550277f60405a01d1dbc03289fae4a325b014ac6197906b0583cf86d7c27b8"}
Jul 22 12:52:27.965511 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:27.965482    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646889cfb-8nxht" event={"ID":"080ef658-7956-4b15-8884-d3fe068c236e","Type":"ContainerStarted","Data":"d560703398f3decfb2a54fa6bef7e7b9f3ca079fae5197ae0e64241f47758567"}
Jul 22 12:52:27.966021 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:27.965514    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7646889cfb-8nxht"
Jul 22 12:52:27.984301 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:27.984256    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7646889cfb-8nxht" podStartSLOduration=1.460722823 podStartE2EDuration="1.984239433s" totalImagesPullingTime="523.51661ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:52:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:52:27.982326764 +0000 UTC m=+910.622573009" watchObservedRunningTime="2026-07-22 12:52:27.984239433 +0000 UTC m=+910.624485742"
Jul 22 12:52:38.972619 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:38.972589    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7646889cfb-8nxht"
Jul 22 12:52:43.622584 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:43.622549    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7646889cfb-8nxht"]
Jul 22 12:52:43.623025 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:43.622765    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7646889cfb-8nxht" podUID="080ef658-7956-4b15-8884-d3fe068c236e" containerName="manager" containerID="cri-o://3a550277f60405a01d1dbc03289fae4a325b014ac6197906b0583cf86d7c27b8" gracePeriod=30
Jul 22 12:52:43.876776 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:43.876721    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646889cfb-8nxht"
Jul 22 12:52:43.942346 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:43.942317    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdmft\" (UniqueName: \"kubernetes.io/projected/080ef658-7956-4b15-8884-d3fe068c236e-kube-api-access-gdmft\") pod \"080ef658-7956-4b15-8884-d3fe068c236e\" (UID: \"080ef658-7956-4b15-8884-d3fe068c236e\") "
Jul 22 12:52:43.942506 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:43.942394    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/080ef658-7956-4b15-8884-d3fe068c236e-webhook-cert\") pod \"080ef658-7956-4b15-8884-d3fe068c236e\" (UID: \"080ef658-7956-4b15-8884-d3fe068c236e\") "
Jul 22 12:52:43.944518 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:43.944486    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/080ef658-7956-4b15-8884-d3fe068c236e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "080ef658-7956-4b15-8884-d3fe068c236e" (UID: "080ef658-7956-4b15-8884-d3fe068c236e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:52:43.944518 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:43.944498    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/080ef658-7956-4b15-8884-d3fe068c236e-kube-api-access-gdmft" (OuterVolumeSpecName: "kube-api-access-gdmft") pod "080ef658-7956-4b15-8884-d3fe068c236e" (UID: "080ef658-7956-4b15-8884-d3fe068c236e"). InnerVolumeSpecName "kube-api-access-gdmft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:52:44.041576 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.041541    2556 generic.go:356] "Generic (PLEG): container finished" podID="080ef658-7956-4b15-8884-d3fe068c236e" containerID="3a550277f60405a01d1dbc03289fae4a325b014ac6197906b0583cf86d7c27b8" exitCode=0
Jul 22 12:52:44.041753 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.041585    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646889cfb-8nxht"
Jul 22 12:52:44.041753 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.041599    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646889cfb-8nxht" event={"ID":"080ef658-7956-4b15-8884-d3fe068c236e","Type":"ContainerDied","Data":"3a550277f60405a01d1dbc03289fae4a325b014ac6197906b0583cf86d7c27b8"}
Jul 22 12:52:44.041753 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.041655    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646889cfb-8nxht" event={"ID":"080ef658-7956-4b15-8884-d3fe068c236e","Type":"ContainerDied","Data":"d560703398f3decfb2a54fa6bef7e7b9f3ca079fae5197ae0e64241f47758567"}
Jul 22 12:52:44.041753 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.041718    2556 scope.go:117] "RemoveContainer" containerID="3a550277f60405a01d1dbc03289fae4a325b014ac6197906b0583cf86d7c27b8"
Jul 22 12:52:44.043066 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.043041    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdmft\" (UniqueName: \"kubernetes.io/projected/080ef658-7956-4b15-8884-d3fe068c236e-kube-api-access-gdmft\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:52:44.043066 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.043061    2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/080ef658-7956-4b15-8884-d3fe068c236e-webhook-cert\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:52:44.051246 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.051229    2556 scope.go:117] "RemoveContainer" containerID="3a550277f60405a01d1dbc03289fae4a325b014ac6197906b0583cf86d7c27b8"
Jul 22 12:52:44.051506 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:52:44.051486    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a550277f60405a01d1dbc03289fae4a325b014ac6197906b0583cf86d7c27b8\": container with ID starting with 3a550277f60405a01d1dbc03289fae4a325b014ac6197906b0583cf86d7c27b8 not found: ID does not exist" containerID="3a550277f60405a01d1dbc03289fae4a325b014ac6197906b0583cf86d7c27b8"
Jul 22 12:52:44.051568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.051516    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a550277f60405a01d1dbc03289fae4a325b014ac6197906b0583cf86d7c27b8"} err="failed to get container status \"3a550277f60405a01d1dbc03289fae4a325b014ac6197906b0583cf86d7c27b8\": rpc error: code = NotFound desc = could not find container \"3a550277f60405a01d1dbc03289fae4a325b014ac6197906b0583cf86d7c27b8\": container with ID starting with 3a550277f60405a01d1dbc03289fae4a325b014ac6197906b0583cf86d7c27b8 not found: ID does not exist"
Jul 22 12:52:44.063541 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.063520    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7646889cfb-8nxht"]
Jul 22 12:52:44.067435 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.067412    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7646889cfb-8nxht"]
Jul 22 12:52:44.853429 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.853400    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7646889cfb-2h96g"]
Jul 22 12:52:44.853892 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.853761    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="080ef658-7956-4b15-8884-d3fe068c236e" containerName="manager"
Jul 22 12:52:44.853892 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.853773    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="080ef658-7956-4b15-8884-d3fe068c236e" containerName="manager"
Jul 22 12:52:44.853892 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.853846    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="080ef658-7956-4b15-8884-d3fe068c236e" containerName="manager"
Jul 22 12:52:44.858079 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.858060    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646889cfb-2h96g"
Jul 22 12:52:44.862225 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.862187    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 12:52:44.862225 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.862205    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 12:52:44.862409 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.862205    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ns5lk\""
Jul 22 12:52:44.868022 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.868004    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7646889cfb-2h96g"]
Jul 22 12:52:44.950131 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.950104    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjx9z\" (UniqueName: \"kubernetes.io/projected/e693d09e-2348-42b0-b866-f988dc1b4eea-kube-api-access-cjx9z\") pod \"maas-controller-7646889cfb-2h96g\" (UID: \"e693d09e-2348-42b0-b866-f988dc1b4eea\") " pod="opendatahub/maas-controller-7646889cfb-2h96g"
Jul 22 12:52:44.950311 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:44.950148    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e693d09e-2348-42b0-b866-f988dc1b4eea-webhook-cert\") pod \"maas-controller-7646889cfb-2h96g\" (UID: \"e693d09e-2348-42b0-b866-f988dc1b4eea\") " pod="opendatahub/maas-controller-7646889cfb-2h96g"
Jul 22 12:52:45.050872 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:45.050848    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjx9z\" (UniqueName: \"kubernetes.io/projected/e693d09e-2348-42b0-b866-f988dc1b4eea-kube-api-access-cjx9z\") pod \"maas-controller-7646889cfb-2h96g\" (UID: \"e693d09e-2348-42b0-b866-f988dc1b4eea\") " pod="opendatahub/maas-controller-7646889cfb-2h96g"
Jul 22 12:52:45.051022 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:45.050892    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e693d09e-2348-42b0-b866-f988dc1b4eea-webhook-cert\") pod \"maas-controller-7646889cfb-2h96g\" (UID: \"e693d09e-2348-42b0-b866-f988dc1b4eea\") " pod="opendatahub/maas-controller-7646889cfb-2h96g"
Jul 22 12:52:45.053435 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:45.053413    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e693d09e-2348-42b0-b866-f988dc1b4eea-webhook-cert\") pod \"maas-controller-7646889cfb-2h96g\" (UID: \"e693d09e-2348-42b0-b866-f988dc1b4eea\") " pod="opendatahub/maas-controller-7646889cfb-2h96g"
Jul 22 12:52:45.059606 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:45.059584    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjx9z\" (UniqueName: \"kubernetes.io/projected/e693d09e-2348-42b0-b866-f988dc1b4eea-kube-api-access-cjx9z\") pod \"maas-controller-7646889cfb-2h96g\" (UID: \"e693d09e-2348-42b0-b866-f988dc1b4eea\") " pod="opendatahub/maas-controller-7646889cfb-2h96g"
Jul 22 12:52:45.170739 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:45.170653    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7646889cfb-2h96g"
Jul 22 12:52:45.308669 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:45.308642    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7646889cfb-2h96g"]
Jul 22 12:52:45.311251 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:52:45.311226    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode693d09e_2348_42b0_b866_f988dc1b4eea.slice/crio-75746d8a73295c83c790e3783c3b8b8de03303f06b5f8b1d1cca598c97d63347 WatchSource:0}: Error finding container 75746d8a73295c83c790e3783c3b8b8de03303f06b5f8b1d1cca598c97d63347: Status 404 returned error can't find the container with id 75746d8a73295c83c790e3783c3b8b8de03303f06b5f8b1d1cca598c97d63347
Jul 22 12:52:45.903297 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:45.903269    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="080ef658-7956-4b15-8884-d3fe068c236e" path="/var/lib/kubelet/pods/080ef658-7956-4b15-8884-d3fe068c236e/volumes"
Jul 22 12:52:46.054521 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:46.054442    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646889cfb-2h96g" event={"ID":"e693d09e-2348-42b0-b866-f988dc1b4eea","Type":"ContainerStarted","Data":"7ca2aaf0f0c68840e9f2b88346be40f04a9d86a2d15a940707b855a55b7c438d"}
Jul 22 12:52:46.054521 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:46.054494    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7646889cfb-2h96g" event={"ID":"e693d09e-2348-42b0-b866-f988dc1b4eea","Type":"ContainerStarted","Data":"75746d8a73295c83c790e3783c3b8b8de03303f06b5f8b1d1cca598c97d63347"}
Jul 22 12:52:46.054721 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:46.054591    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7646889cfb-2h96g"
Jul 22 12:52:46.088221 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:46.088172    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7646889cfb-2h96g" podStartSLOduration=1.618449941 podStartE2EDuration="2.088155358s" totalImagesPullingTime="469.705417ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:52:46.08754503 +0000 UTC m=+928.727791290" watchObservedRunningTime="2026-07-22 12:52:46.088155358 +0000 UTC m=+928.728401599"
Jul 22 12:52:57.062576 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:52:57.062538    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7646889cfb-2h96g"
Jul 22 12:57:17.855068 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:17.855039    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 12:57:17.857442 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:17.857412    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 12:57:17.858540 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:17.858515    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 12:57:17.860956 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:17.860935    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 12:57:29.397753 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:29.397723    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq"]
Jul 22 12:57:29.398239 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:29.397967    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq" podUID="f6b2eb22-e04e-4983-8cb9-8ecff2000319" containerName="manager" containerID="cri-o://c802d11964b0e32df9ed516bfe682a22559803426ed19b54061e50a09a1d696e" gracePeriod=10
Jul 22 12:57:32.956151 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:32.956125    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq"
Jul 22 12:57:33.020328 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:33.020252    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6b2eb22-e04e-4983-8cb9-8ecff2000319-extensions-socket-volume\") pod \"f6b2eb22-e04e-4983-8cb9-8ecff2000319\" (UID: \"f6b2eb22-e04e-4983-8cb9-8ecff2000319\") "
Jul 22 12:57:33.020328 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:33.020293    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67srl\" (UniqueName: \"kubernetes.io/projected/f6b2eb22-e04e-4983-8cb9-8ecff2000319-kube-api-access-67srl\") pod \"f6b2eb22-e04e-4983-8cb9-8ecff2000319\" (UID: \"f6b2eb22-e04e-4983-8cb9-8ecff2000319\") "
Jul 22 12:57:33.020709 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:33.020666    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6b2eb22-e04e-4983-8cb9-8ecff2000319-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f6b2eb22-e04e-4983-8cb9-8ecff2000319" (UID: "f6b2eb22-e04e-4983-8cb9-8ecff2000319"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:57:33.022760 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:33.022737    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6b2eb22-e04e-4983-8cb9-8ecff2000319-kube-api-access-67srl" (OuterVolumeSpecName: "kube-api-access-67srl") pod "f6b2eb22-e04e-4983-8cb9-8ecff2000319" (UID: "f6b2eb22-e04e-4983-8cb9-8ecff2000319"). InnerVolumeSpecName "kube-api-access-67srl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:57:33.121532 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:33.121499    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6b2eb22-e04e-4983-8cb9-8ecff2000319-extensions-socket-volume\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:57:33.121532 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:33.121526    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67srl\" (UniqueName: \"kubernetes.io/projected/f6b2eb22-e04e-4983-8cb9-8ecff2000319-kube-api-access-67srl\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 12:57:33.421098 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:33.421062    2556 generic.go:356] "Generic (PLEG): container finished" podID="f6b2eb22-e04e-4983-8cb9-8ecff2000319" containerID="c802d11964b0e32df9ed516bfe682a22559803426ed19b54061e50a09a1d696e" exitCode=0
Jul 22 12:57:33.421297 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:33.421120    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq"
Jul 22 12:57:33.421297 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:33.421145    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq" event={"ID":"f6b2eb22-e04e-4983-8cb9-8ecff2000319","Type":"ContainerDied","Data":"c802d11964b0e32df9ed516bfe682a22559803426ed19b54061e50a09a1d696e"}
Jul 22 12:57:33.421297 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:33.421203    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq" event={"ID":"f6b2eb22-e04e-4983-8cb9-8ecff2000319","Type":"ContainerDied","Data":"c58bcc80b7e987521fda70fe042ceb29bb7fae886db2742324a012cd37453a3e"}
Jul 22 12:57:33.421297 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:33.421228    2556 scope.go:117] "RemoveContainer" containerID="c802d11964b0e32df9ed516bfe682a22559803426ed19b54061e50a09a1d696e"
Jul 22 12:57:33.431356 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:33.431337    2556 scope.go:117] "RemoveContainer" containerID="c802d11964b0e32df9ed516bfe682a22559803426ed19b54061e50a09a1d696e"
Jul 22 12:57:33.431604 ip-10-0-130-160 kubenswrapper[2556]: E0722 12:57:33.431588    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c802d11964b0e32df9ed516bfe682a22559803426ed19b54061e50a09a1d696e\": container with ID starting with c802d11964b0e32df9ed516bfe682a22559803426ed19b54061e50a09a1d696e not found: ID does not exist" containerID="c802d11964b0e32df9ed516bfe682a22559803426ed19b54061e50a09a1d696e"
Jul 22 12:57:33.431647 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:33.431613    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c802d11964b0e32df9ed516bfe682a22559803426ed19b54061e50a09a1d696e"} err="failed to get container status \"c802d11964b0e32df9ed516bfe682a22559803426ed19b54061e50a09a1d696e\": rpc error: code = NotFound desc = could not find container \"c802d11964b0e32df9ed516bfe682a22559803426ed19b54061e50a09a1d696e\": container with ID starting with c802d11964b0e32df9ed516bfe682a22559803426ed19b54061e50a09a1d696e not found: ID does not exist"
Jul 22 12:57:33.444000 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:33.443974    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq"]
Jul 22 12:57:33.452095 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:33.452077    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ltrlq"]
Jul 22 12:57:33.901608 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:57:33.901574    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6b2eb22-e04e-4983-8cb9-8ecff2000319" path="/var/lib/kubelet/pods/f6b2eb22-e04e-4983-8cb9-8ecff2000319/volumes"
Jul 22 12:58:30.576238 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:30.576199    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmhrv"]
Jul 22 12:58:30.576703 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:30.576594    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6b2eb22-e04e-4983-8cb9-8ecff2000319" containerName="manager"
Jul 22 12:58:30.576703 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:30.576607    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6b2eb22-e04e-4983-8cb9-8ecff2000319" containerName="manager"
Jul 22 12:58:30.576703 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:30.576666    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6b2eb22-e04e-4983-8cb9-8ecff2000319" containerName="manager"
Jul 22 12:58:30.579932 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:30.579916    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmhrv"
Jul 22 12:58:30.582810 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:30.582787    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gfdhd\""
Jul 22 12:58:30.582928 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:30.582818    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 12:58:30.582928 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:30.582824    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 12:58:30.592381 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:30.592357    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmhrv"]
Jul 22 12:58:30.627743 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:30.627713    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlpbd\" (UniqueName: \"kubernetes.io/projected/367b4b39-9dbc-479c-9992-8b1bef034b71-kube-api-access-zlpbd\") pod \"kuadrant-operator-controller-manager-86878c769f-rmhrv\" (UID: \"367b4b39-9dbc-479c-9992-8b1bef034b71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmhrv"
Jul 22 12:58:30.627890 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:30.627767    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/367b4b39-9dbc-479c-9992-8b1bef034b71-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rmhrv\" (UID: \"367b4b39-9dbc-479c-9992-8b1bef034b71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmhrv"
Jul 22 12:58:30.728784 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:30.728741    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlpbd\" (UniqueName: \"kubernetes.io/projected/367b4b39-9dbc-479c-9992-8b1bef034b71-kube-api-access-zlpbd\") pod \"kuadrant-operator-controller-manager-86878c769f-rmhrv\" (UID: \"367b4b39-9dbc-479c-9992-8b1bef034b71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmhrv"
Jul 22 12:58:30.728978 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:30.728805    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/367b4b39-9dbc-479c-9992-8b1bef034b71-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rmhrv\" (UID: \"367b4b39-9dbc-479c-9992-8b1bef034b71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmhrv"
Jul 22 12:58:30.729216 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:30.729196    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/367b4b39-9dbc-479c-9992-8b1bef034b71-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rmhrv\" (UID: \"367b4b39-9dbc-479c-9992-8b1bef034b71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmhrv"
Jul 22 12:58:30.738617 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:30.738588    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlpbd\" (UniqueName: \"kubernetes.io/projected/367b4b39-9dbc-479c-9992-8b1bef034b71-kube-api-access-zlpbd\") pod \"kuadrant-operator-controller-manager-86878c769f-rmhrv\" (UID: \"367b4b39-9dbc-479c-9992-8b1bef034b71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmhrv"
Jul 22 12:58:30.890880 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:30.890804    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmhrv"
Jul 22 12:58:31.036479 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:31.036451    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmhrv"]
Jul 22 12:58:31.039384 ip-10-0-130-160 kubenswrapper[2556]: W0722 12:58:31.039356    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod367b4b39_9dbc_479c_9992_8b1bef034b71.slice/crio-f808ab38f2736147e1dd967f703f2c41742c163dd14e1e4b0ef073a6779ab913 WatchSource:0}: Error finding container f808ab38f2736147e1dd967f703f2c41742c163dd14e1e4b0ef073a6779ab913: Status 404 returned error can't find the container with id f808ab38f2736147e1dd967f703f2c41742c163dd14e1e4b0ef073a6779ab913
Jul 22 12:58:31.690724 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:31.690664    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmhrv" event={"ID":"367b4b39-9dbc-479c-9992-8b1bef034b71","Type":"ContainerStarted","Data":"21e8b70d787c969ba18461f48fa69efa2aaf86313ccdc75bc790badca2638658"}
Jul 22 12:58:31.690724 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:31.690732    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmhrv" event={"ID":"367b4b39-9dbc-479c-9992-8b1bef034b71","Type":"ContainerStarted","Data":"f808ab38f2736147e1dd967f703f2c41742c163dd14e1e4b0ef073a6779ab913"}
Jul 22 12:58:31.691231 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:31.690754    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmhrv"
Jul 22 12:58:31.717568 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:31.716986    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmhrv" podStartSLOduration=1.716965397 podStartE2EDuration="1.716965397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:58:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:58:31.715366267 +0000 UTC m=+1274.355612508" watchObservedRunningTime="2026-07-22 12:58:31.716965397 +0000 UTC m=+1274.357211639"
Jul 22 12:58:42.697286 ip-10-0-130-160 kubenswrapper[2556]: I0722 12:58:42.697258    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rmhrv"
Jul 22 13:00:00.151390 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:00:00.151360    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745420-8tlf9"]
Jul 22 13:00:00.154667 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:00:00.154647    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745420-8tlf9"
Jul 22 13:00:00.157459 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:00:00.157439    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qrrb5\""
Jul 22 13:00:00.161745 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:00:00.161718    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745420-8tlf9"]
Jul 22 13:00:00.167176 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:00:00.167157    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745420-8tlf9"
Jul 22 13:00:00.514204 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:00:00.514182    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745420-8tlf9"]
Jul 22 13:00:00.516483 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:00:00.516456    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25501c0c_5dd5_461a_9f42_5df7a12c1d55.slice/crio-6a727304ca80bbaa2fff3835b53cc744a2cf901bdce18bebcf8dc0447f767ad8 WatchSource:0}: Error finding container 6a727304ca80bbaa2fff3835b53cc744a2cf901bdce18bebcf8dc0447f767ad8: Status 404 returned error can't find the container with id 6a727304ca80bbaa2fff3835b53cc744a2cf901bdce18bebcf8dc0447f767ad8
Jul 22 13:00:00.518398 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:00:00.518380    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 13:00:01.112313 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:00:01.112277    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745420-8tlf9" event={"ID":"25501c0c-5dd5-461a-9f42-5df7a12c1d55","Type":"ContainerStarted","Data":"6a727304ca80bbaa2fff3835b53cc744a2cf901bdce18bebcf8dc0447f767ad8"}
Jul 22 13:00:03.122975 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:00:03.122938    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745420-8tlf9" event={"ID":"25501c0c-5dd5-461a-9f42-5df7a12c1d55","Type":"ContainerStarted","Data":"231b8a2bf00824bc8645a60b2b4d918072c55446c7f98927f6fb38acc1415b51"}
Jul 22 13:00:03.141631 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:00:03.141573    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745420-8tlf9" podStartSLOduration=1.000591609 podStartE2EDuration="3.14155201s" totalImagesPullingTime="2.140960401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:00:03.138806846 +0000 UTC m=+1365.779053106" watchObservedRunningTime="2026-07-22 13:00:03.14155201 +0000 UTC m=+1365.781798252"
Jul 22 13:00:04.128939 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:00:04.128907    2556 generic.go:356] "Generic (PLEG): container finished" podID="25501c0c-5dd5-461a-9f42-5df7a12c1d55" containerID="231b8a2bf00824bc8645a60b2b4d918072c55446c7f98927f6fb38acc1415b51" exitCode=0
Jul 22 13:00:04.129317 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:00:04.128994    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745420-8tlf9" event={"ID":"25501c0c-5dd5-461a-9f42-5df7a12c1d55","Type":"ContainerDied","Data":"231b8a2bf00824bc8645a60b2b4d918072c55446c7f98927f6fb38acc1415b51"}
Jul 22 13:00:05.275090 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:00:05.275055    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745420-8tlf9"
Jul 22 13:00:06.140088 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:00:06.140048    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745420-8tlf9" event={"ID":"25501c0c-5dd5-461a-9f42-5df7a12c1d55","Type":"ContainerDied","Data":"6a727304ca80bbaa2fff3835b53cc744a2cf901bdce18bebcf8dc0447f767ad8"}
Jul 22 13:00:06.140268 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:00:06.140118    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a727304ca80bbaa2fff3835b53cc744a2cf901bdce18bebcf8dc0447f767ad8"
Jul 22 13:00:06.140268 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:00:06.140069    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745420-8tlf9"
Jul 22 13:02:17.885424 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:02:17.885390    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 13:02:17.888710 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:02:17.888689    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 13:02:17.888947 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:02:17.888934    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 13:02:17.891996 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:02:17.891977    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 13:06:23.412375 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:23.412333    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7638e0e4-v54l4"]
Jul 22 13:06:23.412939 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:23.412899    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25501c0c-5dd5-461a-9f42-5df7a12c1d55" containerName="cleanup"
Jul 22 13:06:23.412939 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:23.412919    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="25501c0c-5dd5-461a-9f42-5df7a12c1d55" containerName="cleanup"
Jul 22 13:06:23.413061 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:23.413022    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="25501c0c-5dd5-461a-9f42-5df7a12c1d55" containerName="cleanup"
Jul 22 13:06:23.415957 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:23.415937    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7638e0e4-v54l4"
Jul 22 13:06:23.418864 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:23.418844    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 13:06:23.418978 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:23.418924    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qrrb5\""
Jul 22 13:06:23.424270 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:23.423533    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7638e0e4-v54l4"]
Jul 22 13:06:23.447854 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:23.447819    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec466a52-0e89-4aab-9940-680614c59050-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7638e0e4-v54l4\" (UID: \"ec466a52-0e89-4aab-9940-680614c59050\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7638e0e4-v54l4"
Jul 22 13:06:23.549092 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:23.549058    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec466a52-0e89-4aab-9940-680614c59050-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7638e0e4-v54l4\" (UID: \"ec466a52-0e89-4aab-9940-680614c59050\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7638e0e4-v54l4"
Jul 22 13:06:23.549740 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:23.549722    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec466a52-0e89-4aab-9940-680614c59050-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7638e0e4-v54l4\" (UID: \"ec466a52-0e89-4aab-9940-680614c59050\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7638e0e4-v54l4"
Jul 22 13:06:23.729029 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:23.728934    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7638e0e4-v54l4"
Jul 22 13:06:23.866371 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:23.866347    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7638e0e4-v54l4"]
Jul 22 13:06:23.868569 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:06:23.868535    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec466a52_0e89_4aab_9940_680614c59050.slice/crio-89e2a559c70b064a7c6d2d9ad7bb13e23dcf0246150d3647bfcfad343318606d WatchSource:0}: Error finding container 89e2a559c70b064a7c6d2d9ad7bb13e23dcf0246150d3647bfcfad343318606d: Status 404 returned error can't find the container with id 89e2a559c70b064a7c6d2d9ad7bb13e23dcf0246150d3647bfcfad343318606d
Jul 22 13:06:23.977470 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:23.977421    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7638e0e4-v54l4" event={"ID":"ec466a52-0e89-4aab-9940-680614c59050","Type":"ContainerStarted","Data":"89e2a559c70b064a7c6d2d9ad7bb13e23dcf0246150d3647bfcfad343318606d"}
Jul 22 13:06:24.983921 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:24.983823    2556 generic.go:356] "Generic (PLEG): container finished" podID="ec466a52-0e89-4aab-9940-680614c59050" containerID="88f3b3ade93e8db450016a9a8544b34831337b116dde7227b01f3ba0623d0fe5" exitCode=0
Jul 22 13:06:24.983921 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:24.983905    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7638e0e4-v54l4" event={"ID":"ec466a52-0e89-4aab-9940-680614c59050","Type":"ContainerDied","Data":"88f3b3ade93e8db450016a9a8544b34831337b116dde7227b01f3ba0623d0fe5"}
Jul 22 13:06:26.122199 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:26.122172    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7638e0e4-v54l4"
Jul 22 13:06:26.171514 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:26.171484    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec466a52-0e89-4aab-9940-680614c59050-maas-api-service-ca\") pod \"ec466a52-0e89-4aab-9940-680614c59050\" (UID: \"ec466a52-0e89-4aab-9940-680614c59050\") "
Jul 22 13:06:26.171923 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:26.171897    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec466a52-0e89-4aab-9940-680614c59050-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ec466a52-0e89-4aab-9940-680614c59050" (UID: "ec466a52-0e89-4aab-9940-680614c59050"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:06:26.273044 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:26.273008    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec466a52-0e89-4aab-9940-680614c59050-maas-api-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:06:26.994525 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:26.994497    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7638e0e4-v54l4"
Jul 22 13:06:26.994713 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:26.994542    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7638e0e4-v54l4" event={"ID":"ec466a52-0e89-4aab-9940-680614c59050","Type":"ContainerDied","Data":"89e2a559c70b064a7c6d2d9ad7bb13e23dcf0246150d3647bfcfad343318606d"}
Jul 22 13:06:26.994713 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:26.994590    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89e2a559c70b064a7c6d2d9ad7bb13e23dcf0246150d3647bfcfad343318606d"
Jul 22 13:06:38.489715 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:38.489664    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7638e0e4-v54l4"]
Jul 22 13:06:38.491752 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:38.491724    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7638e0e4-v54l4"]
Jul 22 13:06:39.901817 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:39.901778    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec466a52-0e89-4aab-9940-680614c59050" path="/var/lib/kubelet/pods/ec466a52-0e89-4aab-9940-680614c59050/volumes"
Jul 22 13:06:42.394109 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.394074    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"]
Jul 22 13:06:42.394642 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.394627    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec466a52-0e89-4aab-9940-680614c59050" containerName="revoke-keys"
Jul 22 13:06:42.394715 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.394646    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec466a52-0e89-4aab-9940-680614c59050" containerName="revoke-keys"
Jul 22 13:06:42.394790 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.394778    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec466a52-0e89-4aab-9940-680614c59050" containerName="revoke-keys"
Jul 22 13:06:42.399126 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.399101    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"
Jul 22 13:06:42.402213 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.402186    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 13:06:42.402350 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.402230    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8dbk8\""
Jul 22 13:06:42.402420 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.402371    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-3147e54f-serving-cert\""
Jul 22 13:06:42.403333 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.403316    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 13:06:42.407892 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.407873    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"]
Jul 22 13:06:42.527504 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.527469    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sfjv\" (UniqueName: \"kubernetes.io/projected/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f-kube-api-access-9sfjv\") pod \"maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6\" (UID: \"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"
Jul 22 13:06:42.527699 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.527525    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f-maas-api-tls\") pod \"maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6\" (UID: \"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"
Jul 22 13:06:42.527699 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.527563    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f-openshift-service-ca\") pod \"maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6\" (UID: \"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"
Jul 22 13:06:42.628064 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.628030    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sfjv\" (UniqueName: \"kubernetes.io/projected/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f-kube-api-access-9sfjv\") pod \"maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6\" (UID: \"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"
Jul 22 13:06:42.628237 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.628077    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f-maas-api-tls\") pod \"maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6\" (UID: \"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"
Jul 22 13:06:42.628237 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.628105    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f-openshift-service-ca\") pod \"maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6\" (UID: \"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"
Jul 22 13:06:42.628729 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.628711    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f-openshift-service-ca\") pod \"maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6\" (UID: \"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"
Jul 22 13:06:42.630586 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.630562    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f-maas-api-tls\") pod \"maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6\" (UID: \"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"
Jul 22 13:06:42.639435 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.639402    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sfjv\" (UniqueName: \"kubernetes.io/projected/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f-kube-api-access-9sfjv\") pod \"maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6\" (UID: \"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"
Jul 22 13:06:42.713590 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.713519    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"
Jul 22 13:06:42.855277 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.855248    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"]
Jul 22 13:06:42.857379 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:06:42.857353    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3591f8b_d5c7_400f_ae0d_ef2710a73c9f.slice/crio-4ce7f03f45f533b4e6f6e47cb55d867205c1065a9292ca438d99b753cb8f7649 WatchSource:0}: Error finding container 4ce7f03f45f533b4e6f6e47cb55d867205c1065a9292ca438d99b753cb8f7649: Status 404 returned error can't find the container with id 4ce7f03f45f533b4e6f6e47cb55d867205c1065a9292ca438d99b753cb8f7649
Jul 22 13:06:42.858897 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:42.858880    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 13:06:43.072214 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:43.072184    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6" event={"ID":"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f","Type":"ContainerStarted","Data":"4ce7f03f45f533b4e6f6e47cb55d867205c1065a9292ca438d99b753cb8f7649"}
Jul 22 13:06:45.084572 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:45.084532    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6" event={"ID":"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f","Type":"ContainerStarted","Data":"f0a3a0b628cd000b2259dac9eefa9067cdba75bae6a15cb52b2e6c394970b4ef"}
Jul 22 13:06:45.084995 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:45.084595    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"
Jul 22 13:06:45.103387 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:45.103342    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6" podStartSLOduration=1.703799772 podStartE2EDuration="3.103329844s" totalImagesPullingTime="1.399530072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:06:45.102121366 +0000 UTC m=+1767.742367606" watchObservedRunningTime="2026-07-22 13:06:45.103329844 +0000 UTC m=+1767.743576084"
Jul 22 13:06:51.096064 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:06:51.096038    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"
Jul 22 13:07:07.183047 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:07.183010    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26"]
Jul 22 13:07:07.186375 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:07.186356    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26"
Jul 22 13:07:07.189167 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:07.189145    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qrrb5\""
Jul 22 13:07:07.195521 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:07.195496    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26"]
Jul 22 13:07:07.242728 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:07.242672    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df0e4cc0-7499-41ed-87fd-f4a6fd359d44-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26\" (UID: \"df0e4cc0-7499-41ed-87fd-f4a6fd359d44\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26"
Jul 22 13:07:07.343694 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:07.343635    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df0e4cc0-7499-41ed-87fd-f4a6fd359d44-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26\" (UID: \"df0e4cc0-7499-41ed-87fd-f4a6fd359d44\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26"
Jul 22 13:07:07.344286 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:07.344265    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df0e4cc0-7499-41ed-87fd-f4a6fd359d44-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26\" (UID: \"df0e4cc0-7499-41ed-87fd-f4a6fd359d44\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26"
Jul 22 13:07:07.497908 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:07.497816    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26"
Jul 22 13:07:07.633571 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:07.633537    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26"]
Jul 22 13:07:07.636376 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:07:07.636336    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf0e4cc0_7499_41ed_87fd_f4a6fd359d44.slice/crio-6879b19a2025305f850f95b64f3a9a65eed6f5f5ae9fe9f4a43c03870bac5163 WatchSource:0}: Error finding container 6879b19a2025305f850f95b64f3a9a65eed6f5f5ae9fe9f4a43c03870bac5163: Status 404 returned error can't find the container with id 6879b19a2025305f850f95b64f3a9a65eed6f5f5ae9fe9f4a43c03870bac5163
Jul 22 13:07:08.205727 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:08.205604    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26" event={"ID":"df0e4cc0-7499-41ed-87fd-f4a6fd359d44","Type":"ContainerStarted","Data":"e91941cc6dd9c755f496bbce4f8af676756048b83c8e8dd75270acbf76781c30"}
Jul 22 13:07:08.205727 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:08.205662    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26" event={"ID":"df0e4cc0-7499-41ed-87fd-f4a6fd359d44","Type":"ContainerStarted","Data":"6879b19a2025305f850f95b64f3a9a65eed6f5f5ae9fe9f4a43c03870bac5163"}
Jul 22 13:07:08.223092 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:08.223046    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26" podStartSLOduration=1.223032435 podStartE2EDuration="1.223032435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:07:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:07:08.222120912 +0000 UTC m=+1790.862367174" watchObservedRunningTime="2026-07-22 13:07:08.223032435 +0000 UTC m=+1790.863278677"
Jul 22 13:07:09.212036 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:09.211993    2556 generic.go:356] "Generic (PLEG): container finished" podID="df0e4cc0-7499-41ed-87fd-f4a6fd359d44" containerID="e91941cc6dd9c755f496bbce4f8af676756048b83c8e8dd75270acbf76781c30" exitCode=0
Jul 22 13:07:09.212496 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:09.212051    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26" event={"ID":"df0e4cc0-7499-41ed-87fd-f4a6fd359d44","Type":"ContainerDied","Data":"e91941cc6dd9c755f496bbce4f8af676756048b83c8e8dd75270acbf76781c30"}
Jul 22 13:07:10.348353 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:10.348329    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26"
Jul 22 13:07:10.374667 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:10.374639    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df0e4cc0-7499-41ed-87fd-f4a6fd359d44-maas-api-service-ca\") pod \"df0e4cc0-7499-41ed-87fd-f4a6fd359d44\" (UID: \"df0e4cc0-7499-41ed-87fd-f4a6fd359d44\") "
Jul 22 13:07:10.374949 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:10.374928    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df0e4cc0-7499-41ed-87fd-f4a6fd359d44-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "df0e4cc0-7499-41ed-87fd-f4a6fd359d44" (UID: "df0e4cc0-7499-41ed-87fd-f4a6fd359d44"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:07:10.476280 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:10.476203    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df0e4cc0-7499-41ed-87fd-f4a6fd359d44-maas-api-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:07:11.222816 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:11.222783    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26" event={"ID":"df0e4cc0-7499-41ed-87fd-f4a6fd359d44","Type":"ContainerDied","Data":"6879b19a2025305f850f95b64f3a9a65eed6f5f5ae9fe9f4a43c03870bac5163"}
Jul 22 13:07:11.222816 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:11.222812    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26"
Jul 22 13:07:11.223021 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:11.222835    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6879b19a2025305f850f95b64f3a9a65eed6f5f5ae9fe9f4a43c03870bac5163"
Jul 22 13:07:17.736111 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:17.736063    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"]
Jul 22 13:07:17.736523 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:17.736315    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6" podUID="e3591f8b-d5c7-400f-ae0d-ef2710a73c9f" containerName="maas-api" containerID="cri-o://f0a3a0b628cd000b2259dac9eefa9067cdba75bae6a15cb52b2e6c394970b4ef" gracePeriod=30
Jul 22 13:07:17.921146 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:17.921065    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 13:07:17.925862 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:17.925835    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 13:07:17.931301 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:17.931278    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 13:07:17.935539 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:17.935518    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 13:07:17.999726 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:17.999634    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"
Jul 22 13:07:18.043581 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:18.043547    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f-openshift-service-ca\") pod \"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f\" (UID: \"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f\") "
Jul 22 13:07:18.043823 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:18.043615    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f-maas-api-tls\") pod \"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f\" (UID: \"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f\") "
Jul 22 13:07:18.043823 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:18.043642    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sfjv\" (UniqueName: \"kubernetes.io/projected/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f-kube-api-access-9sfjv\") pod \"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f\" (UID: \"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f\") "
Jul 22 13:07:18.044046 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:18.044018    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e3591f8b-d5c7-400f-ae0d-ef2710a73c9f" (UID: "e3591f8b-d5c7-400f-ae0d-ef2710a73c9f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:07:18.046194 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:18.046166    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e3591f8b-d5c7-400f-ae0d-ef2710a73c9f" (UID: "e3591f8b-d5c7-400f-ae0d-ef2710a73c9f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:07:18.046328 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:18.046259    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f-kube-api-access-9sfjv" (OuterVolumeSpecName: "kube-api-access-9sfjv") pod "e3591f8b-d5c7-400f-ae0d-ef2710a73c9f" (UID: "e3591f8b-d5c7-400f-ae0d-ef2710a73c9f"). InnerVolumeSpecName "kube-api-access-9sfjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:07:18.144699 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:18.144633    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f-maas-api-tls\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:07:18.144880 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:18.144707    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sfjv\" (UniqueName: \"kubernetes.io/projected/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f-kube-api-access-9sfjv\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:07:18.144880 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:18.144723    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f-openshift-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:07:18.258395 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:18.258303    2556 generic.go:356] "Generic (PLEG): container finished" podID="e3591f8b-d5c7-400f-ae0d-ef2710a73c9f" containerID="f0a3a0b628cd000b2259dac9eefa9067cdba75bae6a15cb52b2e6c394970b4ef" exitCode=0
Jul 22 13:07:18.258395 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:18.258360    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"
Jul 22 13:07:18.258618 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:18.258395    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6" event={"ID":"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f","Type":"ContainerDied","Data":"f0a3a0b628cd000b2259dac9eefa9067cdba75bae6a15cb52b2e6c394970b4ef"}
Jul 22 13:07:18.258618 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:18.258457    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6" event={"ID":"e3591f8b-d5c7-400f-ae0d-ef2710a73c9f","Type":"ContainerDied","Data":"4ce7f03f45f533b4e6f6e47cb55d867205c1065a9292ca438d99b753cb8f7649"}
Jul 22 13:07:18.258618 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:18.258483    2556 scope.go:117] "RemoveContainer" containerID="f0a3a0b628cd000b2259dac9eefa9067cdba75bae6a15cb52b2e6c394970b4ef"
Jul 22 13:07:18.267719 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:18.267701    2556 scope.go:117] "RemoveContainer" containerID="f0a3a0b628cd000b2259dac9eefa9067cdba75bae6a15cb52b2e6c394970b4ef"
Jul 22 13:07:18.267973 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:07:18.267952    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0a3a0b628cd000b2259dac9eefa9067cdba75bae6a15cb52b2e6c394970b4ef\": container with ID starting with f0a3a0b628cd000b2259dac9eefa9067cdba75bae6a15cb52b2e6c394970b4ef not found: ID does not exist" containerID="f0a3a0b628cd000b2259dac9eefa9067cdba75bae6a15cb52b2e6c394970b4ef"
Jul 22 13:07:18.268019 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:18.267983    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0a3a0b628cd000b2259dac9eefa9067cdba75bae6a15cb52b2e6c394970b4ef"} err="failed to get container status \"f0a3a0b628cd000b2259dac9eefa9067cdba75bae6a15cb52b2e6c394970b4ef\": rpc error: code = NotFound desc = could not find container \"f0a3a0b628cd000b2259dac9eefa9067cdba75bae6a15cb52b2e6c394970b4ef\": container with ID starting with f0a3a0b628cd000b2259dac9eefa9067cdba75bae6a15cb52b2e6c394970b4ef not found: ID does not exist"
Jul 22 13:07:18.282250 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:18.282224    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"]
Jul 22 13:07:18.284554 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:18.284531    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3147e54f-b8cf7f65f-m72r6"]
Jul 22 13:07:19.901539 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:19.901504    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3591f8b-d5c7-400f-ae0d-ef2710a73c9f" path="/var/lib/kubelet/pods/e3591f8b-d5c7-400f-ae0d-ef2710a73c9f/volumes"
Jul 22 13:07:22.264847 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:22.264802    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26"]
Jul 22 13:07:22.266887 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:22.266865    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3147e54f-kcj26"]
Jul 22 13:07:23.902431 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:23.902394    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df0e4cc0-7499-41ed-87fd-f4a6fd359d44" path="/var/lib/kubelet/pods/df0e4cc0-7499-41ed-87fd-f4a6fd359d44/volumes"
Jul 22 13:07:25.370753 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.370719    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"]
Jul 22 13:07:25.371182 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.371128    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3591f8b-d5c7-400f-ae0d-ef2710a73c9f" containerName="maas-api"
Jul 22 13:07:25.371182 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.371140    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3591f8b-d5c7-400f-ae0d-ef2710a73c9f" containerName="maas-api"
Jul 22 13:07:25.371182 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.371156    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df0e4cc0-7499-41ed-87fd-f4a6fd359d44" containerName="revoke-keys"
Jul 22 13:07:25.371182 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.371161    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="df0e4cc0-7499-41ed-87fd-f4a6fd359d44" containerName="revoke-keys"
Jul 22 13:07:25.371318 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.371230    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="df0e4cc0-7499-41ed-87fd-f4a6fd359d44" containerName="revoke-keys"
Jul 22 13:07:25.371318 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.371243    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3591f8b-d5c7-400f-ae0d-ef2710a73c9f" containerName="maas-api"
Jul 22 13:07:25.376281 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.376262    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"
Jul 22 13:07:25.379069 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.379048    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 13:07:25.379214 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.379153    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-bc6a4359-serving-cert\""
Jul 22 13:07:25.380261 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.380242    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8dbk8\""
Jul 22 13:07:25.380383 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.380280    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 13:07:25.386395 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.386374    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"]
Jul 22 13:07:25.515908 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.515864    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63206732-3a85-4e6b-a51e-701bdb5a87c4-maas-api-tls\") pod \"maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz\" (UID: \"63206732-3a85-4e6b-a51e-701bdb5a87c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"
Jul 22 13:07:25.516105 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.515914    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63206732-3a85-4e6b-a51e-701bdb5a87c4-openshift-service-ca\") pod \"maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz\" (UID: \"63206732-3a85-4e6b-a51e-701bdb5a87c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"
Jul 22 13:07:25.516105 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.515947    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsd9p\" (UniqueName: \"kubernetes.io/projected/63206732-3a85-4e6b-a51e-701bdb5a87c4-kube-api-access-lsd9p\") pod \"maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz\" (UID: \"63206732-3a85-4e6b-a51e-701bdb5a87c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"
Jul 22 13:07:25.617157 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.617118    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsd9p\" (UniqueName: \"kubernetes.io/projected/63206732-3a85-4e6b-a51e-701bdb5a87c4-kube-api-access-lsd9p\") pod \"maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz\" (UID: \"63206732-3a85-4e6b-a51e-701bdb5a87c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"
Jul 22 13:07:25.617343 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.617232    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63206732-3a85-4e6b-a51e-701bdb5a87c4-maas-api-tls\") pod \"maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz\" (UID: \"63206732-3a85-4e6b-a51e-701bdb5a87c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"
Jul 22 13:07:25.617343 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.617259    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63206732-3a85-4e6b-a51e-701bdb5a87c4-openshift-service-ca\") pod \"maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz\" (UID: \"63206732-3a85-4e6b-a51e-701bdb5a87c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"
Jul 22 13:07:25.617442 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:07:25.617373    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-serving-cert: secret "maas-api-e2e-ait-bc6a4359-serving-cert" not found
Jul 22 13:07:25.617478 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:07:25.617447    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63206732-3a85-4e6b-a51e-701bdb5a87c4-maas-api-tls podName:63206732-3a85-4e6b-a51e-701bdb5a87c4 nodeName:}" failed. No retries permitted until 2026-07-22 13:07:26.117426443 +0000 UTC m=+1808.757672662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/63206732-3a85-4e6b-a51e-701bdb5a87c4-maas-api-tls") pod "maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz" (UID: "63206732-3a85-4e6b-a51e-701bdb5a87c4") : secret "maas-api-e2e-ait-bc6a4359-serving-cert" not found
Jul 22 13:07:25.617980 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.617962    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63206732-3a85-4e6b-a51e-701bdb5a87c4-openshift-service-ca\") pod \"maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz\" (UID: \"63206732-3a85-4e6b-a51e-701bdb5a87c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"
Jul 22 13:07:25.627017 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:25.626954    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsd9p\" (UniqueName: \"kubernetes.io/projected/63206732-3a85-4e6b-a51e-701bdb5a87c4-kube-api-access-lsd9p\") pod \"maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz\" (UID: \"63206732-3a85-4e6b-a51e-701bdb5a87c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"
Jul 22 13:07:26.121629 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:26.121590    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63206732-3a85-4e6b-a51e-701bdb5a87c4-maas-api-tls\") pod \"maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz\" (UID: \"63206732-3a85-4e6b-a51e-701bdb5a87c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"
Jul 22 13:07:26.124204 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:26.124173    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63206732-3a85-4e6b-a51e-701bdb5a87c4-maas-api-tls\") pod \"maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz\" (UID: \"63206732-3a85-4e6b-a51e-701bdb5a87c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"
Jul 22 13:07:26.287853 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:26.287817    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"
Jul 22 13:07:26.427656 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:26.427628    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"]
Jul 22 13:07:26.430017 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:07:26.429982    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63206732_3a85_4e6b_a51e_701bdb5a87c4.slice/crio-8991e7214a6c928606713fc5f0c5792a1aaac103f8b2be078006be4b05b5803a WatchSource:0}: Error finding container 8991e7214a6c928606713fc5f0c5792a1aaac103f8b2be078006be4b05b5803a: Status 404 returned error can't find the container with id 8991e7214a6c928606713fc5f0c5792a1aaac103f8b2be078006be4b05b5803a
Jul 22 13:07:27.310752 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:27.310709    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz" event={"ID":"63206732-3a85-4e6b-a51e-701bdb5a87c4","Type":"ContainerStarted","Data":"1ed5d4bc0cf729895ca3bf0ce9c0395c8f97207fd8fa716493f13de56f271221"}
Jul 22 13:07:27.310939 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:27.310769    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz" event={"ID":"63206732-3a85-4e6b-a51e-701bdb5a87c4","Type":"ContainerStarted","Data":"8991e7214a6c928606713fc5f0c5792a1aaac103f8b2be078006be4b05b5803a"}
Jul 22 13:07:27.310939 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:27.310817    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"
Jul 22 13:07:27.328899 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:27.328851    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz" podStartSLOduration=1.851700627 podStartE2EDuration="2.328830603s" totalImagesPullingTime="477.129976ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:07:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:07:27.32789855 +0000 UTC m=+1809.968144947" watchObservedRunningTime="2026-07-22 13:07:27.328830603 +0000 UTC m=+1809.969076844"
Jul 22 13:07:33.321102 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:33.321072    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"
Jul 22 13:07:51.078700 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:51.078642    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bc6a4359-h76v9"]
Jul 22 13:07:51.082177 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:51.082161    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bc6a4359-h76v9"
Jul 22 13:07:51.084897 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:51.084879    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qrrb5\""
Jul 22 13:07:51.089762 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:51.089732    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bc6a4359-h76v9"]
Jul 22 13:07:51.155063 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:51.155031    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed0dfa4a-a564-424d-8e81-54869d7ab539-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bc6a4359-h76v9\" (UID: \"ed0dfa4a-a564-424d-8e81-54869d7ab539\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bc6a4359-h76v9"
Jul 22 13:07:51.256254 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:51.256215    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed0dfa4a-a564-424d-8e81-54869d7ab539-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bc6a4359-h76v9\" (UID: \"ed0dfa4a-a564-424d-8e81-54869d7ab539\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bc6a4359-h76v9"
Jul 22 13:07:51.256900 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:51.256883    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed0dfa4a-a564-424d-8e81-54869d7ab539-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bc6a4359-h76v9\" (UID: \"ed0dfa4a-a564-424d-8e81-54869d7ab539\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bc6a4359-h76v9"
Jul 22 13:07:51.395297 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:51.395208    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bc6a4359-h76v9"
Jul 22 13:07:51.532071 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:51.532045    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bc6a4359-h76v9"]
Jul 22 13:07:51.534272 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:07:51.534242    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded0dfa4a_a564_424d_8e81_54869d7ab539.slice/crio-5945e2df0bc958d01734f32581d2ddf4c7846b9f861ec5891cb263a6eed40676 WatchSource:0}: Error finding container 5945e2df0bc958d01734f32581d2ddf4c7846b9f861ec5891cb263a6eed40676: Status 404 returned error can't find the container with id 5945e2df0bc958d01734f32581d2ddf4c7846b9f861ec5891cb263a6eed40676
Jul 22 13:07:52.441554 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:52.441517    2556 generic.go:356] "Generic (PLEG): container finished" podID="ed0dfa4a-a564-424d-8e81-54869d7ab539" containerID="e69f2262c9855f5ad776253c9ff67e65d0fe9f0ee8603e5da86f2805c7372aa3" exitCode=0
Jul 22 13:07:52.441958 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:52.441596    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bc6a4359-h76v9" event={"ID":"ed0dfa4a-a564-424d-8e81-54869d7ab539","Type":"ContainerDied","Data":"e69f2262c9855f5ad776253c9ff67e65d0fe9f0ee8603e5da86f2805c7372aa3"}
Jul 22 13:07:52.441958 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:52.441665    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bc6a4359-h76v9" event={"ID":"ed0dfa4a-a564-424d-8e81-54869d7ab539","Type":"ContainerStarted","Data":"5945e2df0bc958d01734f32581d2ddf4c7846b9f861ec5891cb263a6eed40676"}
Jul 22 13:07:53.579149 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:53.579125    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bc6a4359-h76v9"
Jul 22 13:07:53.678537 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:53.678504    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed0dfa4a-a564-424d-8e81-54869d7ab539-maas-api-service-ca\") pod \"ed0dfa4a-a564-424d-8e81-54869d7ab539\" (UID: \"ed0dfa4a-a564-424d-8e81-54869d7ab539\") "
Jul 22 13:07:53.678919 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:53.678901    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed0dfa4a-a564-424d-8e81-54869d7ab539-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ed0dfa4a-a564-424d-8e81-54869d7ab539" (UID: "ed0dfa4a-a564-424d-8e81-54869d7ab539"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:07:53.779813 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:53.779783    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed0dfa4a-a564-424d-8e81-54869d7ab539-maas-api-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:07:54.453698 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:54.453652    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bc6a4359-h76v9"
Jul 22 13:07:54.453698 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:54.453662    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bc6a4359-h76v9" event={"ID":"ed0dfa4a-a564-424d-8e81-54869d7ab539","Type":"ContainerDied","Data":"5945e2df0bc958d01734f32581d2ddf4c7846b9f861ec5891cb263a6eed40676"}
Jul 22 13:07:54.453910 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:07:54.453727    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5945e2df0bc958d01734f32581d2ddf4c7846b9f861ec5891cb263a6eed40676"
Jul 22 13:08:01.526785 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:01.526746    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"]
Jul 22 13:08:01.527363 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:01.527005    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz" podUID="63206732-3a85-4e6b-a51e-701bdb5a87c4" containerName="maas-api" containerID="cri-o://1ed5d4bc0cf729895ca3bf0ce9c0395c8f97207fd8fa716493f13de56f271221" gracePeriod=30
Jul 22 13:08:01.790917 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:01.790858    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"
Jul 22 13:08:01.852318 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:01.852281    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsd9p\" (UniqueName: \"kubernetes.io/projected/63206732-3a85-4e6b-a51e-701bdb5a87c4-kube-api-access-lsd9p\") pod \"63206732-3a85-4e6b-a51e-701bdb5a87c4\" (UID: \"63206732-3a85-4e6b-a51e-701bdb5a87c4\") "
Jul 22 13:08:01.852318 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:01.852325    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63206732-3a85-4e6b-a51e-701bdb5a87c4-openshift-service-ca\") pod \"63206732-3a85-4e6b-a51e-701bdb5a87c4\" (UID: \"63206732-3a85-4e6b-a51e-701bdb5a87c4\") "
Jul 22 13:08:01.852568 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:01.852424    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63206732-3a85-4e6b-a51e-701bdb5a87c4-maas-api-tls\") pod \"63206732-3a85-4e6b-a51e-701bdb5a87c4\" (UID: \"63206732-3a85-4e6b-a51e-701bdb5a87c4\") "
Jul 22 13:08:01.852708 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:01.852656    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63206732-3a85-4e6b-a51e-701bdb5a87c4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "63206732-3a85-4e6b-a51e-701bdb5a87c4" (UID: "63206732-3a85-4e6b-a51e-701bdb5a87c4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:08:01.854636 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:01.854613    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63206732-3a85-4e6b-a51e-701bdb5a87c4-kube-api-access-lsd9p" (OuterVolumeSpecName: "kube-api-access-lsd9p") pod "63206732-3a85-4e6b-a51e-701bdb5a87c4" (UID: "63206732-3a85-4e6b-a51e-701bdb5a87c4"). InnerVolumeSpecName "kube-api-access-lsd9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:08:01.854730 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:01.854706    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63206732-3a85-4e6b-a51e-701bdb5a87c4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "63206732-3a85-4e6b-a51e-701bdb5a87c4" (UID: "63206732-3a85-4e6b-a51e-701bdb5a87c4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:08:01.953285 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:01.953254    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63206732-3a85-4e6b-a51e-701bdb5a87c4-openshift-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:08:01.953285 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:01.953280    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63206732-3a85-4e6b-a51e-701bdb5a87c4-maas-api-tls\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:08:01.953484 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:01.953291    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsd9p\" (UniqueName: \"kubernetes.io/projected/63206732-3a85-4e6b-a51e-701bdb5a87c4-kube-api-access-lsd9p\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:08:02.495991 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:02.495961    2556 generic.go:356] "Generic (PLEG): container finished" podID="63206732-3a85-4e6b-a51e-701bdb5a87c4" containerID="1ed5d4bc0cf729895ca3bf0ce9c0395c8f97207fd8fa716493f13de56f271221" exitCode=0
Jul 22 13:08:02.496175 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:02.496002    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"
Jul 22 13:08:02.496175 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:02.496047    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz" event={"ID":"63206732-3a85-4e6b-a51e-701bdb5a87c4","Type":"ContainerDied","Data":"1ed5d4bc0cf729895ca3bf0ce9c0395c8f97207fd8fa716493f13de56f271221"}
Jul 22 13:08:02.496175 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:02.496106    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz" event={"ID":"63206732-3a85-4e6b-a51e-701bdb5a87c4","Type":"ContainerDied","Data":"8991e7214a6c928606713fc5f0c5792a1aaac103f8b2be078006be4b05b5803a"}
Jul 22 13:08:02.496175 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:02.496129    2556 scope.go:117] "RemoveContainer" containerID="1ed5d4bc0cf729895ca3bf0ce9c0395c8f97207fd8fa716493f13de56f271221"
Jul 22 13:08:02.504870 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:02.504844    2556 scope.go:117] "RemoveContainer" containerID="1ed5d4bc0cf729895ca3bf0ce9c0395c8f97207fd8fa716493f13de56f271221"
Jul 22 13:08:02.505174 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:08:02.505149    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ed5d4bc0cf729895ca3bf0ce9c0395c8f97207fd8fa716493f13de56f271221\": container with ID starting with 1ed5d4bc0cf729895ca3bf0ce9c0395c8f97207fd8fa716493f13de56f271221 not found: ID does not exist" containerID="1ed5d4bc0cf729895ca3bf0ce9c0395c8f97207fd8fa716493f13de56f271221"
Jul 22 13:08:02.505225 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:02.505188    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ed5d4bc0cf729895ca3bf0ce9c0395c8f97207fd8fa716493f13de56f271221"} err="failed to get container status \"1ed5d4bc0cf729895ca3bf0ce9c0395c8f97207fd8fa716493f13de56f271221\": rpc error: code = NotFound desc = could not find container \"1ed5d4bc0cf729895ca3bf0ce9c0395c8f97207fd8fa716493f13de56f271221\": container with ID starting with 1ed5d4bc0cf729895ca3bf0ce9c0395c8f97207fd8fa716493f13de56f271221 not found: ID does not exist"
Jul 22 13:08:02.516060 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:02.516036    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"]
Jul 22 13:08:02.520916 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:02.520896    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bc6a4359-5d8c976f74-zlhqz"]
Jul 22 13:08:03.901328 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:03.901294    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63206732-3a85-4e6b-a51e-701bdb5a87c4" path="/var/lib/kubelet/pods/63206732-3a85-4e6b-a51e-701bdb5a87c4/volumes"
Jul 22 13:08:06.159580 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:06.159549    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bc6a4359-h76v9"]
Jul 22 13:08:06.164664 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:06.164639    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bc6a4359-h76v9"]
Jul 22 13:08:07.902603 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:07.902567    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed0dfa4a-a564-424d-8e81-54869d7ab539" path="/var/lib/kubelet/pods/ed0dfa4a-a564-424d-8e81-54869d7ab539/volumes"
Jul 22 13:08:10.635374 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.635335    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"]
Jul 22 13:08:10.635781 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.635732    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63206732-3a85-4e6b-a51e-701bdb5a87c4" containerName="maas-api"
Jul 22 13:08:10.635781 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.635744    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="63206732-3a85-4e6b-a51e-701bdb5a87c4" containerName="maas-api"
Jul 22 13:08:10.635781 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.635752    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed0dfa4a-a564-424d-8e81-54869d7ab539" containerName="revoke-keys"
Jul 22 13:08:10.635781 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.635758    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed0dfa4a-a564-424d-8e81-54869d7ab539" containerName="revoke-keys"
Jul 22 13:08:10.635935 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.635833    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed0dfa4a-a564-424d-8e81-54869d7ab539" containerName="revoke-keys"
Jul 22 13:08:10.635935 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.635842    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="63206732-3a85-4e6b-a51e-701bdb5a87c4" containerName="maas-api"
Jul 22 13:08:10.641127 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.641098    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"
Jul 22 13:08:10.646254 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.646230    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 13:08:10.646413 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.646369    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8dbk8\""
Jul 22 13:08:10.647167 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.647140    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-0d907048-serving-cert\""
Jul 22 13:08:10.647620 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.647478    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 13:08:10.654355 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.654332    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"]
Jul 22 13:08:10.740170 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.740133    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8397edb0-2b2a-4ea5-9c4a-3194842db61a-openshift-service-ca\") pod \"maas-api-e2e-derive-0d907048-796f6bd746-9dgtw\" (UID: \"8397edb0-2b2a-4ea5-9c4a-3194842db61a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"
Jul 22 13:08:10.740341 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.740174    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs6r2\" (UniqueName: \"kubernetes.io/projected/8397edb0-2b2a-4ea5-9c4a-3194842db61a-kube-api-access-bs6r2\") pod \"maas-api-e2e-derive-0d907048-796f6bd746-9dgtw\" (UID: \"8397edb0-2b2a-4ea5-9c4a-3194842db61a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"
Jul 22 13:08:10.740341 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.740215    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8397edb0-2b2a-4ea5-9c4a-3194842db61a-maas-api-tls\") pod \"maas-api-e2e-derive-0d907048-796f6bd746-9dgtw\" (UID: \"8397edb0-2b2a-4ea5-9c4a-3194842db61a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"
Jul 22 13:08:10.841342 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.841305    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8397edb0-2b2a-4ea5-9c4a-3194842db61a-openshift-service-ca\") pod \"maas-api-e2e-derive-0d907048-796f6bd746-9dgtw\" (UID: \"8397edb0-2b2a-4ea5-9c4a-3194842db61a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"
Jul 22 13:08:10.841342 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.841347    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs6r2\" (UniqueName: \"kubernetes.io/projected/8397edb0-2b2a-4ea5-9c4a-3194842db61a-kube-api-access-bs6r2\") pod \"maas-api-e2e-derive-0d907048-796f6bd746-9dgtw\" (UID: \"8397edb0-2b2a-4ea5-9c4a-3194842db61a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"
Jul 22 13:08:10.841655 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.841380    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8397edb0-2b2a-4ea5-9c4a-3194842db61a-maas-api-tls\") pod \"maas-api-e2e-derive-0d907048-796f6bd746-9dgtw\" (UID: \"8397edb0-2b2a-4ea5-9c4a-3194842db61a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"
Jul 22 13:08:10.842454 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.842426    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8397edb0-2b2a-4ea5-9c4a-3194842db61a-openshift-service-ca\") pod \"maas-api-e2e-derive-0d907048-796f6bd746-9dgtw\" (UID: \"8397edb0-2b2a-4ea5-9c4a-3194842db61a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"
Jul 22 13:08:10.844258 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.844226    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8397edb0-2b2a-4ea5-9c4a-3194842db61a-maas-api-tls\") pod \"maas-api-e2e-derive-0d907048-796f6bd746-9dgtw\" (UID: \"8397edb0-2b2a-4ea5-9c4a-3194842db61a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"
Jul 22 13:08:10.856939 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.856906    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs6r2\" (UniqueName: \"kubernetes.io/projected/8397edb0-2b2a-4ea5-9c4a-3194842db61a-kube-api-access-bs6r2\") pod \"maas-api-e2e-derive-0d907048-796f6bd746-9dgtw\" (UID: \"8397edb0-2b2a-4ea5-9c4a-3194842db61a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"
Jul 22 13:08:10.954500 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:10.954422    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"
Jul 22 13:08:11.098379 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:11.098354    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"]
Jul 22 13:08:11.100332 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:08:11.100304    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8397edb0_2b2a_4ea5_9c4a_3194842db61a.slice/crio-bd17fbb22fc8bf8d45b4d88ad01475ad323622cc0f5bf6a16ac3804ea7ea8708 WatchSource:0}: Error finding container bd17fbb22fc8bf8d45b4d88ad01475ad323622cc0f5bf6a16ac3804ea7ea8708: Status 404 returned error can't find the container with id bd17fbb22fc8bf8d45b4d88ad01475ad323622cc0f5bf6a16ac3804ea7ea8708
Jul 22 13:08:11.543455 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:11.543420    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw" event={"ID":"8397edb0-2b2a-4ea5-9c4a-3194842db61a","Type":"ContainerStarted","Data":"71ea87a580ed8a1738f75ba646bd0772f0b262e2d0b48392a85077bf71ae38cf"}
Jul 22 13:08:11.543626 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:11.543484    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw" event={"ID":"8397edb0-2b2a-4ea5-9c4a-3194842db61a","Type":"ContainerStarted","Data":"bd17fbb22fc8bf8d45b4d88ad01475ad323622cc0f5bf6a16ac3804ea7ea8708"}
Jul 22 13:08:11.543626 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:11.543526    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"
Jul 22 13:08:11.592150 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:11.592096    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw" podStartSLOduration=1.2384840129999999 podStartE2EDuration="1.592069702s" totalImagesPullingTime="353.585689ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:08:11.590498154 +0000 UTC m=+1854.230744424" watchObservedRunningTime="2026-07-22 13:08:11.592069702 +0000 UTC m=+1854.232315943"
Jul 22 13:08:17.555351 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:17.555317    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"
Jul 22 13:08:35.390309 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:35.390267    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d907048-66bzk"]
Jul 22 13:08:35.393993 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:35.393966    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d907048-66bzk"
Jul 22 13:08:35.396881 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:35.396858    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qrrb5\""
Jul 22 13:08:35.401362 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:35.401336    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d907048-66bzk"]
Jul 22 13:08:35.471400 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:35.471368    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f7dc626-399f-4d4d-9a9d-5b83fd584585-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d907048-66bzk\" (UID: \"6f7dc626-399f-4d4d-9a9d-5b83fd584585\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d907048-66bzk"
Jul 22 13:08:35.572804 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:35.572773    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f7dc626-399f-4d4d-9a9d-5b83fd584585-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d907048-66bzk\" (UID: \"6f7dc626-399f-4d4d-9a9d-5b83fd584585\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d907048-66bzk"
Jul 22 13:08:35.573450 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:35.573430    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f7dc626-399f-4d4d-9a9d-5b83fd584585-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0d907048-66bzk\" (UID: \"6f7dc626-399f-4d4d-9a9d-5b83fd584585\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d907048-66bzk"
Jul 22 13:08:35.706315 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:35.706230    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d907048-66bzk"
Jul 22 13:08:35.847618 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:35.847594    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d907048-66bzk"]
Jul 22 13:08:35.850147 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:08:35.850121    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f7dc626_399f_4d4d_9a9d_5b83fd584585.slice/crio-6b72244ec5e05e3c14f85c9adec3bb7cf1a8151e52d8b1b9eae8a4b9885a0851 WatchSource:0}: Error finding container 6b72244ec5e05e3c14f85c9adec3bb7cf1a8151e52d8b1b9eae8a4b9885a0851: Status 404 returned error can't find the container with id 6b72244ec5e05e3c14f85c9adec3bb7cf1a8151e52d8b1b9eae8a4b9885a0851
Jul 22 13:08:36.666707 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:36.666658    2556 generic.go:356] "Generic (PLEG): container finished" podID="6f7dc626-399f-4d4d-9a9d-5b83fd584585" containerID="76cabc6b7d190988d88a2bd0ae9877d6c2bb22eeb902b7eff28976fad504cb89" exitCode=0
Jul 22 13:08:36.667166 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:36.666712    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d907048-66bzk" event={"ID":"6f7dc626-399f-4d4d-9a9d-5b83fd584585","Type":"ContainerDied","Data":"76cabc6b7d190988d88a2bd0ae9877d6c2bb22eeb902b7eff28976fad504cb89"}
Jul 22 13:08:36.667166 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:36.666770    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d907048-66bzk" event={"ID":"6f7dc626-399f-4d4d-9a9d-5b83fd584585","Type":"ContainerStarted","Data":"6b72244ec5e05e3c14f85c9adec3bb7cf1a8151e52d8b1b9eae8a4b9885a0851"}
Jul 22 13:08:37.800472 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:37.800441    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d907048-66bzk"
Jul 22 13:08:37.895564 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:37.895536    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f7dc626-399f-4d4d-9a9d-5b83fd584585-maas-api-service-ca\") pod \"6f7dc626-399f-4d4d-9a9d-5b83fd584585\" (UID: \"6f7dc626-399f-4d4d-9a9d-5b83fd584585\") "
Jul 22 13:08:37.896014 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:37.895989    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f7dc626-399f-4d4d-9a9d-5b83fd584585-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6f7dc626-399f-4d4d-9a9d-5b83fd584585" (UID: "6f7dc626-399f-4d4d-9a9d-5b83fd584585"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:08:37.996612 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:37.996528    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f7dc626-399f-4d4d-9a9d-5b83fd584585-maas-api-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:08:38.679009 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:38.678976    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d907048-66bzk"
Jul 22 13:08:38.679197 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:38.679007    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d907048-66bzk" event={"ID":"6f7dc626-399f-4d4d-9a9d-5b83fd584585","Type":"ContainerDied","Data":"6b72244ec5e05e3c14f85c9adec3bb7cf1a8151e52d8b1b9eae8a4b9885a0851"}
Jul 22 13:08:38.679197 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:38.679082    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b72244ec5e05e3c14f85c9adec3bb7cf1a8151e52d8b1b9eae8a4b9885a0851"
Jul 22 13:08:45.945933 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:45.945905    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"]
Jul 22 13:08:45.946339 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:45.946134    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw" podUID="8397edb0-2b2a-4ea5-9c4a-3194842db61a" containerName="maas-api" containerID="cri-o://71ea87a580ed8a1738f75ba646bd0772f0b262e2d0b48392a85077bf71ae38cf" gracePeriod=30
Jul 22 13:08:46.212772 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.212747    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"
Jul 22 13:08:46.272665 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.272633    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8397edb0-2b2a-4ea5-9c4a-3194842db61a-openshift-service-ca\") pod \"8397edb0-2b2a-4ea5-9c4a-3194842db61a\" (UID: \"8397edb0-2b2a-4ea5-9c4a-3194842db61a\") "
Jul 22 13:08:46.272665 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.272692    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bs6r2\" (UniqueName: \"kubernetes.io/projected/8397edb0-2b2a-4ea5-9c4a-3194842db61a-kube-api-access-bs6r2\") pod \"8397edb0-2b2a-4ea5-9c4a-3194842db61a\" (UID: \"8397edb0-2b2a-4ea5-9c4a-3194842db61a\") "
Jul 22 13:08:46.272926 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.272755    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8397edb0-2b2a-4ea5-9c4a-3194842db61a-maas-api-tls\") pod \"8397edb0-2b2a-4ea5-9c4a-3194842db61a\" (UID: \"8397edb0-2b2a-4ea5-9c4a-3194842db61a\") "
Jul 22 13:08:46.272980 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.272961    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8397edb0-2b2a-4ea5-9c4a-3194842db61a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8397edb0-2b2a-4ea5-9c4a-3194842db61a" (UID: "8397edb0-2b2a-4ea5-9c4a-3194842db61a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:08:46.273064 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.273048    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8397edb0-2b2a-4ea5-9c4a-3194842db61a-openshift-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:08:46.274976 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.274956    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8397edb0-2b2a-4ea5-9c4a-3194842db61a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8397edb0-2b2a-4ea5-9c4a-3194842db61a" (UID: "8397edb0-2b2a-4ea5-9c4a-3194842db61a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:08:46.275049 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.274968    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8397edb0-2b2a-4ea5-9c4a-3194842db61a-kube-api-access-bs6r2" (OuterVolumeSpecName: "kube-api-access-bs6r2") pod "8397edb0-2b2a-4ea5-9c4a-3194842db61a" (UID: "8397edb0-2b2a-4ea5-9c4a-3194842db61a"). InnerVolumeSpecName "kube-api-access-bs6r2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:08:46.374427 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.374394    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bs6r2\" (UniqueName: \"kubernetes.io/projected/8397edb0-2b2a-4ea5-9c4a-3194842db61a-kube-api-access-bs6r2\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:08:46.374427 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.374424    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8397edb0-2b2a-4ea5-9c4a-3194842db61a-maas-api-tls\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:08:46.721302 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.721267    2556 generic.go:356] "Generic (PLEG): container finished" podID="8397edb0-2b2a-4ea5-9c4a-3194842db61a" containerID="71ea87a580ed8a1738f75ba646bd0772f0b262e2d0b48392a85077bf71ae38cf" exitCode=0
Jul 22 13:08:46.721471 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.721309    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"
Jul 22 13:08:46.721471 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.721356    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw" event={"ID":"8397edb0-2b2a-4ea5-9c4a-3194842db61a","Type":"ContainerDied","Data":"71ea87a580ed8a1738f75ba646bd0772f0b262e2d0b48392a85077bf71ae38cf"}
Jul 22 13:08:46.721471 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.721412    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw" event={"ID":"8397edb0-2b2a-4ea5-9c4a-3194842db61a","Type":"ContainerDied","Data":"bd17fbb22fc8bf8d45b4d88ad01475ad323622cc0f5bf6a16ac3804ea7ea8708"}
Jul 22 13:08:46.721471 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.721440    2556 scope.go:117] "RemoveContainer" containerID="71ea87a580ed8a1738f75ba646bd0772f0b262e2d0b48392a85077bf71ae38cf"
Jul 22 13:08:46.730664 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.730650    2556 scope.go:117] "RemoveContainer" containerID="71ea87a580ed8a1738f75ba646bd0772f0b262e2d0b48392a85077bf71ae38cf"
Jul 22 13:08:46.730936 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:08:46.730916    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71ea87a580ed8a1738f75ba646bd0772f0b262e2d0b48392a85077bf71ae38cf\": container with ID starting with 71ea87a580ed8a1738f75ba646bd0772f0b262e2d0b48392a85077bf71ae38cf not found: ID does not exist" containerID="71ea87a580ed8a1738f75ba646bd0772f0b262e2d0b48392a85077bf71ae38cf"
Jul 22 13:08:46.730979 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.730945    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71ea87a580ed8a1738f75ba646bd0772f0b262e2d0b48392a85077bf71ae38cf"} err="failed to get container status \"71ea87a580ed8a1738f75ba646bd0772f0b262e2d0b48392a85077bf71ae38cf\": rpc error: code = NotFound desc = could not find container \"71ea87a580ed8a1738f75ba646bd0772f0b262e2d0b48392a85077bf71ae38cf\": container with ID starting with 71ea87a580ed8a1738f75ba646bd0772f0b262e2d0b48392a85077bf71ae38cf not found: ID does not exist"
Jul 22 13:08:46.743149 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.743124    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"]
Jul 22 13:08:46.745487 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:46.745455    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0d907048-796f6bd746-9dgtw"]
Jul 22 13:08:47.902208 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:47.902165    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8397edb0-2b2a-4ea5-9c4a-3194842db61a" path="/var/lib/kubelet/pods/8397edb0-2b2a-4ea5-9c4a-3194842db61a/volumes"
Jul 22 13:08:50.469108 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:50.469070    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d907048-66bzk"]
Jul 22 13:08:50.472644 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:50.472621    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0d907048-66bzk"]
Jul 22 13:08:51.902443 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:08:51.902404    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f7dc626-399f-4d4d-9a9d-5b83fd584585" path="/var/lib/kubelet/pods/6f7dc626-399f-4d4d-9a9d-5b83fd584585/volumes"
Jul 22 13:10:32.943497 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:32.943420    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"]
Jul 22 13:10:32.944002 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:32.943790    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8397edb0-2b2a-4ea5-9c4a-3194842db61a" containerName="maas-api"
Jul 22 13:10:32.944002 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:32.943804    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8397edb0-2b2a-4ea5-9c4a-3194842db61a" containerName="maas-api"
Jul 22 13:10:32.944002 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:32.943844    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f7dc626-399f-4d4d-9a9d-5b83fd584585" containerName="revoke-keys"
Jul 22 13:10:32.944002 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:32.943850    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f7dc626-399f-4d4d-9a9d-5b83fd584585" containerName="revoke-keys"
Jul 22 13:10:32.944002 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:32.943910    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f7dc626-399f-4d4d-9a9d-5b83fd584585" containerName="revoke-keys"
Jul 22 13:10:32.944002 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:32.943920    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8397edb0-2b2a-4ea5-9c4a-3194842db61a" containerName="maas-api"
Jul 22 13:10:32.947013 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:32.946994    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"
Jul 22 13:10:32.950142 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:32.950119    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8c3b45b1-serving-cert\""
Jul 22 13:10:32.951396 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:32.951373    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8dbk8\""
Jul 22 13:10:32.951532 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:32.951414    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 13:10:32.951532 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:32.951440    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 13:10:32.958413 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:32.958388    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-openshift-service-ca\") pod \"maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg\" (UID: \"120ab47f-7b52-4ec2-a2a2-e37b19808bf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"
Jul 22 13:10:32.958545 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:32.958526    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-maas-api-tls\") pod \"maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg\" (UID: \"120ab47f-7b52-4ec2-a2a2-e37b19808bf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"
Jul 22 13:10:32.958622 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:32.958571    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t76rv\" (UniqueName: \"kubernetes.io/projected/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-kube-api-access-t76rv\") pod \"maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg\" (UID: \"120ab47f-7b52-4ec2-a2a2-e37b19808bf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"
Jul 22 13:10:32.971415 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:32.971391    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"]
Jul 22 13:10:33.059413 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:33.059381    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-openshift-service-ca\") pod \"maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg\" (UID: \"120ab47f-7b52-4ec2-a2a2-e37b19808bf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"
Jul 22 13:10:33.059622 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:33.059464    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-maas-api-tls\") pod \"maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg\" (UID: \"120ab47f-7b52-4ec2-a2a2-e37b19808bf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"
Jul 22 13:10:33.059622 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:33.059495    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t76rv\" (UniqueName: \"kubernetes.io/projected/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-kube-api-access-t76rv\") pod \"maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg\" (UID: \"120ab47f-7b52-4ec2-a2a2-e37b19808bf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"
Jul 22 13:10:33.059789 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:10:33.059625    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-serving-cert: secret "maas-api-e2e-mt-8c3b45b1-serving-cert" not found
Jul 22 13:10:33.059789 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:10:33.059734    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-maas-api-tls podName:120ab47f-7b52-4ec2-a2a2-e37b19808bf2 nodeName:}" failed. No retries permitted until 2026-07-22 13:10:33.559713293 +0000 UTC m=+1996.199959512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-maas-api-tls") pod "maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg" (UID: "120ab47f-7b52-4ec2-a2a2-e37b19808bf2") : secret "maas-api-e2e-mt-8c3b45b1-serving-cert" not found
Jul 22 13:10:33.060172 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:33.060149    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-openshift-service-ca\") pod \"maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg\" (UID: \"120ab47f-7b52-4ec2-a2a2-e37b19808bf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"
Jul 22 13:10:33.072424 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:33.072396    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t76rv\" (UniqueName: \"kubernetes.io/projected/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-kube-api-access-t76rv\") pod \"maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg\" (UID: \"120ab47f-7b52-4ec2-a2a2-e37b19808bf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"
Jul 22 13:10:33.564030 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:33.563997    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-maas-api-tls\") pod \"maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg\" (UID: \"120ab47f-7b52-4ec2-a2a2-e37b19808bf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"
Jul 22 13:10:33.564223 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:10:33.564143    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-serving-cert: secret "maas-api-e2e-mt-8c3b45b1-serving-cert" not found
Jul 22 13:10:33.564223 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:10:33.564215    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-maas-api-tls podName:120ab47f-7b52-4ec2-a2a2-e37b19808bf2 nodeName:}" failed. No retries permitted until 2026-07-22 13:10:34.564198826 +0000 UTC m=+1997.204445045 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-maas-api-tls") pod "maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg" (UID: "120ab47f-7b52-4ec2-a2a2-e37b19808bf2") : secret "maas-api-e2e-mt-8c3b45b1-serving-cert" not found
Jul 22 13:10:34.574070 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:34.574031    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-maas-api-tls\") pod \"maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg\" (UID: \"120ab47f-7b52-4ec2-a2a2-e37b19808bf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"
Jul 22 13:10:34.576765 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:34.576741    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-maas-api-tls\") pod \"maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg\" (UID: \"120ab47f-7b52-4ec2-a2a2-e37b19808bf2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"
Jul 22 13:10:34.758148 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:34.758111    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"
Jul 22 13:10:34.919405 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:34.919379    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"]
Jul 22 13:10:34.922364 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:10:34.922340    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120ab47f_7b52_4ec2_a2a2_e37b19808bf2.slice/crio-d91c57815f5d8925218a405d480cdab02d7d11c1a0c3318d5722e5761e0480dd WatchSource:0}: Error finding container d91c57815f5d8925218a405d480cdab02d7d11c1a0c3318d5722e5761e0480dd: Status 404 returned error can't find the container with id d91c57815f5d8925218a405d480cdab02d7d11c1a0c3318d5722e5761e0480dd
Jul 22 13:10:35.272740 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:35.272708    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg" event={"ID":"120ab47f-7b52-4ec2-a2a2-e37b19808bf2","Type":"ContainerStarted","Data":"d91c57815f5d8925218a405d480cdab02d7d11c1a0c3318d5722e5761e0480dd"}
Jul 22 13:10:36.280170 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:36.280134    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg" event={"ID":"120ab47f-7b52-4ec2-a2a2-e37b19808bf2","Type":"ContainerStarted","Data":"ee7334aeb079ce915aba6c0beaa028063fb78284ec6cd06e6cb66ba812d7dc7b"}
Jul 22 13:10:36.280649 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:36.280281    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"
Jul 22 13:10:36.299307 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:36.299257    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg" podStartSLOduration=3.781403471 podStartE2EDuration="4.299240917s" totalImagesPullingTime="517.837446ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:10:36.296661018 +0000 UTC m=+1998.936907287" watchObservedRunningTime="2026-07-22 13:10:36.299240917 +0000 UTC m=+1998.939487158"
Jul 22 13:10:42.291529 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:42.291497    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"
Jul 22 13:10:44.572582 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:44.572543    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c3b45b1-n4r4v"]
Jul 22 13:10:44.576544 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:44.576523    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c3b45b1-n4r4v"
Jul 22 13:10:44.579210 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:44.579190    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qrrb5\""
Jul 22 13:10:44.583266 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:44.583241    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c3b45b1-n4r4v"]
Jul 22 13:10:44.672254 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:44.672215    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8c8e9f-39d7-453c-bfcf-b08db01e7f25-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8c3b45b1-n4r4v\" (UID: \"fd8c8e9f-39d7-453c-bfcf-b08db01e7f25\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c3b45b1-n4r4v"
Jul 22 13:10:44.773095 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:44.773058    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8c8e9f-39d7-453c-bfcf-b08db01e7f25-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8c3b45b1-n4r4v\" (UID: \"fd8c8e9f-39d7-453c-bfcf-b08db01e7f25\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c3b45b1-n4r4v"
Jul 22 13:10:44.773700 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:44.773662    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8c8e9f-39d7-453c-bfcf-b08db01e7f25-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8c3b45b1-n4r4v\" (UID: \"fd8c8e9f-39d7-453c-bfcf-b08db01e7f25\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c3b45b1-n4r4v"
Jul 22 13:10:44.889432 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:44.889336    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c3b45b1-n4r4v"
Jul 22 13:10:45.033567 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:45.033539    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c3b45b1-n4r4v"]
Jul 22 13:10:45.034413 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:10:45.034386    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd8c8e9f_39d7_453c_bfcf_b08db01e7f25.slice/crio-30138085f066a1e7b241d869b7d748b50b5c4ceb23b8f1dd88559f46e8f8545f WatchSource:0}: Error finding container 30138085f066a1e7b241d869b7d748b50b5c4ceb23b8f1dd88559f46e8f8545f: Status 404 returned error can't find the container with id 30138085f066a1e7b241d869b7d748b50b5c4ceb23b8f1dd88559f46e8f8545f
Jul 22 13:10:45.326918 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:45.326884    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c3b45b1-n4r4v" event={"ID":"fd8c8e9f-39d7-453c-bfcf-b08db01e7f25","Type":"ContainerStarted","Data":"30138085f066a1e7b241d869b7d748b50b5c4ceb23b8f1dd88559f46e8f8545f"}
Jul 22 13:10:46.333509 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:46.333473    2556 generic.go:356] "Generic (PLEG): container finished" podID="fd8c8e9f-39d7-453c-bfcf-b08db01e7f25" containerID="aafb38c4d90b19fc9d58af1b1bce3515957c838011218298a9c76acfaab5ed53" exitCode=0
Jul 22 13:10:46.333918 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:46.333524    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c3b45b1-n4r4v" event={"ID":"fd8c8e9f-39d7-453c-bfcf-b08db01e7f25","Type":"ContainerDied","Data":"aafb38c4d90b19fc9d58af1b1bce3515957c838011218298a9c76acfaab5ed53"}
Jul 22 13:10:47.477848 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:47.477814    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c3b45b1-n4r4v"
Jul 22 13:10:47.600378 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:47.600273    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8c8e9f-39d7-453c-bfcf-b08db01e7f25-maas-api-service-ca\") pod \"fd8c8e9f-39d7-453c-bfcf-b08db01e7f25\" (UID: \"fd8c8e9f-39d7-453c-bfcf-b08db01e7f25\") "
Jul 22 13:10:47.600743 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:47.600708    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd8c8e9f-39d7-453c-bfcf-b08db01e7f25-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fd8c8e9f-39d7-453c-bfcf-b08db01e7f25" (UID: "fd8c8e9f-39d7-453c-bfcf-b08db01e7f25"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:10:47.701738 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:47.701659    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd8c8e9f-39d7-453c-bfcf-b08db01e7f25-maas-api-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:10:48.345074 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:48.345035    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c3b45b1-n4r4v" event={"ID":"fd8c8e9f-39d7-453c-bfcf-b08db01e7f25","Type":"ContainerDied","Data":"30138085f066a1e7b241d869b7d748b50b5c4ceb23b8f1dd88559f46e8f8545f"}
Jul 22 13:10:48.345074 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:48.345077    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c3b45b1-n4r4v"
Jul 22 13:10:48.345297 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:48.345098    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30138085f066a1e7b241d869b7d748b50b5c4ceb23b8f1dd88559f46e8f8545f"
Jul 22 13:10:55.020118 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.020076    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"]
Jul 22 13:10:55.020567 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.020338    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg" podUID="120ab47f-7b52-4ec2-a2a2-e37b19808bf2" containerName="maas-api" containerID="cri-o://ee7334aeb079ce915aba6c0beaa028063fb78284ec6cd06e6cb66ba812d7dc7b" gracePeriod=30
Jul 22 13:10:55.270477 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.270417    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"
Jul 22 13:10:55.377766 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.377730    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-maas-api-tls\") pod \"120ab47f-7b52-4ec2-a2a2-e37b19808bf2\" (UID: \"120ab47f-7b52-4ec2-a2a2-e37b19808bf2\") "
Jul 22 13:10:55.377966 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.377782    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-openshift-service-ca\") pod \"120ab47f-7b52-4ec2-a2a2-e37b19808bf2\" (UID: \"120ab47f-7b52-4ec2-a2a2-e37b19808bf2\") "
Jul 22 13:10:55.377966 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.377823    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t76rv\" (UniqueName: \"kubernetes.io/projected/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-kube-api-access-t76rv\") pod \"120ab47f-7b52-4ec2-a2a2-e37b19808bf2\" (UID: \"120ab47f-7b52-4ec2-a2a2-e37b19808bf2\") "
Jul 22 13:10:55.378178 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.378152    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "120ab47f-7b52-4ec2-a2a2-e37b19808bf2" (UID: "120ab47f-7b52-4ec2-a2a2-e37b19808bf2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:10:55.380234 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.380206    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "120ab47f-7b52-4ec2-a2a2-e37b19808bf2" (UID: "120ab47f-7b52-4ec2-a2a2-e37b19808bf2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:10:55.380325 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.380231    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-kube-api-access-t76rv" (OuterVolumeSpecName: "kube-api-access-t76rv") pod "120ab47f-7b52-4ec2-a2a2-e37b19808bf2" (UID: "120ab47f-7b52-4ec2-a2a2-e37b19808bf2"). InnerVolumeSpecName "kube-api-access-t76rv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:10:55.383080 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.383055    2556 generic.go:356] "Generic (PLEG): container finished" podID="120ab47f-7b52-4ec2-a2a2-e37b19808bf2" containerID="ee7334aeb079ce915aba6c0beaa028063fb78284ec6cd06e6cb66ba812d7dc7b" exitCode=0
Jul 22 13:10:55.383181 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.383117    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"
Jul 22 13:10:55.383181 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.383139    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg" event={"ID":"120ab47f-7b52-4ec2-a2a2-e37b19808bf2","Type":"ContainerDied","Data":"ee7334aeb079ce915aba6c0beaa028063fb78284ec6cd06e6cb66ba812d7dc7b"}
Jul 22 13:10:55.383295 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.383235    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg" event={"ID":"120ab47f-7b52-4ec2-a2a2-e37b19808bf2","Type":"ContainerDied","Data":"d91c57815f5d8925218a405d480cdab02d7d11c1a0c3318d5722e5761e0480dd"}
Jul 22 13:10:55.383295 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.383268    2556 scope.go:117] "RemoveContainer" containerID="ee7334aeb079ce915aba6c0beaa028063fb78284ec6cd06e6cb66ba812d7dc7b"
Jul 22 13:10:55.393774 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.393756    2556 scope.go:117] "RemoveContainer" containerID="ee7334aeb079ce915aba6c0beaa028063fb78284ec6cd06e6cb66ba812d7dc7b"
Jul 22 13:10:55.394031 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:10:55.394012    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee7334aeb079ce915aba6c0beaa028063fb78284ec6cd06e6cb66ba812d7dc7b\": container with ID starting with ee7334aeb079ce915aba6c0beaa028063fb78284ec6cd06e6cb66ba812d7dc7b not found: ID does not exist" containerID="ee7334aeb079ce915aba6c0beaa028063fb78284ec6cd06e6cb66ba812d7dc7b"
Jul 22 13:10:55.394081 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.394040    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7334aeb079ce915aba6c0beaa028063fb78284ec6cd06e6cb66ba812d7dc7b"} err="failed to get container status \"ee7334aeb079ce915aba6c0beaa028063fb78284ec6cd06e6cb66ba812d7dc7b\": rpc error: code = NotFound desc = could not find container \"ee7334aeb079ce915aba6c0beaa028063fb78284ec6cd06e6cb66ba812d7dc7b\": container with ID starting with ee7334aeb079ce915aba6c0beaa028063fb78284ec6cd06e6cb66ba812d7dc7b not found: ID does not exist"
Jul 22 13:10:55.405223 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.405200    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"]
Jul 22 13:10:55.409852 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.409832    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8c3b45b1-55c957956d-2mktg"]
Jul 22 13:10:55.479117 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.479083    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-maas-api-tls\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:10:55.479117 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.479113    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-openshift-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:10:55.479117 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.479123    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t76rv\" (UniqueName: \"kubernetes.io/projected/120ab47f-7b52-4ec2-a2a2-e37b19808bf2-kube-api-access-t76rv\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:10:55.901860 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:55.901824    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="120ab47f-7b52-4ec2-a2a2-e37b19808bf2" path="/var/lib/kubelet/pods/120ab47f-7b52-4ec2-a2a2-e37b19808bf2/volumes"
Jul 22 13:10:59.650157 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:59.650115    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c3b45b1-n4r4v"]
Jul 22 13:10:59.653949 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:59.653918    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c3b45b1-n4r4v"]
Jul 22 13:10:59.901594 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:10:59.901510    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd8c8e9f-39d7-453c-bfcf-b08db01e7f25" path="/var/lib/kubelet/pods/fd8c8e9f-39d7-453c-bfcf-b08db01e7f25/volumes"
Jul 22 13:11:29.314328 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.314293    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"]
Jul 22 13:11:29.314913 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.314894    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd8c8e9f-39d7-453c-bfcf-b08db01e7f25" containerName="revoke-keys"
Jul 22 13:11:29.314984 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.314917    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd8c8e9f-39d7-453c-bfcf-b08db01e7f25" containerName="revoke-keys"
Jul 22 13:11:29.314984 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.314945    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="120ab47f-7b52-4ec2-a2a2-e37b19808bf2" containerName="maas-api"
Jul 22 13:11:29.314984 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.314953    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="120ab47f-7b52-4ec2-a2a2-e37b19808bf2" containerName="maas-api"
Jul 22 13:11:29.315091 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.315024    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd8c8e9f-39d7-453c-bfcf-b08db01e7f25" containerName="revoke-keys"
Jul 22 13:11:29.315091 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.315034    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="120ab47f-7b52-4ec2-a2a2-e37b19808bf2" containerName="maas-api"
Jul 22 13:11:29.318139 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.318122    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"
Jul 22 13:11:29.321371 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.321350    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-1cd4d457-serving-cert\""
Jul 22 13:11:29.321514 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.321376    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8dbk8\""
Jul 22 13:11:29.321514 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.321392    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 13:11:29.322243 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.322221    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 13:11:29.329238 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.329202    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"]
Jul 22 13:11:29.394826 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.394788    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj46m\" (UniqueName: \"kubernetes.io/projected/7dcbc925-7c2f-4864-acce-0bd2e6e6813a-kube-api-access-wj46m\") pod \"maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf\" (UID: \"7dcbc925-7c2f-4864-acce-0bd2e6e6813a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"
Jul 22 13:11:29.395021 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.394832    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dcbc925-7c2f-4864-acce-0bd2e6e6813a-openshift-service-ca\") pod \"maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf\" (UID: \"7dcbc925-7c2f-4864-acce-0bd2e6e6813a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"
Jul 22 13:11:29.395021 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.394863    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dcbc925-7c2f-4864-acce-0bd2e6e6813a-maas-api-tls\") pod \"maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf\" (UID: \"7dcbc925-7c2f-4864-acce-0bd2e6e6813a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"
Jul 22 13:11:29.496242 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.496204    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj46m\" (UniqueName: \"kubernetes.io/projected/7dcbc925-7c2f-4864-acce-0bd2e6e6813a-kube-api-access-wj46m\") pod \"maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf\" (UID: \"7dcbc925-7c2f-4864-acce-0bd2e6e6813a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"
Jul 22 13:11:29.496242 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.496251    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dcbc925-7c2f-4864-acce-0bd2e6e6813a-openshift-service-ca\") pod \"maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf\" (UID: \"7dcbc925-7c2f-4864-acce-0bd2e6e6813a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"
Jul 22 13:11:29.496515 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.496284    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dcbc925-7c2f-4864-acce-0bd2e6e6813a-maas-api-tls\") pod \"maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf\" (UID: \"7dcbc925-7c2f-4864-acce-0bd2e6e6813a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"
Jul 22 13:11:29.496947 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.496923    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dcbc925-7c2f-4864-acce-0bd2e6e6813a-openshift-service-ca\") pod \"maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf\" (UID: \"7dcbc925-7c2f-4864-acce-0bd2e6e6813a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"
Jul 22 13:11:29.499007 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.498985    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dcbc925-7c2f-4864-acce-0bd2e6e6813a-maas-api-tls\") pod \"maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf\" (UID: \"7dcbc925-7c2f-4864-acce-0bd2e6e6813a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"
Jul 22 13:11:29.510537 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.510501    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj46m\" (UniqueName: \"kubernetes.io/projected/7dcbc925-7c2f-4864-acce-0bd2e6e6813a-kube-api-access-wj46m\") pod \"maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf\" (UID: \"7dcbc925-7c2f-4864-acce-0bd2e6e6813a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"
Jul 22 13:11:29.630435 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.630343    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"
Jul 22 13:11:29.776138 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:29.776109    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"]
Jul 22 13:11:29.778848 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:11:29.778817    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dcbc925_7c2f_4864_acce_0bd2e6e6813a.slice/crio-e4056445e951a1a0e5ff20a74e111e1b73e684f18410b945c585ac7055b9f0c6 WatchSource:0}: Error finding container e4056445e951a1a0e5ff20a74e111e1b73e684f18410b945c585ac7055b9f0c6: Status 404 returned error can't find the container with id e4056445e951a1a0e5ff20a74e111e1b73e684f18410b945c585ac7055b9f0c6
Jul 22 13:11:30.565707 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:30.565584    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf" event={"ID":"7dcbc925-7c2f-4864-acce-0bd2e6e6813a","Type":"ContainerStarted","Data":"29238ac3682eeaa77efb1e2605907ebffb8aae44420b1b5624d4d44a38650954"}
Jul 22 13:11:30.565707 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:30.565654    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf" event={"ID":"7dcbc925-7c2f-4864-acce-0bd2e6e6813a","Type":"ContainerStarted","Data":"e4056445e951a1a0e5ff20a74e111e1b73e684f18410b945c585ac7055b9f0c6"}
Jul 22 13:11:30.566151 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:30.565713    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"
Jul 22 13:11:30.603616 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:30.603560    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf" podStartSLOduration=1.0806393 podStartE2EDuration="1.603541297s" totalImagesPullingTime="522.901997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:11:30.602259952 +0000 UTC m=+2053.242506214" watchObservedRunningTime="2026-07-22 13:11:30.603541297 +0000 UTC m=+2053.243787538"
Jul 22 13:11:36.577156 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:11:36.577130    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"
Jul 22 13:12:17.960549 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:17.960522    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 13:12:17.964038 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:17.964010    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 13:12:17.968039 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:17.968005    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 13:12:17.971360 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:17.971339    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 13:12:37.725092 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:37.725053    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t"]
Jul 22 13:12:37.728933 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:37.728905    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t"
Jul 22 13:12:37.731795 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:37.731768    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qrrb5\""
Jul 22 13:12:37.734272 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:37.734243    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d94039e1-910c-45e9-a7eb-e406d7b03fdf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t\" (UID: \"d94039e1-910c-45e9-a7eb-e406d7b03fdf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t"
Jul 22 13:12:37.735492 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:37.735469    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t"]
Jul 22 13:12:37.834915 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:37.834877    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d94039e1-910c-45e9-a7eb-e406d7b03fdf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t\" (UID: \"d94039e1-910c-45e9-a7eb-e406d7b03fdf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t"
Jul 22 13:12:37.835486 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:37.835466    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d94039e1-910c-45e9-a7eb-e406d7b03fdf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t\" (UID: \"d94039e1-910c-45e9-a7eb-e406d7b03fdf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t"
Jul 22 13:12:38.041958 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:38.041918    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t"
Jul 22 13:12:38.192730 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:38.192696    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t"]
Jul 22 13:12:38.195862 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:12:38.195830    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd94039e1_910c_45e9_a7eb_e406d7b03fdf.slice/crio-acbc8a35fa5ad3ca4127e63749fefd8f7d861bfe3614d35d9456c008b89ab02c WatchSource:0}: Error finding container acbc8a35fa5ad3ca4127e63749fefd8f7d861bfe3614d35d9456c008b89ab02c: Status 404 returned error can't find the container with id acbc8a35fa5ad3ca4127e63749fefd8f7d861bfe3614d35d9456c008b89ab02c
Jul 22 13:12:38.918072 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:38.918037    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t" event={"ID":"d94039e1-910c-45e9-a7eb-e406d7b03fdf","Type":"ContainerStarted","Data":"200fe60ae2ba39d8eabb34af46bc12feb4762a962b68b144d4209e9be1bee4fb"}
Jul 22 13:12:38.918505 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:38.918101    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t" event={"ID":"d94039e1-910c-45e9-a7eb-e406d7b03fdf","Type":"ContainerStarted","Data":"acbc8a35fa5ad3ca4127e63749fefd8f7d861bfe3614d35d9456c008b89ab02c"}
Jul 22 13:12:38.936614 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:38.936558    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t" podStartSLOduration=1.9365363119999999 podStartE2EDuration="1.936536312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:12:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:12:38.934613955 +0000 UTC m=+2121.574860213" watchObservedRunningTime="2026-07-22 13:12:38.936536312 +0000 UTC m=+2121.576782612"
Jul 22 13:12:39.927308 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:39.927204    2556 generic.go:356] "Generic (PLEG): container finished" podID="d94039e1-910c-45e9-a7eb-e406d7b03fdf" containerID="200fe60ae2ba39d8eabb34af46bc12feb4762a962b68b144d4209e9be1bee4fb" exitCode=0
Jul 22 13:12:39.927308 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:39.927275    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t" event={"ID":"d94039e1-910c-45e9-a7eb-e406d7b03fdf","Type":"ContainerDied","Data":"200fe60ae2ba39d8eabb34af46bc12feb4762a962b68b144d4209e9be1bee4fb"}
Jul 22 13:12:41.078036 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:41.078003    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t"
Jul 22 13:12:41.159819 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:41.159788    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d94039e1-910c-45e9-a7eb-e406d7b03fdf-maas-api-service-ca\") pod \"d94039e1-910c-45e9-a7eb-e406d7b03fdf\" (UID: \"d94039e1-910c-45e9-a7eb-e406d7b03fdf\") "
Jul 22 13:12:41.160166 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:41.160142    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d94039e1-910c-45e9-a7eb-e406d7b03fdf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d94039e1-910c-45e9-a7eb-e406d7b03fdf" (UID: "d94039e1-910c-45e9-a7eb-e406d7b03fdf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:12:41.261099 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:41.261016    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d94039e1-910c-45e9-a7eb-e406d7b03fdf-maas-api-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:12:41.938867 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:41.938826    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t" event={"ID":"d94039e1-910c-45e9-a7eb-e406d7b03fdf","Type":"ContainerDied","Data":"acbc8a35fa5ad3ca4127e63749fefd8f7d861bfe3614d35d9456c008b89ab02c"}
Jul 22 13:12:41.939078 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:41.938885    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acbc8a35fa5ad3ca4127e63749fefd8f7d861bfe3614d35d9456c008b89ab02c"
Jul 22 13:12:41.939078 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:41.938834    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t"
Jul 22 13:12:53.184059 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:53.184016    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"]
Jul 22 13:12:53.184665 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:53.184262    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf" podUID="7dcbc925-7c2f-4864-acce-0bd2e6e6813a" containerName="maas-api" containerID="cri-o://29238ac3682eeaa77efb1e2605907ebffb8aae44420b1b5624d4d44a38650954" gracePeriod=30
Jul 22 13:12:53.442869 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:53.442790    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"
Jul 22 13:12:53.482485 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:53.482453    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj46m\" (UniqueName: \"kubernetes.io/projected/7dcbc925-7c2f-4864-acce-0bd2e6e6813a-kube-api-access-wj46m\") pod \"7dcbc925-7c2f-4864-acce-0bd2e6e6813a\" (UID: \"7dcbc925-7c2f-4864-acce-0bd2e6e6813a\") "
Jul 22 13:12:53.482666 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:53.482515    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dcbc925-7c2f-4864-acce-0bd2e6e6813a-maas-api-tls\") pod \"7dcbc925-7c2f-4864-acce-0bd2e6e6813a\" (UID: \"7dcbc925-7c2f-4864-acce-0bd2e6e6813a\") "
Jul 22 13:12:53.482666 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:53.482564    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dcbc925-7c2f-4864-acce-0bd2e6e6813a-openshift-service-ca\") pod \"7dcbc925-7c2f-4864-acce-0bd2e6e6813a\" (UID: \"7dcbc925-7c2f-4864-acce-0bd2e6e6813a\") "
Jul 22 13:12:53.483003 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:53.482977    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dcbc925-7c2f-4864-acce-0bd2e6e6813a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7dcbc925-7c2f-4864-acce-0bd2e6e6813a" (UID: "7dcbc925-7c2f-4864-acce-0bd2e6e6813a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:12:53.484768 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:53.484734    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dcbc925-7c2f-4864-acce-0bd2e6e6813a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7dcbc925-7c2f-4864-acce-0bd2e6e6813a" (UID: "7dcbc925-7c2f-4864-acce-0bd2e6e6813a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:12:53.484862 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:53.484817    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dcbc925-7c2f-4864-acce-0bd2e6e6813a-kube-api-access-wj46m" (OuterVolumeSpecName: "kube-api-access-wj46m") pod "7dcbc925-7c2f-4864-acce-0bd2e6e6813a" (UID: "7dcbc925-7c2f-4864-acce-0bd2e6e6813a"). InnerVolumeSpecName "kube-api-access-wj46m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:12:53.583809 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:53.583771    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj46m\" (UniqueName: \"kubernetes.io/projected/7dcbc925-7c2f-4864-acce-0bd2e6e6813a-kube-api-access-wj46m\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:12:53.583809 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:53.583800    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7dcbc925-7c2f-4864-acce-0bd2e6e6813a-maas-api-tls\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:12:53.583809 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:53.583809    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7dcbc925-7c2f-4864-acce-0bd2e6e6813a-openshift-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:12:54.002509 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:54.002470    2556 generic.go:356] "Generic (PLEG): container finished" podID="7dcbc925-7c2f-4864-acce-0bd2e6e6813a" containerID="29238ac3682eeaa77efb1e2605907ebffb8aae44420b1b5624d4d44a38650954" exitCode=0
Jul 22 13:12:54.002727 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:54.002518    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"
Jul 22 13:12:54.002727 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:54.002552    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf" event={"ID":"7dcbc925-7c2f-4864-acce-0bd2e6e6813a","Type":"ContainerDied","Data":"29238ac3682eeaa77efb1e2605907ebffb8aae44420b1b5624d4d44a38650954"}
Jul 22 13:12:54.002727 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:54.002605    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf" event={"ID":"7dcbc925-7c2f-4864-acce-0bd2e6e6813a","Type":"ContainerDied","Data":"e4056445e951a1a0e5ff20a74e111e1b73e684f18410b945c585ac7055b9f0c6"}
Jul 22 13:12:54.002727 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:54.002628    2556 scope.go:117] "RemoveContainer" containerID="29238ac3682eeaa77efb1e2605907ebffb8aae44420b1b5624d4d44a38650954"
Jul 22 13:12:54.011531 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:54.011510    2556 scope.go:117] "RemoveContainer" containerID="29238ac3682eeaa77efb1e2605907ebffb8aae44420b1b5624d4d44a38650954"
Jul 22 13:12:54.011849 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:12:54.011829    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29238ac3682eeaa77efb1e2605907ebffb8aae44420b1b5624d4d44a38650954\": container with ID starting with 29238ac3682eeaa77efb1e2605907ebffb8aae44420b1b5624d4d44a38650954 not found: ID does not exist" containerID="29238ac3682eeaa77efb1e2605907ebffb8aae44420b1b5624d4d44a38650954"
Jul 22 13:12:54.011912 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:54.011856    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29238ac3682eeaa77efb1e2605907ebffb8aae44420b1b5624d4d44a38650954"} err="failed to get container status \"29238ac3682eeaa77efb1e2605907ebffb8aae44420b1b5624d4d44a38650954\": rpc error: code = NotFound desc = could not find container \"29238ac3682eeaa77efb1e2605907ebffb8aae44420b1b5624d4d44a38650954\": container with ID starting with 29238ac3682eeaa77efb1e2605907ebffb8aae44420b1b5624d4d44a38650954 not found: ID does not exist"
Jul 22 13:12:54.020774 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:54.020746    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"]
Jul 22 13:12:54.024194 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:54.024166    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1cd4d457-7fcf88788b-vbrpf"]
Jul 22 13:12:55.902220 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:55.902185    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dcbc925-7c2f-4864-acce-0bd2e6e6813a" path="/var/lib/kubelet/pods/7dcbc925-7c2f-4864-acce-0bd2e6e6813a/volumes"
Jul 22 13:12:57.803287 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:57.803252    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t"]
Jul 22 13:12:57.805337 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:57.805316    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1cd4d457-lhz7t"]
Jul 22 13:12:57.906533 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:12:57.906497    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d94039e1-910c-45e9-a7eb-e406d7b03fdf" path="/var/lib/kubelet/pods/d94039e1-910c-45e9-a7eb-e406d7b03fdf/volumes"
Jul 22 13:13:18.038031 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:13:18.037941    2556 scope.go:117] "RemoveContainer" containerID="88f3b3ade93e8db450016a9a8544b34831337b116dde7227b01f3ba0623d0fe5"
Jul 22 13:13:18.046604 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:13:18.046582    2556 scope.go:117] "RemoveContainer" containerID="e91941cc6dd9c755f496bbce4f8af676756048b83c8e8dd75270acbf76781c30"
Jul 22 13:14:18.075671 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:18.075639    2556 scope.go:117] "RemoveContainer" containerID="e69f2262c9855f5ad776253c9ff67e65d0fe9f0ee8603e5da86f2805c7372aa3"
Jul 22 13:14:47.229481 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.229394    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"]
Jul 22 13:14:47.229986 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.229946    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dcbc925-7c2f-4864-acce-0bd2e6e6813a" containerName="maas-api"
Jul 22 13:14:47.229986 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.229964    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dcbc925-7c2f-4864-acce-0bd2e6e6813a" containerName="maas-api"
Jul 22 13:14:47.230116 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.229994    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d94039e1-910c-45e9-a7eb-e406d7b03fdf" containerName="revoke-keys"
Jul 22 13:14:47.230116 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.230002    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d94039e1-910c-45e9-a7eb-e406d7b03fdf" containerName="revoke-keys"
Jul 22 13:14:47.230213 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.230114    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dcbc925-7c2f-4864-acce-0bd2e6e6813a" containerName="maas-api"
Jul 22 13:14:47.230213 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.230127    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d94039e1-910c-45e9-a7eb-e406d7b03fdf" containerName="revoke-keys"
Jul 22 13:14:47.233518 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.233498    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"
Jul 22 13:14:47.236807 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.236785    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-6b8164-serving-cert\""
Jul 22 13:14:47.236944 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.236839    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 13:14:47.237796 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.237777    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 13:14:47.237796 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.237792    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8dbk8\""
Jul 22 13:14:47.239464 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.239439    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55002a36-0347-4d30-89ab-85714298bb68-maas-api-tls\") pod \"maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89\" (UID: \"55002a36-0347-4d30-89ab-85714298bb68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"
Jul 22 13:14:47.239584 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.239538    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55002a36-0347-4d30-89ab-85714298bb68-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89\" (UID: \"55002a36-0347-4d30-89ab-85714298bb68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"
Jul 22 13:14:47.239653 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.239636    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs4vr\" (UniqueName: \"kubernetes.io/projected/55002a36-0347-4d30-89ab-85714298bb68-kube-api-access-hs4vr\") pod \"maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89\" (UID: \"55002a36-0347-4d30-89ab-85714298bb68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"
Jul 22 13:14:47.243567 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.243535    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"]
Jul 22 13:14:47.340562 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.340524    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs4vr\" (UniqueName: \"kubernetes.io/projected/55002a36-0347-4d30-89ab-85714298bb68-kube-api-access-hs4vr\") pod \"maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89\" (UID: \"55002a36-0347-4d30-89ab-85714298bb68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"
Jul 22 13:14:47.340810 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.340657    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55002a36-0347-4d30-89ab-85714298bb68-maas-api-tls\") pod \"maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89\" (UID: \"55002a36-0347-4d30-89ab-85714298bb68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"
Jul 22 13:14:47.340810 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.340729    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55002a36-0347-4d30-89ab-85714298bb68-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89\" (UID: \"55002a36-0347-4d30-89ab-85714298bb68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"
Jul 22 13:14:47.340810 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:14:47.340792    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-serving-cert: secret "maas-api-e2e-inf-a-6b8164-serving-cert" not found
Jul 22 13:14:47.340994 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:14:47.340882    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55002a36-0347-4d30-89ab-85714298bb68-maas-api-tls podName:55002a36-0347-4d30-89ab-85714298bb68 nodeName:}" failed. No retries permitted until 2026-07-22 13:14:47.84086054 +0000 UTC m=+2250.481106776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/55002a36-0347-4d30-89ab-85714298bb68-maas-api-tls") pod "maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89" (UID: "55002a36-0347-4d30-89ab-85714298bb68") : secret "maas-api-e2e-inf-a-6b8164-serving-cert" not found
Jul 22 13:14:47.341405 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.341381    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55002a36-0347-4d30-89ab-85714298bb68-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89\" (UID: \"55002a36-0347-4d30-89ab-85714298bb68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"
Jul 22 13:14:47.350206 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.350168    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs4vr\" (UniqueName: \"kubernetes.io/projected/55002a36-0347-4d30-89ab-85714298bb68-kube-api-access-hs4vr\") pod \"maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89\" (UID: \"55002a36-0347-4d30-89ab-85714298bb68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"
Jul 22 13:14:47.844869 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.844831    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55002a36-0347-4d30-89ab-85714298bb68-maas-api-tls\") pod \"maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89\" (UID: \"55002a36-0347-4d30-89ab-85714298bb68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"
Jul 22 13:14:47.847652 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.847625    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55002a36-0347-4d30-89ab-85714298bb68-maas-api-tls\") pod \"maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89\" (UID: \"55002a36-0347-4d30-89ab-85714298bb68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"
Jul 22 13:14:47.850518 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:47.850497    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"
Jul 22 13:14:48.028604 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:48.028578    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"]
Jul 22 13:14:48.031161 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:14:48.031130    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55002a36_0347_4d30_89ab_85714298bb68.slice/crio-a4fdba69f81d73beef45565c70c641cae284fefabe47abe3fa4067c1c7a9acd7 WatchSource:0}: Error finding container a4fdba69f81d73beef45565c70c641cae284fefabe47abe3fa4067c1c7a9acd7: Status 404 returned error can't find the container with id a4fdba69f81d73beef45565c70c641cae284fefabe47abe3fa4067c1c7a9acd7
Jul 22 13:14:48.032544 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:48.032523    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 13:14:48.586768 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:48.586729    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89" event={"ID":"55002a36-0347-4d30-89ab-85714298bb68","Type":"ContainerStarted","Data":"e910132f08e8d8a5887484c1cce943f2b726f50d3dbd2a5ff869464a6685989a"}
Jul 22 13:14:48.587145 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:48.586810    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89" event={"ID":"55002a36-0347-4d30-89ab-85714298bb68","Type":"ContainerStarted","Data":"a4fdba69f81d73beef45565c70c641cae284fefabe47abe3fa4067c1c7a9acd7"}
Jul 22 13:14:48.587145 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:48.586854    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"
Jul 22 13:14:48.607976 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:48.607921    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89" podStartSLOduration=1.176559873 podStartE2EDuration="1.607904715s" totalImagesPullingTime="431.344842ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:14:48.605330307 +0000 UTC m=+2251.245576567" watchObservedRunningTime="2026-07-22 13:14:48.607904715 +0000 UTC m=+2251.248150955"
Jul 22 13:14:54.597860 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:54.597832    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"
Jul 22 13:14:55.071879 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:55.071842    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"]
Jul 22 13:14:55.076076 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:55.076052    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"
Jul 22 13:14:55.078815 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:55.078790    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-c5ea07-serving-cert\""
Jul 22 13:14:55.084198 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:55.084173    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"]
Jul 22 13:14:55.106197 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:55.106159    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrlvs\" (UniqueName: \"kubernetes.io/projected/820adec9-e1a5-4e25-8271-662d9f0bbd46-kube-api-access-wrlvs\") pod \"maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm\" (UID: \"820adec9-e1a5-4e25-8271-662d9f0bbd46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"
Jul 22 13:14:55.106390 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:55.106205    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/820adec9-e1a5-4e25-8271-662d9f0bbd46-maas-api-tls\") pod \"maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm\" (UID: \"820adec9-e1a5-4e25-8271-662d9f0bbd46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"
Jul 22 13:14:55.106390 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:55.106287    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/820adec9-e1a5-4e25-8271-662d9f0bbd46-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm\" (UID: \"820adec9-e1a5-4e25-8271-662d9f0bbd46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"
Jul 22 13:14:55.207227 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:55.207184    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrlvs\" (UniqueName: \"kubernetes.io/projected/820adec9-e1a5-4e25-8271-662d9f0bbd46-kube-api-access-wrlvs\") pod \"maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm\" (UID: \"820adec9-e1a5-4e25-8271-662d9f0bbd46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"
Jul 22 13:14:55.207227 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:55.207226    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/820adec9-e1a5-4e25-8271-662d9f0bbd46-maas-api-tls\") pod \"maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm\" (UID: \"820adec9-e1a5-4e25-8271-662d9f0bbd46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"
Jul 22 13:14:55.207448 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:55.207266    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/820adec9-e1a5-4e25-8271-662d9f0bbd46-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm\" (UID: \"820adec9-e1a5-4e25-8271-662d9f0bbd46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"
Jul 22 13:14:55.207448 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:14:55.207415    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-serving-cert: secret "maas-api-e2e-inf-b-c5ea07-serving-cert" not found
Jul 22 13:14:55.207530 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:14:55.207518    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820adec9-e1a5-4e25-8271-662d9f0bbd46-maas-api-tls podName:820adec9-e1a5-4e25-8271-662d9f0bbd46 nodeName:}" failed. No retries permitted until 2026-07-22 13:14:55.707485212 +0000 UTC m=+2258.347731436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/820adec9-e1a5-4e25-8271-662d9f0bbd46-maas-api-tls") pod "maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm" (UID: "820adec9-e1a5-4e25-8271-662d9f0bbd46") : secret "maas-api-e2e-inf-b-c5ea07-serving-cert" not found
Jul 22 13:14:55.207894 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:55.207878    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/820adec9-e1a5-4e25-8271-662d9f0bbd46-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm\" (UID: \"820adec9-e1a5-4e25-8271-662d9f0bbd46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"
Jul 22 13:14:55.217783 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:55.217756    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrlvs\" (UniqueName: \"kubernetes.io/projected/820adec9-e1a5-4e25-8271-662d9f0bbd46-kube-api-access-wrlvs\") pod \"maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm\" (UID: \"820adec9-e1a5-4e25-8271-662d9f0bbd46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"
Jul 22 13:14:55.712446 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:55.712403    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/820adec9-e1a5-4e25-8271-662d9f0bbd46-maas-api-tls\") pod \"maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm\" (UID: \"820adec9-e1a5-4e25-8271-662d9f0bbd46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"
Jul 22 13:14:55.715043 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:55.715020    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/820adec9-e1a5-4e25-8271-662d9f0bbd46-maas-api-tls\") pod \"maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm\" (UID: \"820adec9-e1a5-4e25-8271-662d9f0bbd46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"
Jul 22 13:14:55.990914 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:55.990822    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"
Jul 22 13:14:56.141706 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:56.141656    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"]
Jul 22 13:14:56.143935 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:14:56.143899    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod820adec9_e1a5_4e25_8271_662d9f0bbd46.slice/crio-e6ba73211b636308d5fadb9a152538b855e3a5cd307613392edd652fb22f7399 WatchSource:0}: Error finding container e6ba73211b636308d5fadb9a152538b855e3a5cd307613392edd652fb22f7399: Status 404 returned error can't find the container with id e6ba73211b636308d5fadb9a152538b855e3a5cd307613392edd652fb22f7399
Jul 22 13:14:56.627970 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:56.627930    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm" event={"ID":"820adec9-e1a5-4e25-8271-662d9f0bbd46","Type":"ContainerStarted","Data":"256b444f32e9df3efc3429c028d348cd4fed236fb2a925316bf6cdd638057337"}
Jul 22 13:14:56.628183 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:56.627991    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm" event={"ID":"820adec9-e1a5-4e25-8271-662d9f0bbd46","Type":"ContainerStarted","Data":"e6ba73211b636308d5fadb9a152538b855e3a5cd307613392edd652fb22f7399"}
Jul 22 13:14:56.628183 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:56.628068    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"
Jul 22 13:14:56.646353 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:14:56.646295    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm" podStartSLOduration=1.3032728869999999 podStartE2EDuration="1.646276704s" totalImagesPullingTime="343.003817ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:14:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:14:56.64494386 +0000 UTC m=+2259.285190120" watchObservedRunningTime="2026-07-22 13:14:56.646276704 +0000 UTC m=+2259.286523001"
Jul 22 13:15:00.133855 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.133803    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745435-jzr79"]
Jul 22 13:15:00.137975 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.137941    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg"]
Jul 22 13:15:00.138153 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.138087    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745435-jzr79"
Jul 22 13:15:00.140830 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.140800    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qrrb5\""
Jul 22 13:15:00.141986 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.141963    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6b8164-29745435-7zzq4"]
Jul 22 13:15:00.142125 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.142102    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg"
Jul 22 13:15:00.147081 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.147057    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6b8164-29745435-7zzq4"
Jul 22 13:15:00.148144 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.148072    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745435-jzr79"]
Jul 22 13:15:00.151141 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.151119    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg"]
Jul 22 13:15:00.154468 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.153959    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6b8164-29745435-7zzq4"]
Jul 22 13:15:00.159528 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.159454    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745435-jzr79"
Jul 22 13:15:00.202529 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.202504    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg"
Jul 22 13:15:00.205158 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.205134    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6b8164-29745435-7zzq4"
Jul 22 13:15:00.360838 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.360390    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745435-jzr79"]
Jul 22 13:15:00.364248 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:15:00.363728    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f83750f_1d94_4ac5_812f_0d8fe65d81c7.slice/crio-014ab91b81db3f92a178ecc7fe5947133f9e2b38a59b837d512c4a42d6b350bf WatchSource:0}: Error finding container 014ab91b81db3f92a178ecc7fe5947133f9e2b38a59b837d512c4a42d6b350bf: Status 404 returned error can't find the container with id 014ab91b81db3f92a178ecc7fe5947133f9e2b38a59b837d512c4a42d6b350bf
Jul 22 13:15:00.392753 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.392370    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg"]
Jul 22 13:15:00.396130 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:15:00.396051    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf71dc75c_e562_4d12_8b72_24a801dbd756.slice/crio-42334184c16e39f1881e65136bcc7cbff803bad7c091f6dbb83d3757f41baeb9 WatchSource:0}: Error finding container 42334184c16e39f1881e65136bcc7cbff803bad7c091f6dbb83d3757f41baeb9: Status 404 returned error can't find the container with id 42334184c16e39f1881e65136bcc7cbff803bad7c091f6dbb83d3757f41baeb9
Jul 22 13:15:00.421629 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.421508    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6b8164-29745435-7zzq4"]
Jul 22 13:15:00.432446 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:15:00.432406    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf456ea3d_44a9_4d42_ac93_1efcfd8bf4fb.slice/crio-e6ea038b35f5a2f8304fe6bc0ce7844e8d1d7cb53f062985f4883cb4dcea059b WatchSource:0}: Error finding container e6ea038b35f5a2f8304fe6bc0ce7844e8d1d7cb53f062985f4883cb4dcea059b: Status 404 returned error can't find the container with id e6ea038b35f5a2f8304fe6bc0ce7844e8d1d7cb53f062985f4883cb4dcea059b
Jul 22 13:15:00.650862 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.650832    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6b8164-29745435-7zzq4" event={"ID":"f456ea3d-44a9-4d42-ac93-1efcfd8bf4fb","Type":"ContainerStarted","Data":"e6ea038b35f5a2f8304fe6bc0ce7844e8d1d7cb53f062985f4883cb4dcea059b"}
Jul 22 13:15:00.652627 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.652598    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg" event={"ID":"f71dc75c-e562-4d12-8b72-24a801dbd756","Type":"ContainerStarted","Data":"42334184c16e39f1881e65136bcc7cbff803bad7c091f6dbb83d3757f41baeb9"}
Jul 22 13:15:00.653844 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:00.653820    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745435-jzr79" event={"ID":"5f83750f-1d94-4ac5-812f-0d8fe65d81c7","Type":"ContainerStarted","Data":"014ab91b81db3f92a178ecc7fe5947133f9e2b38a59b837d512c4a42d6b350bf"}
Jul 22 13:15:01.660710 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:01.660646    2556 generic.go:356] "Generic (PLEG): container finished" podID="f456ea3d-44a9-4d42-ac93-1efcfd8bf4fb" containerID="bdb05968e724cbeb2ac7f4af0bca0b107ea696625a84cbeb8b816da81aed04b6" exitCode=0
Jul 22 13:15:01.661151 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:01.660716    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6b8164-29745435-7zzq4" event={"ID":"f456ea3d-44a9-4d42-ac93-1efcfd8bf4fb","Type":"ContainerDied","Data":"bdb05968e724cbeb2ac7f4af0bca0b107ea696625a84cbeb8b816da81aed04b6"}
Jul 22 13:15:01.662396 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:01.662371    2556 generic.go:356] "Generic (PLEG): container finished" podID="f71dc75c-e562-4d12-8b72-24a801dbd756" containerID="d05bb9c479c5a3b10bea0b566c7bfbb55b506a766faf570fe4f0cfee84e9c1e5" exitCode=7
Jul 22 13:15:01.662508 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:01.662453    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg" event={"ID":"f71dc75c-e562-4d12-8b72-24a801dbd756","Type":"ContainerDied","Data":"d05bb9c479c5a3b10bea0b566c7bfbb55b506a766faf570fe4f0cfee84e9c1e5"}
Jul 22 13:15:01.662604 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:01.662590    2556 scope.go:117] "RemoveContainer" containerID="d05bb9c479c5a3b10bea0b566c7bfbb55b506a766faf570fe4f0cfee84e9c1e5"
Jul 22 13:15:01.664036 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:01.664017    2556 generic.go:356] "Generic (PLEG): container finished" podID="5f83750f-1d94-4ac5-812f-0d8fe65d81c7" containerID="8210ecea6b7c4c6abbc235be0f24e1219096a816e84945cd668c2496243d8579" exitCode=0
Jul 22 13:15:01.664154 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:01.664044    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745435-jzr79" event={"ID":"5f83750f-1d94-4ac5-812f-0d8fe65d81c7","Type":"ContainerDied","Data":"8210ecea6b7c4c6abbc235be0f24e1219096a816e84945cd668c2496243d8579"}
Jul 22 13:15:02.638553 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:02.638472    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"
Jul 22 13:15:02.673389 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:02.673348    2556 generic.go:356] "Generic (PLEG): container finished" podID="f71dc75c-e562-4d12-8b72-24a801dbd756" containerID="0848a91364ee53561acdacbc054e0afb0a8cb8c63f4d37f086ccdc9fa41021f4" exitCode=7
Jul 22 13:15:02.673861 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:02.673433    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg" event={"ID":"f71dc75c-e562-4d12-8b72-24a801dbd756","Type":"ContainerDied","Data":"0848a91364ee53561acdacbc054e0afb0a8cb8c63f4d37f086ccdc9fa41021f4"}
Jul 22 13:15:02.673861 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:02.673497    2556 scope.go:117] "RemoveContainer" containerID="d05bb9c479c5a3b10bea0b566c7bfbb55b506a766faf570fe4f0cfee84e9c1e5"
Jul 22 13:15:02.673861 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:02.673594    2556 scope.go:117] "RemoveContainer" containerID="0848a91364ee53561acdacbc054e0afb0a8cb8c63f4d37f086ccdc9fa41021f4"
Jul 22 13:15:02.674050 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:15:02.673909    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg_odh-ai-gateway-infra(f71dc75c-e562-4d12-8b72-24a801dbd756)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg" podUID="f71dc75c-e562-4d12-8b72-24a801dbd756"
Jul 22 13:15:02.811613 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:02.811584    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745435-jzr79"
Jul 22 13:15:02.854816 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:02.854793    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6b8164-29745435-7zzq4"
Jul 22 13:15:03.681196 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:03.681166    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6b8164-29745435-7zzq4"
Jul 22 13:15:03.681196 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:03.681172    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6b8164-29745435-7zzq4" event={"ID":"f456ea3d-44a9-4d42-ac93-1efcfd8bf4fb","Type":"ContainerDied","Data":"e6ea038b35f5a2f8304fe6bc0ce7844e8d1d7cb53f062985f4883cb4dcea059b"}
Jul 22 13:15:03.681804 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:03.681223    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6ea038b35f5a2f8304fe6bc0ce7844e8d1d7cb53f062985f4883cb4dcea059b"
Jul 22 13:15:03.683092 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:03.683065    2556 scope.go:117] "RemoveContainer" containerID="0848a91364ee53561acdacbc054e0afb0a8cb8c63f4d37f086ccdc9fa41021f4"
Jul 22 13:15:03.683337 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:15:03.683310    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg_odh-ai-gateway-infra(f71dc75c-e562-4d12-8b72-24a801dbd756)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg" podUID="f71dc75c-e562-4d12-8b72-24a801dbd756"
Jul 22 13:15:03.684231 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:03.684216    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745435-jzr79"
Jul 22 13:15:03.684342 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:03.684263    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745435-jzr79" event={"ID":"5f83750f-1d94-4ac5-812f-0d8fe65d81c7","Type":"ContainerDied","Data":"014ab91b81db3f92a178ecc7fe5947133f9e2b38a59b837d512c4a42d6b350bf"}
Jul 22 13:15:03.684342 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:03.684313    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="014ab91b81db3f92a178ecc7fe5947133f9e2b38a59b837d512c4a42d6b350bf"
Jul 22 13:15:16.896987 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:16.896956    2556 scope.go:117] "RemoveContainer" containerID="0848a91364ee53561acdacbc054e0afb0a8cb8c63f4d37f086ccdc9fa41021f4"
Jul 22 13:15:17.763660 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:17.763616    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg" event={"ID":"f71dc75c-e562-4d12-8b72-24a801dbd756","Type":"ContainerStarted","Data":"efe069a8449a21e12f4c62a1e769d7dd0fc41a667eeb39a1270a1982ac55c4c1"}
Jul 22 13:15:17.779957 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:17.779902    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg" podStartSLOduration=17.779886193 podStartE2EDuration="17.779886193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:15:17.777799606 +0000 UTC m=+2280.418045848" watchObservedRunningTime="2026-07-22 13:15:17.779886193 +0000 UTC m=+2280.420132433"
Jul 22 13:15:18.100156 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:18.100126    2556 scope.go:117] "RemoveContainer" containerID="76cabc6b7d190988d88a2bd0ae9877d6c2bb22eeb902b7eff28976fad504cb89"
Jul 22 13:15:18.770547 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:18.770503    2556 generic.go:356] "Generic (PLEG): container finished" podID="f71dc75c-e562-4d12-8b72-24a801dbd756" containerID="efe069a8449a21e12f4c62a1e769d7dd0fc41a667eeb39a1270a1982ac55c4c1" exitCode=0
Jul 22 13:15:18.770773 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:18.770568    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg" event={"ID":"f71dc75c-e562-4d12-8b72-24a801dbd756","Type":"ContainerDied","Data":"efe069a8449a21e12f4c62a1e769d7dd0fc41a667eeb39a1270a1982ac55c4c1"}
Jul 22 13:15:18.770773 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:18.770640    2556 scope.go:117] "RemoveContainer" containerID="0848a91364ee53561acdacbc054e0afb0a8cb8c63f4d37f086ccdc9fa41021f4"
Jul 22 13:15:18.786717 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:18.786669    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg"]
Jul 22 13:15:19.920394 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:19.920362    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg"
Jul 22 13:15:20.783006 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:20.782970    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg" event={"ID":"f71dc75c-e562-4d12-8b72-24a801dbd756","Type":"ContainerDied","Data":"42334184c16e39f1881e65136bcc7cbff803bad7c091f6dbb83d3757f41baeb9"}
Jul 22 13:15:20.783220 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:20.783029    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42334184c16e39f1881e65136bcc7cbff803bad7c091f6dbb83d3757f41baeb9"
Jul 22 13:15:20.783220 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:20.782981    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg"
Jul 22 13:15:20.811530 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:20.811495    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg"]
Jul 22 13:15:20.815358 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:20.815333    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-c5ea07-29745435-vhwwg"]
Jul 22 13:15:21.902318 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:15:21.902281    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f71dc75c-e562-4d12-8b72-24a801dbd756" path="/var/lib/kubelet/pods/f71dc75c-e562-4d12-8b72-24a801dbd756/volumes"
Jul 22 13:16:09.910144 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:09.910061    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm"]
Jul 22 13:16:09.910611 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:09.910474    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f71dc75c-e562-4d12-8b72-24a801dbd756" containerName="cleanup"
Jul 22 13:16:09.910611 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:09.910487    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f71dc75c-e562-4d12-8b72-24a801dbd756" containerName="cleanup"
Jul 22 13:16:09.910611 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:09.910496    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f456ea3d-44a9-4d42-ac93-1efcfd8bf4fb" containerName="cleanup"
Jul 22 13:16:09.910611 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:09.910502    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f456ea3d-44a9-4d42-ac93-1efcfd8bf4fb" containerName="cleanup"
Jul 22 13:16:09.910611 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:09.910509    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f83750f-1d94-4ac5-812f-0d8fe65d81c7" containerName="cleanup"
Jul 22 13:16:09.910611 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:09.910515    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f83750f-1d94-4ac5-812f-0d8fe65d81c7" containerName="cleanup"
Jul 22 13:16:09.910611 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:09.910526    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f71dc75c-e562-4d12-8b72-24a801dbd756" containerName="cleanup"
Jul 22 13:16:09.910611 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:09.910532    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f71dc75c-e562-4d12-8b72-24a801dbd756" containerName="cleanup"
Jul 22 13:16:09.910611 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:09.910608    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f71dc75c-e562-4d12-8b72-24a801dbd756" containerName="cleanup"
Jul 22 13:16:09.910611 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:09.910617    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f456ea3d-44a9-4d42-ac93-1efcfd8bf4fb" containerName="cleanup"
Jul 22 13:16:09.911006 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:09.910624    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f71dc75c-e562-4d12-8b72-24a801dbd756" containerName="cleanup"
Jul 22 13:16:09.911006 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:09.910634    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f83750f-1d94-4ac5-812f-0d8fe65d81c7" containerName="cleanup"
Jul 22 13:16:09.913792 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:09.913777    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm"
Jul 22 13:16:09.916617 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:09.916592    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qrrb5\""
Jul 22 13:16:09.925095 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:09.925069    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm"]
Jul 22 13:16:10.029867 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:10.029833    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/386be4f4-375d-4942-ae2c-98d6caae194c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm\" (UID: \"386be4f4-375d-4942-ae2c-98d6caae194c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm"
Jul 22 13:16:10.131026 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:10.130997    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/386be4f4-375d-4942-ae2c-98d6caae194c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm\" (UID: \"386be4f4-375d-4942-ae2c-98d6caae194c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm"
Jul 22 13:16:10.131634 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:10.131612    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/386be4f4-375d-4942-ae2c-98d6caae194c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm\" (UID: \"386be4f4-375d-4942-ae2c-98d6caae194c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm"
Jul 22 13:16:10.224256 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:10.224154    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm"
Jul 22 13:16:10.374922 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:10.374813    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm"]
Jul 22 13:16:10.380498 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:16:10.380470    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386be4f4_375d_4942_ae2c_98d6caae194c.slice/crio-e366c1e275e98ab6d4a9f2f252322c2d383e0064d99c1d5f5d618370f1dd9e58 WatchSource:0}: Error finding container e366c1e275e98ab6d4a9f2f252322c2d383e0064d99c1d5f5d618370f1dd9e58: Status 404 returned error can't find the container with id e366c1e275e98ab6d4a9f2f252322c2d383e0064d99c1d5f5d618370f1dd9e58
Jul 22 13:16:11.048782 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:11.048748    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm" event={"ID":"386be4f4-375d-4942-ae2c-98d6caae194c","Type":"ContainerStarted","Data":"1f6f96b58b55a0ecb0652ea469921e2665b42e1c368fd59c0c21934e037f8e5e"}
Jul 22 13:16:11.049149 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:11.048820    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm" event={"ID":"386be4f4-375d-4942-ae2c-98d6caae194c","Type":"ContainerStarted","Data":"e366c1e275e98ab6d4a9f2f252322c2d383e0064d99c1d5f5d618370f1dd9e58"}
Jul 22 13:16:11.077536 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:11.077478    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm" podStartSLOduration=2.0774586839999998 podStartE2EDuration="2.077458684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:16:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:16:11.074737156 +0000 UTC m=+2333.714983398" watchObservedRunningTime="2026-07-22 13:16:11.077458684 +0000 UTC m=+2333.717704924"
Jul 22 13:16:12.056006 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:12.055969    2556 generic.go:356] "Generic (PLEG): container finished" podID="386be4f4-375d-4942-ae2c-98d6caae194c" containerID="1f6f96b58b55a0ecb0652ea469921e2665b42e1c368fd59c0c21934e037f8e5e" exitCode=0
Jul 22 13:16:12.056412 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:12.056046    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm" event={"ID":"386be4f4-375d-4942-ae2c-98d6caae194c","Type":"ContainerDied","Data":"1f6f96b58b55a0ecb0652ea469921e2665b42e1c368fd59c0c21934e037f8e5e"}
Jul 22 13:16:13.194853 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:13.194827    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm"
Jul 22 13:16:13.362701 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:13.362577    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/386be4f4-375d-4942-ae2c-98d6caae194c-maas-api-service-ca\") pod \"386be4f4-375d-4942-ae2c-98d6caae194c\" (UID: \"386be4f4-375d-4942-ae2c-98d6caae194c\") "
Jul 22 13:16:13.363023 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:13.362996    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/386be4f4-375d-4942-ae2c-98d6caae194c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "386be4f4-375d-4942-ae2c-98d6caae194c" (UID: "386be4f4-375d-4942-ae2c-98d6caae194c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:16:13.463602 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:13.463554    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/386be4f4-375d-4942-ae2c-98d6caae194c-maas-api-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:16:14.069148 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:14.069119    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm"
Jul 22 13:16:14.069322 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:14.069143    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm" event={"ID":"386be4f4-375d-4942-ae2c-98d6caae194c","Type":"ContainerDied","Data":"e366c1e275e98ab6d4a9f2f252322c2d383e0064d99c1d5f5d618370f1dd9e58"}
Jul 22 13:16:14.069322 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:14.069193    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e366c1e275e98ab6d4a9f2f252322c2d383e0064d99c1d5f5d618370f1dd9e58"
Jul 22 13:16:20.369324 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:20.369291    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"]
Jul 22 13:16:20.371818 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:20.369485    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89" podUID="55002a36-0347-4d30-89ab-85714298bb68" containerName="maas-api" containerID="cri-o://e910132f08e8d8a5887484c1cce943f2b726f50d3dbd2a5ff869464a6685989a" gracePeriod=30
Jul 22 13:16:20.388284 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:20.388256    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6b8164-29745435-7zzq4"]
Jul 22 13:16:20.391237 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:20.391208    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-6b8164-29745435-7zzq4"]
Jul 22 13:16:20.622965 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:20.622895    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"
Jul 22 13:16:20.731278 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:20.731244    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hs4vr\" (UniqueName: \"kubernetes.io/projected/55002a36-0347-4d30-89ab-85714298bb68-kube-api-access-hs4vr\") pod \"55002a36-0347-4d30-89ab-85714298bb68\" (UID: \"55002a36-0347-4d30-89ab-85714298bb68\") "
Jul 22 13:16:20.731483 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:20.731310    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55002a36-0347-4d30-89ab-85714298bb68-openshift-service-ca\") pod \"55002a36-0347-4d30-89ab-85714298bb68\" (UID: \"55002a36-0347-4d30-89ab-85714298bb68\") "
Jul 22 13:16:20.731483 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:20.731354    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55002a36-0347-4d30-89ab-85714298bb68-maas-api-tls\") pod \"55002a36-0347-4d30-89ab-85714298bb68\" (UID: \"55002a36-0347-4d30-89ab-85714298bb68\") "
Jul 22 13:16:20.731780 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:20.731748    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55002a36-0347-4d30-89ab-85714298bb68-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "55002a36-0347-4d30-89ab-85714298bb68" (UID: "55002a36-0347-4d30-89ab-85714298bb68"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:16:20.733639 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:20.733607    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55002a36-0347-4d30-89ab-85714298bb68-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "55002a36-0347-4d30-89ab-85714298bb68" (UID: "55002a36-0347-4d30-89ab-85714298bb68"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:16:20.733759 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:20.733659    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55002a36-0347-4d30-89ab-85714298bb68-kube-api-access-hs4vr" (OuterVolumeSpecName: "kube-api-access-hs4vr") pod "55002a36-0347-4d30-89ab-85714298bb68" (UID: "55002a36-0347-4d30-89ab-85714298bb68"). InnerVolumeSpecName "kube-api-access-hs4vr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:16:20.832970 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:20.832926    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs4vr\" (UniqueName: \"kubernetes.io/projected/55002a36-0347-4d30-89ab-85714298bb68-kube-api-access-hs4vr\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:16:20.832970 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:20.832964    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55002a36-0347-4d30-89ab-85714298bb68-openshift-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:16:20.832970 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:20.832976    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55002a36-0347-4d30-89ab-85714298bb68-maas-api-tls\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:16:21.110962 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:21.110924    2556 generic.go:356] "Generic (PLEG): container finished" podID="55002a36-0347-4d30-89ab-85714298bb68" containerID="e910132f08e8d8a5887484c1cce943f2b726f50d3dbd2a5ff869464a6685989a" exitCode=0
Jul 22 13:16:21.111150 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:21.110970    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"
Jul 22 13:16:21.111150 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:21.111013    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89" event={"ID":"55002a36-0347-4d30-89ab-85714298bb68","Type":"ContainerDied","Data":"e910132f08e8d8a5887484c1cce943f2b726f50d3dbd2a5ff869464a6685989a"}
Jul 22 13:16:21.111150 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:21.111063    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89" event={"ID":"55002a36-0347-4d30-89ab-85714298bb68","Type":"ContainerDied","Data":"a4fdba69f81d73beef45565c70c641cae284fefabe47abe3fa4067c1c7a9acd7"}
Jul 22 13:16:21.111150 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:21.111086    2556 scope.go:117] "RemoveContainer" containerID="e910132f08e8d8a5887484c1cce943f2b726f50d3dbd2a5ff869464a6685989a"
Jul 22 13:16:21.120587 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:21.120562    2556 scope.go:117] "RemoveContainer" containerID="e910132f08e8d8a5887484c1cce943f2b726f50d3dbd2a5ff869464a6685989a"
Jul 22 13:16:21.120959 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:16:21.120891    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e910132f08e8d8a5887484c1cce943f2b726f50d3dbd2a5ff869464a6685989a\": container with ID starting with e910132f08e8d8a5887484c1cce943f2b726f50d3dbd2a5ff869464a6685989a not found: ID does not exist" containerID="e910132f08e8d8a5887484c1cce943f2b726f50d3dbd2a5ff869464a6685989a"
Jul 22 13:16:21.121059 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:21.120969    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e910132f08e8d8a5887484c1cce943f2b726f50d3dbd2a5ff869464a6685989a"} err="failed to get container status \"e910132f08e8d8a5887484c1cce943f2b726f50d3dbd2a5ff869464a6685989a\": rpc error: code = NotFound desc = could not find container \"e910132f08e8d8a5887484c1cce943f2b726f50d3dbd2a5ff869464a6685989a\": container with ID starting with e910132f08e8d8a5887484c1cce943f2b726f50d3dbd2a5ff869464a6685989a not found: ID does not exist"
Jul 22 13:16:21.134835 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:21.134807    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"]
Jul 22 13:16:21.139287 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:21.139261    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6b8164-5594d6496c-c4t89"]
Jul 22 13:16:21.902833 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:21.902797    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55002a36-0347-4d30-89ab-85714298bb68" path="/var/lib/kubelet/pods/55002a36-0347-4d30-89ab-85714298bb68/volumes"
Jul 22 13:16:21.903197 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:21.903100    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f456ea3d-44a9-4d42-ac93-1efcfd8bf4fb" path="/var/lib/kubelet/pods/f456ea3d-44a9-4d42-ac93-1efcfd8bf4fb/volumes"
Jul 22 13:16:24.992962 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:24.992926    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm"]
Jul 22 13:16:24.995251 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:24.995229    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6b8164-5whzm"]
Jul 22 13:16:25.901739 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:25.901701    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="386be4f4-375d-4942-ae2c-98d6caae194c" path="/var/lib/kubelet/pods/386be4f4-375d-4942-ae2c-98d6caae194c/volumes"
Jul 22 13:16:31.904132 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:31.904102    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c5ea07-5x6cr"]
Jul 22 13:16:31.904523 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:31.904471    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="386be4f4-375d-4942-ae2c-98d6caae194c" containerName="revoke-keys"
Jul 22 13:16:31.904523 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:31.904482    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="386be4f4-375d-4942-ae2c-98d6caae194c" containerName="revoke-keys"
Jul 22 13:16:31.904523 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:31.904491    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55002a36-0347-4d30-89ab-85714298bb68" containerName="maas-api"
Jul 22 13:16:31.904523 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:31.904496    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="55002a36-0347-4d30-89ab-85714298bb68" containerName="maas-api"
Jul 22 13:16:31.904523 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:31.904507    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f71dc75c-e562-4d12-8b72-24a801dbd756" containerName="cleanup"
Jul 22 13:16:31.904523 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:31.904512    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f71dc75c-e562-4d12-8b72-24a801dbd756" containerName="cleanup"
Jul 22 13:16:31.904730 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:31.904571    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="386be4f4-375d-4942-ae2c-98d6caae194c" containerName="revoke-keys"
Jul 22 13:16:31.904730 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:31.904580    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f71dc75c-e562-4d12-8b72-24a801dbd756" containerName="cleanup"
Jul 22 13:16:31.904730 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:31.904590    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="55002a36-0347-4d30-89ab-85714298bb68" containerName="maas-api"
Jul 22 13:16:31.908867 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:31.908845    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c5ea07-5x6cr"
Jul 22 13:16:31.911755 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:31.911737    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qrrb5\""
Jul 22 13:16:31.916010 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:31.915968    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c5ea07-5x6cr"]
Jul 22 13:16:32.039302 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:32.039254    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b155eb8f-94f2-490b-bacb-fa0f34e6933b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c5ea07-5x6cr\" (UID: \"b155eb8f-94f2-490b-bacb-fa0f34e6933b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c5ea07-5x6cr"
Jul 22 13:16:32.140180 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:32.140133    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b155eb8f-94f2-490b-bacb-fa0f34e6933b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c5ea07-5x6cr\" (UID: \"b155eb8f-94f2-490b-bacb-fa0f34e6933b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c5ea07-5x6cr"
Jul 22 13:16:32.140787 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:32.140766    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b155eb8f-94f2-490b-bacb-fa0f34e6933b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c5ea07-5x6cr\" (UID: \"b155eb8f-94f2-490b-bacb-fa0f34e6933b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c5ea07-5x6cr"
Jul 22 13:16:32.221319 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:32.221227    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c5ea07-5x6cr"
Jul 22 13:16:32.362551 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:32.362524    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c5ea07-5x6cr"]
Jul 22 13:16:32.365328 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:16:32.365298    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb155eb8f_94f2_490b_bacb_fa0f34e6933b.slice/crio-82e27da53ddc669e51209e320598529a6692a47de1067e231402dcfaae84ca1e WatchSource:0}: Error finding container 82e27da53ddc669e51209e320598529a6692a47de1067e231402dcfaae84ca1e: Status 404 returned error can't find the container with id 82e27da53ddc669e51209e320598529a6692a47de1067e231402dcfaae84ca1e
Jul 22 13:16:33.174543 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:33.174502    2556 generic.go:356] "Generic (PLEG): container finished" podID="b155eb8f-94f2-490b-bacb-fa0f34e6933b" containerID="7ea6890b2b89d54c6dfb31a6afa949bf57e05e59d0979af52d2f1f498bd98fad" exitCode=0
Jul 22 13:16:33.174986 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:33.174592    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c5ea07-5x6cr" event={"ID":"b155eb8f-94f2-490b-bacb-fa0f34e6933b","Type":"ContainerDied","Data":"7ea6890b2b89d54c6dfb31a6afa949bf57e05e59d0979af52d2f1f498bd98fad"}
Jul 22 13:16:33.174986 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:33.174660    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c5ea07-5x6cr" event={"ID":"b155eb8f-94f2-490b-bacb-fa0f34e6933b","Type":"ContainerStarted","Data":"82e27da53ddc669e51209e320598529a6692a47de1067e231402dcfaae84ca1e"}
Jul 22 13:16:34.320027 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:34.319999    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c5ea07-5x6cr"
Jul 22 13:16:34.460417 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:34.460327    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b155eb8f-94f2-490b-bacb-fa0f34e6933b-maas-api-service-ca\") pod \"b155eb8f-94f2-490b-bacb-fa0f34e6933b\" (UID: \"b155eb8f-94f2-490b-bacb-fa0f34e6933b\") "
Jul 22 13:16:34.460695 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:34.460656    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b155eb8f-94f2-490b-bacb-fa0f34e6933b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b155eb8f-94f2-490b-bacb-fa0f34e6933b" (UID: "b155eb8f-94f2-490b-bacb-fa0f34e6933b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:16:34.561046 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:34.561012    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b155eb8f-94f2-490b-bacb-fa0f34e6933b-maas-api-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:16:35.186415 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:35.186372    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c5ea07-5x6cr" event={"ID":"b155eb8f-94f2-490b-bacb-fa0f34e6933b","Type":"ContainerDied","Data":"82e27da53ddc669e51209e320598529a6692a47de1067e231402dcfaae84ca1e"}
Jul 22 13:16:35.186591 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:35.186423    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82e27da53ddc669e51209e320598529a6692a47de1067e231402dcfaae84ca1e"
Jul 22 13:16:35.186591 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:35.186387    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c5ea07-5x6cr"
Jul 22 13:16:42.502284 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:42.502247    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"]
Jul 22 13:16:42.502922 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:42.502559    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm" podUID="820adec9-e1a5-4e25-8271-662d9f0bbd46" containerName="maas-api" containerID="cri-o://256b444f32e9df3efc3429c028d348cd4fed236fb2a925316bf6cdd638057337" gracePeriod=30
Jul 22 13:16:42.633451 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:42.633408    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm" podUID="820adec9-e1a5-4e25-8271-662d9f0bbd46" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.47:8443/health\": dial tcp 10.133.0.47:8443: connect: connection refused"
Jul 22 13:16:42.760497 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:42.760430    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"
Jul 22 13:16:42.843146 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:42.843108    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/820adec9-e1a5-4e25-8271-662d9f0bbd46-openshift-service-ca\") pod \"820adec9-e1a5-4e25-8271-662d9f0bbd46\" (UID: \"820adec9-e1a5-4e25-8271-662d9f0bbd46\") "
Jul 22 13:16:42.843349 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:42.843176    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrlvs\" (UniqueName: \"kubernetes.io/projected/820adec9-e1a5-4e25-8271-662d9f0bbd46-kube-api-access-wrlvs\") pod \"820adec9-e1a5-4e25-8271-662d9f0bbd46\" (UID: \"820adec9-e1a5-4e25-8271-662d9f0bbd46\") "
Jul 22 13:16:42.843349 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:42.843253    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/820adec9-e1a5-4e25-8271-662d9f0bbd46-maas-api-tls\") pod \"820adec9-e1a5-4e25-8271-662d9f0bbd46\" (UID: \"820adec9-e1a5-4e25-8271-662d9f0bbd46\") "
Jul 22 13:16:42.843556 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:42.843531    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/820adec9-e1a5-4e25-8271-662d9f0bbd46-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "820adec9-e1a5-4e25-8271-662d9f0bbd46" (UID: "820adec9-e1a5-4e25-8271-662d9f0bbd46"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:16:42.845573 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:42.845538    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/820adec9-e1a5-4e25-8271-662d9f0bbd46-kube-api-access-wrlvs" (OuterVolumeSpecName: "kube-api-access-wrlvs") pod "820adec9-e1a5-4e25-8271-662d9f0bbd46" (UID: "820adec9-e1a5-4e25-8271-662d9f0bbd46"). InnerVolumeSpecName "kube-api-access-wrlvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:16:42.845724 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:42.845614    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820adec9-e1a5-4e25-8271-662d9f0bbd46-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "820adec9-e1a5-4e25-8271-662d9f0bbd46" (UID: "820adec9-e1a5-4e25-8271-662d9f0bbd46"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:16:42.944792 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:42.944749    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrlvs\" (UniqueName: \"kubernetes.io/projected/820adec9-e1a5-4e25-8271-662d9f0bbd46-kube-api-access-wrlvs\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:16:42.944792 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:42.944787    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/820adec9-e1a5-4e25-8271-662d9f0bbd46-maas-api-tls\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:16:42.944792 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:42.944796    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/820adec9-e1a5-4e25-8271-662d9f0bbd46-openshift-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:16:43.228376 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:43.228337    2556 generic.go:356] "Generic (PLEG): container finished" podID="820adec9-e1a5-4e25-8271-662d9f0bbd46" containerID="256b444f32e9df3efc3429c028d348cd4fed236fb2a925316bf6cdd638057337" exitCode=0
Jul 22 13:16:43.228529 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:43.228388    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"
Jul 22 13:16:43.228529 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:43.228418    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm" event={"ID":"820adec9-e1a5-4e25-8271-662d9f0bbd46","Type":"ContainerDied","Data":"256b444f32e9df3efc3429c028d348cd4fed236fb2a925316bf6cdd638057337"}
Jul 22 13:16:43.228529 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:43.228474    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm" event={"ID":"820adec9-e1a5-4e25-8271-662d9f0bbd46","Type":"ContainerDied","Data":"e6ba73211b636308d5fadb9a152538b855e3a5cd307613392edd652fb22f7399"}
Jul 22 13:16:43.228529 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:43.228496    2556 scope.go:117] "RemoveContainer" containerID="256b444f32e9df3efc3429c028d348cd4fed236fb2a925316bf6cdd638057337"
Jul 22 13:16:43.238660 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:43.238639    2556 scope.go:117] "RemoveContainer" containerID="256b444f32e9df3efc3429c028d348cd4fed236fb2a925316bf6cdd638057337"
Jul 22 13:16:43.239021 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:16:43.239003    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"256b444f32e9df3efc3429c028d348cd4fed236fb2a925316bf6cdd638057337\": container with ID starting with 256b444f32e9df3efc3429c028d348cd4fed236fb2a925316bf6cdd638057337 not found: ID does not exist" containerID="256b444f32e9df3efc3429c028d348cd4fed236fb2a925316bf6cdd638057337"
Jul 22 13:16:43.239094 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:43.239031    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"256b444f32e9df3efc3429c028d348cd4fed236fb2a925316bf6cdd638057337"} err="failed to get container status \"256b444f32e9df3efc3429c028d348cd4fed236fb2a925316bf6cdd638057337\": rpc error: code = NotFound desc = could not find container \"256b444f32e9df3efc3429c028d348cd4fed236fb2a925316bf6cdd638057337\": container with ID starting with 256b444f32e9df3efc3429c028d348cd4fed236fb2a925316bf6cdd638057337 not found: ID does not exist"
Jul 22 13:16:43.252358 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:43.252327    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"]
Jul 22 13:16:43.255807 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:43.255782    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c5ea07-6598744c8b-8pvjm"]
Jul 22 13:16:43.901889 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:43.901854    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="820adec9-e1a5-4e25-8271-662d9f0bbd46" path="/var/lib/kubelet/pods/820adec9-e1a5-4e25-8271-662d9f0bbd46/volumes"
Jul 22 13:16:46.992916 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:46.992877    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c5ea07-5x6cr"]
Jul 22 13:16:46.996860 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:46.996833    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c5ea07-5x6cr"]
Jul 22 13:16:47.901689 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:47.901638    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b155eb8f-94f2-490b-bacb-fa0f34e6933b" path="/var/lib/kubelet/pods/b155eb8f-94f2-490b-bacb-fa0f34e6933b/volumes"
Jul 22 13:16:57.735114 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.735081    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"]
Jul 22 13:16:57.735571 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.735435    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820adec9-e1a5-4e25-8271-662d9f0bbd46" containerName="maas-api"
Jul 22 13:16:57.735571 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.735446    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="820adec9-e1a5-4e25-8271-662d9f0bbd46" containerName="maas-api"
Jul 22 13:16:57.735571 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.735456    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b155eb8f-94f2-490b-bacb-fa0f34e6933b" containerName="revoke-keys"
Jul 22 13:16:57.735571 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.735461    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b155eb8f-94f2-490b-bacb-fa0f34e6933b" containerName="revoke-keys"
Jul 22 13:16:57.735571 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.735527    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b155eb8f-94f2-490b-bacb-fa0f34e6933b" containerName="revoke-keys"
Jul 22 13:16:57.735571 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.735534    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="820adec9-e1a5-4e25-8271-662d9f0bbd46" containerName="maas-api"
Jul 22 13:16:57.738502 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.738484    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"
Jul 22 13:16:57.741204 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.741175    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 13:16:57.741380 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.741357    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-266bd1-serving-cert\""
Jul 22 13:16:57.741458 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.741446    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 13:16:57.742383 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.742364    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8dbk8\""
Jul 22 13:16:57.749961 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.749933    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"]
Jul 22 13:16:57.788771 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.788738    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a170bd4b-6e59-4947-9074-1a09ad2f309a-openshift-service-ca\") pod \"maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs\" (UID: \"a170bd4b-6e59-4947-9074-1a09ad2f309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"
Jul 22 13:16:57.788771 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.788773    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a170bd4b-6e59-4947-9074-1a09ad2f309a-maas-api-tls\") pod \"maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs\" (UID: \"a170bd4b-6e59-4947-9074-1a09ad2f309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"
Jul 22 13:16:57.789057 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.788800    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48phm\" (UniqueName: \"kubernetes.io/projected/a170bd4b-6e59-4947-9074-1a09ad2f309a-kube-api-access-48phm\") pod \"maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs\" (UID: \"a170bd4b-6e59-4947-9074-1a09ad2f309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"
Jul 22 13:16:57.889854 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.889824    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a170bd4b-6e59-4947-9074-1a09ad2f309a-openshift-service-ca\") pod \"maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs\" (UID: \"a170bd4b-6e59-4947-9074-1a09ad2f309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"
Jul 22 13:16:57.889854 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.889858    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a170bd4b-6e59-4947-9074-1a09ad2f309a-maas-api-tls\") pod \"maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs\" (UID: \"a170bd4b-6e59-4947-9074-1a09ad2f309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"
Jul 22 13:16:57.890128 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.889878    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48phm\" (UniqueName: \"kubernetes.io/projected/a170bd4b-6e59-4947-9074-1a09ad2f309a-kube-api-access-48phm\") pod \"maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs\" (UID: \"a170bd4b-6e59-4947-9074-1a09ad2f309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"
Jul 22 13:16:57.890128 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:16:57.889989    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-serving-cert: secret "maas-api-e2e-api-a-266bd1-serving-cert" not found
Jul 22 13:16:57.890128 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:16:57.890066    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a170bd4b-6e59-4947-9074-1a09ad2f309a-maas-api-tls podName:a170bd4b-6e59-4947-9074-1a09ad2f309a nodeName:}" failed. No retries permitted until 2026-07-22 13:16:58.390048973 +0000 UTC m=+2381.030295194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a170bd4b-6e59-4947-9074-1a09ad2f309a-maas-api-tls") pod "maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs" (UID: "a170bd4b-6e59-4947-9074-1a09ad2f309a") : secret "maas-api-e2e-api-a-266bd1-serving-cert" not found
Jul 22 13:16:57.890552 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.890529    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a170bd4b-6e59-4947-9074-1a09ad2f309a-openshift-service-ca\") pod \"maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs\" (UID: \"a170bd4b-6e59-4947-9074-1a09ad2f309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"
Jul 22 13:16:57.899348 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:57.899327    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48phm\" (UniqueName: \"kubernetes.io/projected/a170bd4b-6e59-4947-9074-1a09ad2f309a-kube-api-access-48phm\") pod \"maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs\" (UID: \"a170bd4b-6e59-4947-9074-1a09ad2f309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"
Jul 22 13:16:58.393609 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:58.393567    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a170bd4b-6e59-4947-9074-1a09ad2f309a-maas-api-tls\") pod \"maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs\" (UID: \"a170bd4b-6e59-4947-9074-1a09ad2f309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"
Jul 22 13:16:58.396502 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:58.396467    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a170bd4b-6e59-4947-9074-1a09ad2f309a-maas-api-tls\") pod \"maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs\" (UID: \"a170bd4b-6e59-4947-9074-1a09ad2f309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"
Jul 22 13:16:58.652051 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:58.651948    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"
Jul 22 13:16:58.791891 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:58.791860    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"]
Jul 22 13:16:58.795131 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:16:58.795100    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda170bd4b_6e59_4947_9074_1a09ad2f309a.slice/crio-3f558d5387e10e6075b1c9d9628ce6c2c5a47b7aee5eb1d1aa6ee427d501b1b8 WatchSource:0}: Error finding container 3f558d5387e10e6075b1c9d9628ce6c2c5a47b7aee5eb1d1aa6ee427d501b1b8: Status 404 returned error can't find the container with id 3f558d5387e10e6075b1c9d9628ce6c2c5a47b7aee5eb1d1aa6ee427d501b1b8
Jul 22 13:16:59.314892 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:16:59.314859    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs" event={"ID":"a170bd4b-6e59-4947-9074-1a09ad2f309a","Type":"ContainerStarted","Data":"3f558d5387e10e6075b1c9d9628ce6c2c5a47b7aee5eb1d1aa6ee427d501b1b8"}
Jul 22 13:17:02.331955 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:02.331916    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs" event={"ID":"a170bd4b-6e59-4947-9074-1a09ad2f309a","Type":"ContainerStarted","Data":"556c49b4afcb85f7b2969e5f413e75c8ffa22b8ea7920c7e60a6df459bf8b4ec"}
Jul 22 13:17:02.332370 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:02.332024    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"
Jul 22 13:17:02.354040 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:02.353988    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs" podStartSLOduration=1.92091894 podStartE2EDuration="5.353968783s" totalImagesPullingTime="3.433049843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:16:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:17:02.352899797 +0000 UTC m=+2384.993146043" watchObservedRunningTime="2026-07-22 13:17:02.353968783 +0000 UTC m=+2384.994215023"
Jul 22 13:17:05.784518 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:05.784478    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"]
Jul 22 13:17:05.788908 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:05.788879    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"
Jul 22 13:17:05.791770 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:05.791748    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-0d04d7-serving-cert\""
Jul 22 13:17:05.800484 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:05.800453    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"]
Jul 22 13:17:05.854007 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:05.853965    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60b2314d-50ba-41b8-8449-2ceb24fac530-openshift-service-ca\") pod \"maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk\" (UID: \"60b2314d-50ba-41b8-8449-2ceb24fac530\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"
Jul 22 13:17:05.854205 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:05.854030    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgh6t\" (UniqueName: \"kubernetes.io/projected/60b2314d-50ba-41b8-8449-2ceb24fac530-kube-api-access-xgh6t\") pod \"maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk\" (UID: \"60b2314d-50ba-41b8-8449-2ceb24fac530\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"
Jul 22 13:17:05.854205 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:05.854085    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60b2314d-50ba-41b8-8449-2ceb24fac530-maas-api-tls\") pod \"maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk\" (UID: \"60b2314d-50ba-41b8-8449-2ceb24fac530\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"
Jul 22 13:17:05.954890 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:05.954836    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60b2314d-50ba-41b8-8449-2ceb24fac530-openshift-service-ca\") pod \"maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk\" (UID: \"60b2314d-50ba-41b8-8449-2ceb24fac530\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"
Jul 22 13:17:05.955078 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:05.954995    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgh6t\" (UniqueName: \"kubernetes.io/projected/60b2314d-50ba-41b8-8449-2ceb24fac530-kube-api-access-xgh6t\") pod \"maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk\" (UID: \"60b2314d-50ba-41b8-8449-2ceb24fac530\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"
Jul 22 13:17:05.955078 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:05.955053    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60b2314d-50ba-41b8-8449-2ceb24fac530-maas-api-tls\") pod \"maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk\" (UID: \"60b2314d-50ba-41b8-8449-2ceb24fac530\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"
Jul 22 13:17:05.955272 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:17:05.955248    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-serving-cert: secret "maas-api-e2e-api-b-0d04d7-serving-cert" not found
Jul 22 13:17:05.955356 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:17:05.955335    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60b2314d-50ba-41b8-8449-2ceb24fac530-maas-api-tls podName:60b2314d-50ba-41b8-8449-2ceb24fac530 nodeName:}" failed. No retries permitted until 2026-07-22 13:17:06.455314582 +0000 UTC m=+2389.095560809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/60b2314d-50ba-41b8-8449-2ceb24fac530-maas-api-tls") pod "maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk" (UID: "60b2314d-50ba-41b8-8449-2ceb24fac530") : secret "maas-api-e2e-api-b-0d04d7-serving-cert" not found
Jul 22 13:17:05.955602 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:05.955584    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60b2314d-50ba-41b8-8449-2ceb24fac530-openshift-service-ca\") pod \"maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk\" (UID: \"60b2314d-50ba-41b8-8449-2ceb24fac530\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"
Jul 22 13:17:05.967305 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:05.967267    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgh6t\" (UniqueName: \"kubernetes.io/projected/60b2314d-50ba-41b8-8449-2ceb24fac530-kube-api-access-xgh6t\") pod \"maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk\" (UID: \"60b2314d-50ba-41b8-8449-2ceb24fac530\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"
Jul 22 13:17:06.460024 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:06.459986    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60b2314d-50ba-41b8-8449-2ceb24fac530-maas-api-tls\") pod \"maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk\" (UID: \"60b2314d-50ba-41b8-8449-2ceb24fac530\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"
Jul 22 13:17:06.462841 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:06.462810    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60b2314d-50ba-41b8-8449-2ceb24fac530-maas-api-tls\") pod \"maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk\" (UID: \"60b2314d-50ba-41b8-8449-2ceb24fac530\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"
Jul 22 13:17:06.701850 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:06.701818    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"
Jul 22 13:17:06.848483 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:06.848452    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"]
Jul 22 13:17:06.850856 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:17:06.850816    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60b2314d_50ba_41b8_8449_2ceb24fac530.slice/crio-1348c1ff0150d14e3fbd8cb3ac208aeeb081b1c6ea5550e7fc16c29050d88244 WatchSource:0}: Error finding container 1348c1ff0150d14e3fbd8cb3ac208aeeb081b1c6ea5550e7fc16c29050d88244: Status 404 returned error can't find the container with id 1348c1ff0150d14e3fbd8cb3ac208aeeb081b1c6ea5550e7fc16c29050d88244
Jul 22 13:17:07.360734 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:07.360696    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk" event={"ID":"60b2314d-50ba-41b8-8449-2ceb24fac530","Type":"ContainerStarted","Data":"10709a7aa26d7ba059a6419476919dd58381989334fa0cfd8831ea3fb9418f41"}
Jul 22 13:17:07.360933 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:07.360759    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk" event={"ID":"60b2314d-50ba-41b8-8449-2ceb24fac530","Type":"ContainerStarted","Data":"1348c1ff0150d14e3fbd8cb3ac208aeeb081b1c6ea5550e7fc16c29050d88244"}
Jul 22 13:17:07.360933 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:07.360826    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"
Jul 22 13:17:07.380025 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:07.379977    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk" podStartSLOduration=1.985286061 podStartE2EDuration="2.37996037s" totalImagesPullingTime="394.674309ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:17:07.377983661 +0000 UTC m=+2390.018229939" watchObservedRunningTime="2026-07-22 13:17:07.37996037 +0000 UTC m=+2390.020206610"
Jul 22 13:17:08.342784 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:08.342755    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"
Jul 22 13:17:13.371401 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:13.371371    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"
Jul 22 13:17:17.993092 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:17.993067    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 13:17:17.996387 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:17.996358    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 13:17:18.001663 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:18.001647    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 13:17:18.005011 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:18.004993    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 13:17:18.128831 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:18.128800    2556 scope.go:117] "RemoveContainer" containerID="aafb38c4d90b19fc9d58af1b1bce3515957c838011218298a9c76acfaab5ed53"
Jul 22 13:17:18.198205 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:18.198171    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-266bd1-5lp79"]
Jul 22 13:17:18.203508 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:18.203488    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-266bd1-5lp79"
Jul 22 13:17:18.206605 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:18.206583    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qrrb5\""
Jul 22 13:17:18.208721 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:18.208668    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-266bd1-5lp79"]
Jul 22 13:17:18.269753 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:18.269625    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5a9eb71-7095-4d45-be5f-56ecd9b01300-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-266bd1-5lp79\" (UID: \"d5a9eb71-7095-4d45-be5f-56ecd9b01300\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-266bd1-5lp79"
Jul 22 13:17:18.370380 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:18.370340    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5a9eb71-7095-4d45-be5f-56ecd9b01300-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-266bd1-5lp79\" (UID: \"d5a9eb71-7095-4d45-be5f-56ecd9b01300\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-266bd1-5lp79"
Jul 22 13:17:18.370959 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:18.370940    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5a9eb71-7095-4d45-be5f-56ecd9b01300-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-266bd1-5lp79\" (UID: \"d5a9eb71-7095-4d45-be5f-56ecd9b01300\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-266bd1-5lp79"
Jul 22 13:17:18.515293 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:18.515265    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-266bd1-5lp79"
Jul 22 13:17:18.659133 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:18.659107    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-266bd1-5lp79"]
Jul 22 13:17:18.661291 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:17:18.661262    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a9eb71_7095_4d45_be5f_56ecd9b01300.slice/crio-5ba8f8fc1e4abe1fcd73d09b6018dc0b78a968699ed0fce8d0af54aca7f9fc21 WatchSource:0}: Error finding container 5ba8f8fc1e4abe1fcd73d09b6018dc0b78a968699ed0fce8d0af54aca7f9fc21: Status 404 returned error can't find the container with id 5ba8f8fc1e4abe1fcd73d09b6018dc0b78a968699ed0fce8d0af54aca7f9fc21
Jul 22 13:17:19.426757 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:19.426717    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-266bd1-5lp79" event={"ID":"d5a9eb71-7095-4d45-be5f-56ecd9b01300","Type":"ContainerStarted","Data":"a6e703d5c7cc97ff508a4fde23af7ca9c92165a2ff999ce2b1074590804ed187"}
Jul 22 13:17:19.427158 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:19.426774    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-266bd1-5lp79" event={"ID":"d5a9eb71-7095-4d45-be5f-56ecd9b01300","Type":"ContainerStarted","Data":"5ba8f8fc1e4abe1fcd73d09b6018dc0b78a968699ed0fce8d0af54aca7f9fc21"}
Jul 22 13:17:19.445571 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:19.445502    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-266bd1-5lp79" podStartSLOduration=1.4454814360000001 podStartE2EDuration="1.445481436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:17:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:17:19.442810942 +0000 UTC m=+2402.083057187" watchObservedRunningTime="2026-07-22 13:17:19.445481436 +0000 UTC m=+2402.085727678"
Jul 22 13:17:20.439100 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:20.439061    2556 generic.go:356] "Generic (PLEG): container finished" podID="d5a9eb71-7095-4d45-be5f-56ecd9b01300" containerID="a6e703d5c7cc97ff508a4fde23af7ca9c92165a2ff999ce2b1074590804ed187" exitCode=0
Jul 22 13:17:20.439515 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:20.439150    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-266bd1-5lp79" event={"ID":"d5a9eb71-7095-4d45-be5f-56ecd9b01300","Type":"ContainerDied","Data":"a6e703d5c7cc97ff508a4fde23af7ca9c92165a2ff999ce2b1074590804ed187"}
Jul 22 13:17:21.597104 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:21.597078    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-266bd1-5lp79"
Jul 22 13:17:21.700233 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:21.700145    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5a9eb71-7095-4d45-be5f-56ecd9b01300-maas-api-service-ca\") pod \"d5a9eb71-7095-4d45-be5f-56ecd9b01300\" (UID: \"d5a9eb71-7095-4d45-be5f-56ecd9b01300\") "
Jul 22 13:17:21.700502 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:21.700478    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5a9eb71-7095-4d45-be5f-56ecd9b01300-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d5a9eb71-7095-4d45-be5f-56ecd9b01300" (UID: "d5a9eb71-7095-4d45-be5f-56ecd9b01300"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:17:21.801379 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:21.801346    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5a9eb71-7095-4d45-be5f-56ecd9b01300-maas-api-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:17:22.452884 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:22.452855    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-266bd1-5lp79"
Jul 22 13:17:22.452884 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:22.452871    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-266bd1-5lp79" event={"ID":"d5a9eb71-7095-4d45-be5f-56ecd9b01300","Type":"ContainerDied","Data":"5ba8f8fc1e4abe1fcd73d09b6018dc0b78a968699ed0fce8d0af54aca7f9fc21"}
Jul 22 13:17:22.453151 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:22.452913    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ba8f8fc1e4abe1fcd73d09b6018dc0b78a968699ed0fce8d0af54aca7f9fc21"
Jul 22 13:17:33.953039 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:33.952988    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"]
Jul 22 13:17:33.953485 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:33.953238    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs" podUID="a170bd4b-6e59-4947-9074-1a09ad2f309a" containerName="maas-api" containerID="cri-o://556c49b4afcb85f7b2969e5f413e75c8ffa22b8ea7920c7e60a6df459bf8b4ec" gracePeriod=30
Jul 22 13:17:34.207848 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.207793    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"
Jul 22 13:17:34.321419 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.321381    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a170bd4b-6e59-4947-9074-1a09ad2f309a-maas-api-tls\") pod \"a170bd4b-6e59-4947-9074-1a09ad2f309a\" (UID: \"a170bd4b-6e59-4947-9074-1a09ad2f309a\") "
Jul 22 13:17:34.321419 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.321426    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48phm\" (UniqueName: \"kubernetes.io/projected/a170bd4b-6e59-4947-9074-1a09ad2f309a-kube-api-access-48phm\") pod \"a170bd4b-6e59-4947-9074-1a09ad2f309a\" (UID: \"a170bd4b-6e59-4947-9074-1a09ad2f309a\") "
Jul 22 13:17:34.321706 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.321518    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a170bd4b-6e59-4947-9074-1a09ad2f309a-openshift-service-ca\") pod \"a170bd4b-6e59-4947-9074-1a09ad2f309a\" (UID: \"a170bd4b-6e59-4947-9074-1a09ad2f309a\") "
Jul 22 13:17:34.321922 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.321892    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a170bd4b-6e59-4947-9074-1a09ad2f309a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a170bd4b-6e59-4947-9074-1a09ad2f309a" (UID: "a170bd4b-6e59-4947-9074-1a09ad2f309a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:17:34.323688 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.323645    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a170bd4b-6e59-4947-9074-1a09ad2f309a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a170bd4b-6e59-4947-9074-1a09ad2f309a" (UID: "a170bd4b-6e59-4947-9074-1a09ad2f309a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:17:34.323778 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.323709    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a170bd4b-6e59-4947-9074-1a09ad2f309a-kube-api-access-48phm" (OuterVolumeSpecName: "kube-api-access-48phm") pod "a170bd4b-6e59-4947-9074-1a09ad2f309a" (UID: "a170bd4b-6e59-4947-9074-1a09ad2f309a"). InnerVolumeSpecName "kube-api-access-48phm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:17:34.422486 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.422442    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a170bd4b-6e59-4947-9074-1a09ad2f309a-maas-api-tls\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:17:34.422486 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.422479    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48phm\" (UniqueName: \"kubernetes.io/projected/a170bd4b-6e59-4947-9074-1a09ad2f309a-kube-api-access-48phm\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:17:34.422486 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.422490    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a170bd4b-6e59-4947-9074-1a09ad2f309a-openshift-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:17:34.514554 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.514470    2556 generic.go:356] "Generic (PLEG): container finished" podID="a170bd4b-6e59-4947-9074-1a09ad2f309a" containerID="556c49b4afcb85f7b2969e5f413e75c8ffa22b8ea7920c7e60a6df459bf8b4ec" exitCode=0
Jul 22 13:17:34.514554 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.514521    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"
Jul 22 13:17:34.514776 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.514568    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs" event={"ID":"a170bd4b-6e59-4947-9074-1a09ad2f309a","Type":"ContainerDied","Data":"556c49b4afcb85f7b2969e5f413e75c8ffa22b8ea7920c7e60a6df459bf8b4ec"}
Jul 22 13:17:34.514776 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.514647    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs" event={"ID":"a170bd4b-6e59-4947-9074-1a09ad2f309a","Type":"ContainerDied","Data":"3f558d5387e10e6075b1c9d9628ce6c2c5a47b7aee5eb1d1aa6ee427d501b1b8"}
Jul 22 13:17:34.514776 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.514704    2556 scope.go:117] "RemoveContainer" containerID="556c49b4afcb85f7b2969e5f413e75c8ffa22b8ea7920c7e60a6df459bf8b4ec"
Jul 22 13:17:34.524028 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.524011    2556 scope.go:117] "RemoveContainer" containerID="556c49b4afcb85f7b2969e5f413e75c8ffa22b8ea7920c7e60a6df459bf8b4ec"
Jul 22 13:17:34.524280 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:17:34.524261    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"556c49b4afcb85f7b2969e5f413e75c8ffa22b8ea7920c7e60a6df459bf8b4ec\": container with ID starting with 556c49b4afcb85f7b2969e5f413e75c8ffa22b8ea7920c7e60a6df459bf8b4ec not found: ID does not exist" containerID="556c49b4afcb85f7b2969e5f413e75c8ffa22b8ea7920c7e60a6df459bf8b4ec"
Jul 22 13:17:34.524343 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.524287    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"556c49b4afcb85f7b2969e5f413e75c8ffa22b8ea7920c7e60a6df459bf8b4ec"} err="failed to get container status \"556c49b4afcb85f7b2969e5f413e75c8ffa22b8ea7920c7e60a6df459bf8b4ec\": rpc error: code = NotFound desc = could not find container \"556c49b4afcb85f7b2969e5f413e75c8ffa22b8ea7920c7e60a6df459bf8b4ec\": container with ID starting with 556c49b4afcb85f7b2969e5f413e75c8ffa22b8ea7920c7e60a6df459bf8b4ec not found: ID does not exist"
Jul 22 13:17:34.536084 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.536056    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"]
Jul 22 13:17:34.539994 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:34.539974    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-266bd1-5cfdfccd56-blpfs"]
Jul 22 13:17:35.902160 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:35.902118    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a170bd4b-6e59-4947-9074-1a09ad2f309a" path="/var/lib/kubelet/pods/a170bd4b-6e59-4947-9074-1a09ad2f309a/volumes"
Jul 22 13:17:38.275856 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:38.275753    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-266bd1-5lp79"]
Jul 22 13:17:38.277840 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:38.277814    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-266bd1-5lp79"]
Jul 22 13:17:39.901996 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:39.901959    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5a9eb71-7095-4d45-be5f-56ecd9b01300" path="/var/lib/kubelet/pods/d5a9eb71-7095-4d45-be5f-56ecd9b01300/volumes"
Jul 22 13:17:45.256963 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:45.256925    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0d04d7-vcdvh"]
Jul 22 13:17:45.257538 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:45.257287    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a170bd4b-6e59-4947-9074-1a09ad2f309a" containerName="maas-api"
Jul 22 13:17:45.257538 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:45.257297    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a170bd4b-6e59-4947-9074-1a09ad2f309a" containerName="maas-api"
Jul 22 13:17:45.257538 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:45.257315    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5a9eb71-7095-4d45-be5f-56ecd9b01300" containerName="revoke-keys"
Jul 22 13:17:45.257538 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:45.257322    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5a9eb71-7095-4d45-be5f-56ecd9b01300" containerName="revoke-keys"
Jul 22 13:17:45.257538 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:45.257383    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a170bd4b-6e59-4947-9074-1a09ad2f309a" containerName="maas-api"
Jul 22 13:17:45.257538 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:45.257394    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5a9eb71-7095-4d45-be5f-56ecd9b01300" containerName="revoke-keys"
Jul 22 13:17:45.261970 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:45.261950    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0d04d7-vcdvh"
Jul 22 13:17:45.266853 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:45.266832    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qrrb5\""
Jul 22 13:17:45.269991 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:45.269565    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0d04d7-vcdvh"]
Jul 22 13:17:45.422040 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:45.422001    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8a4e794-d9bd-4a7a-8d99-87048090c272-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0d04d7-vcdvh\" (UID: \"f8a4e794-d9bd-4a7a-8d99-87048090c272\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0d04d7-vcdvh"
Jul 22 13:17:45.523000 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:45.522970    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8a4e794-d9bd-4a7a-8d99-87048090c272-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0d04d7-vcdvh\" (UID: \"f8a4e794-d9bd-4a7a-8d99-87048090c272\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0d04d7-vcdvh"
Jul 22 13:17:45.523670 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:45.523649    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8a4e794-d9bd-4a7a-8d99-87048090c272-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0d04d7-vcdvh\" (UID: \"f8a4e794-d9bd-4a7a-8d99-87048090c272\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0d04d7-vcdvh"
Jul 22 13:17:45.574496 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:45.574470    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0d04d7-vcdvh"
Jul 22 13:17:45.713636 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:45.713611    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0d04d7-vcdvh"]
Jul 22 13:17:45.716051 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:17:45.716022    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8a4e794_d9bd_4a7a_8d99_87048090c272.slice/crio-aae1aabb07a63ee524ae11d76a214739609aed7bc84e1edf5dae0b05da17b7f8 WatchSource:0}: Error finding container aae1aabb07a63ee524ae11d76a214739609aed7bc84e1edf5dae0b05da17b7f8: Status 404 returned error can't find the container with id aae1aabb07a63ee524ae11d76a214739609aed7bc84e1edf5dae0b05da17b7f8
Jul 22 13:17:46.578476 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:46.578440    2556 generic.go:356] "Generic (PLEG): container finished" podID="f8a4e794-d9bd-4a7a-8d99-87048090c272" containerID="5f3ac4d9c59d8c40e19a0f3331de2959ccdaa77663eb6bba265fd0a642878c9b" exitCode=0
Jul 22 13:17:46.578845 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:46.578526    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0d04d7-vcdvh" event={"ID":"f8a4e794-d9bd-4a7a-8d99-87048090c272","Type":"ContainerDied","Data":"5f3ac4d9c59d8c40e19a0f3331de2959ccdaa77663eb6bba265fd0a642878c9b"}
Jul 22 13:17:46.578845 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:46.578578    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0d04d7-vcdvh" event={"ID":"f8a4e794-d9bd-4a7a-8d99-87048090c272","Type":"ContainerStarted","Data":"aae1aabb07a63ee524ae11d76a214739609aed7bc84e1edf5dae0b05da17b7f8"}
Jul 22 13:17:47.723493 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:47.723466    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0d04d7-vcdvh"
Jul 22 13:17:47.845039 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:47.844934    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8a4e794-d9bd-4a7a-8d99-87048090c272-maas-api-service-ca\") pod \"f8a4e794-d9bd-4a7a-8d99-87048090c272\" (UID: \"f8a4e794-d9bd-4a7a-8d99-87048090c272\") "
Jul 22 13:17:47.845281 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:47.845257    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8a4e794-d9bd-4a7a-8d99-87048090c272-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f8a4e794-d9bd-4a7a-8d99-87048090c272" (UID: "f8a4e794-d9bd-4a7a-8d99-87048090c272"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:17:47.946706 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:47.946664    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8a4e794-d9bd-4a7a-8d99-87048090c272-maas-api-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:17:48.591554 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:48.591517    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0d04d7-vcdvh"
Jul 22 13:17:48.591748 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:48.591516    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0d04d7-vcdvh" event={"ID":"f8a4e794-d9bd-4a7a-8d99-87048090c272","Type":"ContainerDied","Data":"aae1aabb07a63ee524ae11d76a214739609aed7bc84e1edf5dae0b05da17b7f8"}
Jul 22 13:17:48.591748 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:17:48.591651    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aae1aabb07a63ee524ae11d76a214739609aed7bc84e1edf5dae0b05da17b7f8"
Jul 22 13:18:00.825659 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:00.825618    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"]
Jul 22 13:18:00.826154 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:00.825907    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk" podUID="60b2314d-50ba-41b8-8449-2ceb24fac530" containerName="maas-api" containerID="cri-o://10709a7aa26d7ba059a6419476919dd58381989334fa0cfd8831ea3fb9418f41" gracePeriod=30
Jul 22 13:18:01.091049 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.090995    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"
Jul 22 13:18:01.171150 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.171125    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60b2314d-50ba-41b8-8449-2ceb24fac530-maas-api-tls\") pod \"60b2314d-50ba-41b8-8449-2ceb24fac530\" (UID: \"60b2314d-50ba-41b8-8449-2ceb24fac530\") "
Jul 22 13:18:01.171335 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.171183    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgh6t\" (UniqueName: \"kubernetes.io/projected/60b2314d-50ba-41b8-8449-2ceb24fac530-kube-api-access-xgh6t\") pod \"60b2314d-50ba-41b8-8449-2ceb24fac530\" (UID: \"60b2314d-50ba-41b8-8449-2ceb24fac530\") "
Jul 22 13:18:01.171335 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.171238    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60b2314d-50ba-41b8-8449-2ceb24fac530-openshift-service-ca\") pod \"60b2314d-50ba-41b8-8449-2ceb24fac530\" (UID: \"60b2314d-50ba-41b8-8449-2ceb24fac530\") "
Jul 22 13:18:01.171601 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.171576    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60b2314d-50ba-41b8-8449-2ceb24fac530-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "60b2314d-50ba-41b8-8449-2ceb24fac530" (UID: "60b2314d-50ba-41b8-8449-2ceb24fac530"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:18:01.173157 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.173138    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60b2314d-50ba-41b8-8449-2ceb24fac530-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "60b2314d-50ba-41b8-8449-2ceb24fac530" (UID: "60b2314d-50ba-41b8-8449-2ceb24fac530"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:18:01.173366 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.173346    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60b2314d-50ba-41b8-8449-2ceb24fac530-kube-api-access-xgh6t" (OuterVolumeSpecName: "kube-api-access-xgh6t") pod "60b2314d-50ba-41b8-8449-2ceb24fac530" (UID: "60b2314d-50ba-41b8-8449-2ceb24fac530"). InnerVolumeSpecName "kube-api-access-xgh6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:18:01.272752 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.272719    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60b2314d-50ba-41b8-8449-2ceb24fac530-maas-api-tls\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:18:01.272752 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.272748    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgh6t\" (UniqueName: \"kubernetes.io/projected/60b2314d-50ba-41b8-8449-2ceb24fac530-kube-api-access-xgh6t\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:18:01.272752 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.272758    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60b2314d-50ba-41b8-8449-2ceb24fac530-openshift-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:18:01.662310 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.662273    2556 generic.go:356] "Generic (PLEG): container finished" podID="60b2314d-50ba-41b8-8449-2ceb24fac530" containerID="10709a7aa26d7ba059a6419476919dd58381989334fa0cfd8831ea3fb9418f41" exitCode=0
Jul 22 13:18:01.662519 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.662322    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"
Jul 22 13:18:01.662519 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.662370    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk" event={"ID":"60b2314d-50ba-41b8-8449-2ceb24fac530","Type":"ContainerDied","Data":"10709a7aa26d7ba059a6419476919dd58381989334fa0cfd8831ea3fb9418f41"}
Jul 22 13:18:01.662519 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.662428    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk" event={"ID":"60b2314d-50ba-41b8-8449-2ceb24fac530","Type":"ContainerDied","Data":"1348c1ff0150d14e3fbd8cb3ac208aeeb081b1c6ea5550e7fc16c29050d88244"}
Jul 22 13:18:01.662519 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.662460    2556 scope.go:117] "RemoveContainer" containerID="10709a7aa26d7ba059a6419476919dd58381989334fa0cfd8831ea3fb9418f41"
Jul 22 13:18:01.671959 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.671942    2556 scope.go:117] "RemoveContainer" containerID="10709a7aa26d7ba059a6419476919dd58381989334fa0cfd8831ea3fb9418f41"
Jul 22 13:18:01.672224 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:18:01.672208    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10709a7aa26d7ba059a6419476919dd58381989334fa0cfd8831ea3fb9418f41\": container with ID starting with 10709a7aa26d7ba059a6419476919dd58381989334fa0cfd8831ea3fb9418f41 not found: ID does not exist" containerID="10709a7aa26d7ba059a6419476919dd58381989334fa0cfd8831ea3fb9418f41"
Jul 22 13:18:01.672274 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.672234    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10709a7aa26d7ba059a6419476919dd58381989334fa0cfd8831ea3fb9418f41"} err="failed to get container status \"10709a7aa26d7ba059a6419476919dd58381989334fa0cfd8831ea3fb9418f41\": rpc error: code = NotFound desc = could not find container \"10709a7aa26d7ba059a6419476919dd58381989334fa0cfd8831ea3fb9418f41\": container with ID starting with 10709a7aa26d7ba059a6419476919dd58381989334fa0cfd8831ea3fb9418f41 not found: ID does not exist"
Jul 22 13:18:01.684408 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.684377    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"]
Jul 22 13:18:01.690849 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.690824    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0d04d7-64664dc4b5-99vpk"]
Jul 22 13:18:01.902235 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:01.902206    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60b2314d-50ba-41b8-8449-2ceb24fac530" path="/var/lib/kubelet/pods/60b2314d-50ba-41b8-8449-2ceb24fac530/volumes"
Jul 22 13:18:05.312075 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:05.312037    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0d04d7-vcdvh"]
Jul 22 13:18:05.314814 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:05.314792    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0d04d7-vcdvh"]
Jul 22 13:18:05.901571 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:05.901534    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8a4e794-d9bd-4a7a-8d99-87048090c272" path="/var/lib/kubelet/pods/f8a4e794-d9bd-4a7a-8d99-87048090c272/volumes"
Jul 22 13:18:16.128843 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.128809    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"]
Jul 22 13:18:16.129440 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.129423    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8a4e794-d9bd-4a7a-8d99-87048090c272" containerName="revoke-keys"
Jul 22 13:18:16.129486 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.129443    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8a4e794-d9bd-4a7a-8d99-87048090c272" containerName="revoke-keys"
Jul 22 13:18:16.129486 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.129478    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60b2314d-50ba-41b8-8449-2ceb24fac530" containerName="maas-api"
Jul 22 13:18:16.129556 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.129487    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="60b2314d-50ba-41b8-8449-2ceb24fac530" containerName="maas-api"
Jul 22 13:18:16.129590 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.129577    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8a4e794-d9bd-4a7a-8d99-87048090c272" containerName="revoke-keys"
Jul 22 13:18:16.129627 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.129595    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="60b2314d-50ba-41b8-8449-2ceb24fac530" containerName="maas-api"
Jul 22 13:18:16.134050 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.134029    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"
Jul 22 13:18:16.137402 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.137380    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 13:18:16.137614 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.137596    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-634440-serving-cert\""
Jul 22 13:18:16.138800 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.138780    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8dbk8\""
Jul 22 13:18:16.139023 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.138784    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 13:18:16.141868 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.141845    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"]
Jul 22 13:18:16.213796 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.213767    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0fa0d99-a3df-4663-8677-b14af0891c8a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-634440-5b4d748679-tbgpw\" (UID: \"e0fa0d99-a3df-4663-8677-b14af0891c8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"
Jul 22 13:18:16.213796 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.213801    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvqdn\" (UniqueName: \"kubernetes.io/projected/e0fa0d99-a3df-4663-8677-b14af0891c8a-kube-api-access-jvqdn\") pod \"maas-api-e2e-shared-a-634440-5b4d748679-tbgpw\" (UID: \"e0fa0d99-a3df-4663-8677-b14af0891c8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"
Jul 22 13:18:16.213995 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.213886    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0fa0d99-a3df-4663-8677-b14af0891c8a-maas-api-tls\") pod \"maas-api-e2e-shared-a-634440-5b4d748679-tbgpw\" (UID: \"e0fa0d99-a3df-4663-8677-b14af0891c8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"
Jul 22 13:18:16.315089 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.315050    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0fa0d99-a3df-4663-8677-b14af0891c8a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-634440-5b4d748679-tbgpw\" (UID: \"e0fa0d99-a3df-4663-8677-b14af0891c8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"
Jul 22 13:18:16.315282 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.315094    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvqdn\" (UniqueName: \"kubernetes.io/projected/e0fa0d99-a3df-4663-8677-b14af0891c8a-kube-api-access-jvqdn\") pod \"maas-api-e2e-shared-a-634440-5b4d748679-tbgpw\" (UID: \"e0fa0d99-a3df-4663-8677-b14af0891c8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"
Jul 22 13:18:16.315282 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.315188    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0fa0d99-a3df-4663-8677-b14af0891c8a-maas-api-tls\") pod \"maas-api-e2e-shared-a-634440-5b4d748679-tbgpw\" (UID: \"e0fa0d99-a3df-4663-8677-b14af0891c8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"
Jul 22 13:18:16.315417 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:18:16.315300    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-serving-cert: secret "maas-api-e2e-shared-a-634440-serving-cert" not found
Jul 22 13:18:16.315417 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:18:16.315379    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0fa0d99-a3df-4663-8677-b14af0891c8a-maas-api-tls podName:e0fa0d99-a3df-4663-8677-b14af0891c8a nodeName:}" failed. No retries permitted until 2026-07-22 13:18:16.815358245 +0000 UTC m=+2459.455604473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e0fa0d99-a3df-4663-8677-b14af0891c8a-maas-api-tls") pod "maas-api-e2e-shared-a-634440-5b4d748679-tbgpw" (UID: "e0fa0d99-a3df-4663-8677-b14af0891c8a") : secret "maas-api-e2e-shared-a-634440-serving-cert" not found
Jul 22 13:18:16.315672 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.315650    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0fa0d99-a3df-4663-8677-b14af0891c8a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-634440-5b4d748679-tbgpw\" (UID: \"e0fa0d99-a3df-4663-8677-b14af0891c8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"
Jul 22 13:18:16.330456 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.330435    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvqdn\" (UniqueName: \"kubernetes.io/projected/e0fa0d99-a3df-4663-8677-b14af0891c8a-kube-api-access-jvqdn\") pod \"maas-api-e2e-shared-a-634440-5b4d748679-tbgpw\" (UID: \"e0fa0d99-a3df-4663-8677-b14af0891c8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"
Jul 22 13:18:16.819353 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.819315    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0fa0d99-a3df-4663-8677-b14af0891c8a-maas-api-tls\") pod \"maas-api-e2e-shared-a-634440-5b4d748679-tbgpw\" (UID: \"e0fa0d99-a3df-4663-8677-b14af0891c8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"
Jul 22 13:18:16.821982 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:16.821961    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0fa0d99-a3df-4663-8677-b14af0891c8a-maas-api-tls\") pod \"maas-api-e2e-shared-a-634440-5b4d748679-tbgpw\" (UID: \"e0fa0d99-a3df-4663-8677-b14af0891c8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"
Jul 22 13:18:17.047881 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:17.047851    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"
Jul 22 13:18:17.185541 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:17.185509    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"]
Jul 22 13:18:17.188611 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:18:17.188583    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0fa0d99_a3df_4663_8677_b14af0891c8a.slice/crio-07fec0fa7fdfb388aed0e5a9e8320dcfa945928469134085586b3fdb637b955c WatchSource:0}: Error finding container 07fec0fa7fdfb388aed0e5a9e8320dcfa945928469134085586b3fdb637b955c: Status 404 returned error can't find the container with id 07fec0fa7fdfb388aed0e5a9e8320dcfa945928469134085586b3fdb637b955c
Jul 22 13:18:17.743733 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:17.743707    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw" event={"ID":"e0fa0d99-a3df-4663-8677-b14af0891c8a","Type":"ContainerStarted","Data":"07fec0fa7fdfb388aed0e5a9e8320dcfa945928469134085586b3fdb637b955c"}
Jul 22 13:18:18.750665 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:18.750624    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw" event={"ID":"e0fa0d99-a3df-4663-8677-b14af0891c8a","Type":"ContainerStarted","Data":"d0e0127f5306bdd03654e34e966efbccbde5e5d9b5052f44593f01ad316d435d"}
Jul 22 13:18:18.751165 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:18.750827    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"
Jul 22 13:18:18.767967 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:18.767920    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw" podStartSLOduration=2.233134779 podStartE2EDuration="2.76790599s" totalImagesPullingTime="534.771211ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:18:18.766526972 +0000 UTC m=+2461.406773234" watchObservedRunningTime="2026-07-22 13:18:18.76790599 +0000 UTC m=+2461.408152231"
Jul 22 13:18:24.309081 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:24.309043    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"]
Jul 22 13:18:24.313040 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:24.313018    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"
Jul 22 13:18:24.315726 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:24.315705    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-494b12-serving-cert\""
Jul 22 13:18:24.322935 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:24.322662    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"]
Jul 22 13:18:24.496200 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:24.496165    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs994\" (UniqueName: \"kubernetes.io/projected/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f-kube-api-access-vs994\") pod \"maas-api-e2e-shared-b-494b12-78fd847789-gqrxg\" (UID: \"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"
Jul 22 13:18:24.496368 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:24.496206    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f-maas-api-tls\") pod \"maas-api-e2e-shared-b-494b12-78fd847789-gqrxg\" (UID: \"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"
Jul 22 13:18:24.496368 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:24.496265    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-494b12-78fd847789-gqrxg\" (UID: \"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"
Jul 22 13:18:24.596969 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:24.596883    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs994\" (UniqueName: \"kubernetes.io/projected/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f-kube-api-access-vs994\") pod \"maas-api-e2e-shared-b-494b12-78fd847789-gqrxg\" (UID: \"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"
Jul 22 13:18:24.596969 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:24.596923    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f-maas-api-tls\") pod \"maas-api-e2e-shared-b-494b12-78fd847789-gqrxg\" (UID: \"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"
Jul 22 13:18:24.596969 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:24.596961    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-494b12-78fd847789-gqrxg\" (UID: \"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"
Jul 22 13:18:24.597572 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:24.597551    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-494b12-78fd847789-gqrxg\" (UID: \"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"
Jul 22 13:18:24.599833 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:24.599807    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f-maas-api-tls\") pod \"maas-api-e2e-shared-b-494b12-78fd847789-gqrxg\" (UID: \"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"
Jul 22 13:18:24.606366 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:24.606344    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs994\" (UniqueName: \"kubernetes.io/projected/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f-kube-api-access-vs994\") pod \"maas-api-e2e-shared-b-494b12-78fd847789-gqrxg\" (UID: \"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"
Jul 22 13:18:24.626218 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:24.626199    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"
Jul 22 13:18:24.761397 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:24.761370    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"
Jul 22 13:18:24.763095 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:24.763075    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"]
Jul 22 13:18:24.765057 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:18:24.765037    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12f2ab05_d2f4_43bf_909d_d2fe4c0f3c9f.slice/crio-8dea75928e57b6210edb0135debe6a6adea1a72872bb49c84caeee1352ad666e WatchSource:0}: Error finding container 8dea75928e57b6210edb0135debe6a6adea1a72872bb49c84caeee1352ad666e: Status 404 returned error can't find the container with id 8dea75928e57b6210edb0135debe6a6adea1a72872bb49c84caeee1352ad666e
Jul 22 13:18:24.784480 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:24.784455    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg" event={"ID":"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f","Type":"ContainerStarted","Data":"8dea75928e57b6210edb0135debe6a6adea1a72872bb49c84caeee1352ad666e"}
Jul 22 13:18:25.798774 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:25.798735    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg" event={"ID":"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f","Type":"ContainerStarted","Data":"e64318fd42ce1695e3c89ed8730556ba2bbba0e1adf8ccbc82103754ab18dda3"}
Jul 22 13:18:25.799192 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:25.798878    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"
Jul 22 13:18:25.818474 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:25.818426    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg" podStartSLOduration=1.3721495799999999 podStartE2EDuration="1.818412224s" totalImagesPullingTime="446.262644ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:18:25.817060861 +0000 UTC m=+2468.457307129" watchObservedRunningTime="2026-07-22 13:18:25.818412224 +0000 UTC m=+2468.458658465"
Jul 22 13:18:31.809385 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:18:31.809357    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"
Jul 22 13:19:18.177188 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:19:18.177103    2556 scope.go:117] "RemoveContainer" containerID="200fe60ae2ba39d8eabb34af46bc12feb4762a962b68b144d4209e9be1bee4fb"
Jul 22 13:21:18.205361 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:21:18.205321    2556 scope.go:117] "RemoveContainer" containerID="efe069a8449a21e12f4c62a1e769d7dd0fc41a667eeb39a1270a1982ac55c4c1"
Jul 22 13:21:18.214261 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:21:18.214234    2556 scope.go:117] "RemoveContainer" containerID="bdb05968e724cbeb2ac7f4af0bca0b107ea696625a84cbeb8b816da81aed04b6"
Jul 22 13:22:18.032077 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:22:18.032008    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 13:22:18.035973 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:22:18.035950    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 13:22:18.042796 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:22:18.042775    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 13:22:18.046541 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:22:18.046523    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vbkcp_ef7c0e9e-ae44-495c-a75e-b9045efb5cdb/ovn-acl-logging/0.log"
Jul 22 13:22:18.243020 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:22:18.242888    2556 scope.go:117] "RemoveContainer" containerID="1f6f96b58b55a0ecb0652ea469921e2665b42e1c368fd59c0c21934e037f8e5e"
Jul 22 13:23:18.265688 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:23:18.265640    2556 scope.go:117] "RemoveContainer" containerID="7ea6890b2b89d54c6dfb31a6afa949bf57e05e59d0979af52d2f1f498bd98fad"
Jul 22 13:24:18.285211 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:24:18.285177    2556 scope.go:117] "RemoveContainer" containerID="5f3ac4d9c59d8c40e19a0f3331de2959ccdaa77663eb6bba265fd0a642878c9b"
Jul 22 13:24:18.293846 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:24:18.293821    2556 scope.go:117] "RemoveContainer" containerID="a6e703d5c7cc97ff508a4fde23af7ca9c92165a2ff999ce2b1074590804ed187"
Jul 22 13:25:13.286324 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:13.286237    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-634440-42bdf"]
Jul 22 13:25:13.289993 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:13.289967    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-634440-42bdf"
Jul 22 13:25:13.293651 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:13.293623    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qrrb5\""
Jul 22 13:25:13.300718 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:13.300665    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-634440-42bdf"]
Jul 22 13:25:13.483193 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:13.483149    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c776377d-1c2c-4727-80c9-ed0618365deb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-634440-42bdf\" (UID: \"c776377d-1c2c-4727-80c9-ed0618365deb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-634440-42bdf"
Jul 22 13:25:13.584042 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:13.583951    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c776377d-1c2c-4727-80c9-ed0618365deb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-634440-42bdf\" (UID: \"c776377d-1c2c-4727-80c9-ed0618365deb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-634440-42bdf"
Jul 22 13:25:13.584610 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:13.584586    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c776377d-1c2c-4727-80c9-ed0618365deb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-634440-42bdf\" (UID: \"c776377d-1c2c-4727-80c9-ed0618365deb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-634440-42bdf"
Jul 22 13:25:13.602380 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:13.602352    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-634440-42bdf"
Jul 22 13:25:13.767438 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:13.767411    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-634440-42bdf"]
Jul 22 13:25:13.769810 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:25:13.769780    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc776377d_1c2c_4727_80c9_ed0618365deb.slice/crio-63b13d430287e2923e349f396d3c96505fc510e9721dcd67194d6220cf17ba77 WatchSource:0}: Error finding container 63b13d430287e2923e349f396d3c96505fc510e9721dcd67194d6220cf17ba77: Status 404 returned error can't find the container with id 63b13d430287e2923e349f396d3c96505fc510e9721dcd67194d6220cf17ba77
Jul 22 13:25:13.887386 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:13.887274    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-634440-42bdf" event={"ID":"c776377d-1c2c-4727-80c9-ed0618365deb","Type":"ContainerStarted","Data":"63b13d430287e2923e349f396d3c96505fc510e9721dcd67194d6220cf17ba77"}
Jul 22 13:25:14.894012 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:14.893970    2556 generic.go:356] "Generic (PLEG): container finished" podID="c776377d-1c2c-4727-80c9-ed0618365deb" containerID="8783cb3763bbff6bdf0ace294404a56aaddfa71c14ced9bb18236f218b8a6257" exitCode=0
Jul 22 13:25:14.894457 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:14.894038    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-634440-42bdf" event={"ID":"c776377d-1c2c-4727-80c9-ed0618365deb","Type":"ContainerDied","Data":"8783cb3763bbff6bdf0ace294404a56aaddfa71c14ced9bb18236f218b8a6257"}
Jul 22 13:25:16.038832 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:16.038800    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-634440-42bdf"
Jul 22 13:25:16.210079 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:16.209984    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c776377d-1c2c-4727-80c9-ed0618365deb-maas-api-service-ca\") pod \"c776377d-1c2c-4727-80c9-ed0618365deb\" (UID: \"c776377d-1c2c-4727-80c9-ed0618365deb\") "
Jul 22 13:25:16.210414 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:16.210391    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c776377d-1c2c-4727-80c9-ed0618365deb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c776377d-1c2c-4727-80c9-ed0618365deb" (UID: "c776377d-1c2c-4727-80c9-ed0618365deb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:25:16.311421 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:16.311382    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c776377d-1c2c-4727-80c9-ed0618365deb-maas-api-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:25:16.904383 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:16.904351    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-634440-42bdf"
Jul 22 13:25:16.904575 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:16.904350    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-634440-42bdf" event={"ID":"c776377d-1c2c-4727-80c9-ed0618365deb","Type":"ContainerDied","Data":"63b13d430287e2923e349f396d3c96505fc510e9721dcd67194d6220cf17ba77"}
Jul 22 13:25:16.904575 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:16.904488    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63b13d430287e2923e349f396d3c96505fc510e9721dcd67194d6220cf17ba77"
Jul 22 13:25:23.733758 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:23.733725    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"]
Jul 22 13:25:23.734405 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:23.733974    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw" podUID="e0fa0d99-a3df-4663-8677-b14af0891c8a" containerName="maas-api" containerID="cri-o://d0e0127f5306bdd03654e34e966efbccbde5e5d9b5052f44593f01ad316d435d" gracePeriod=30
Jul 22 13:25:23.940750 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:23.940717    2556 generic.go:356] "Generic (PLEG): container finished" podID="e0fa0d99-a3df-4663-8677-b14af0891c8a" containerID="d0e0127f5306bdd03654e34e966efbccbde5e5d9b5052f44593f01ad316d435d" exitCode=0
Jul 22 13:25:23.940935 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:23.940777    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw" event={"ID":"e0fa0d99-a3df-4663-8677-b14af0891c8a","Type":"ContainerDied","Data":"d0e0127f5306bdd03654e34e966efbccbde5e5d9b5052f44593f01ad316d435d"}
Jul 22 13:25:23.995418 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:23.995356    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"
Jul 22 13:25:24.079483 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:24.079446    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0fa0d99-a3df-4663-8677-b14af0891c8a-maas-api-tls\") pod \"e0fa0d99-a3df-4663-8677-b14af0891c8a\" (UID: \"e0fa0d99-a3df-4663-8677-b14af0891c8a\") "
Jul 22 13:25:24.079663 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:24.079527    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvqdn\" (UniqueName: \"kubernetes.io/projected/e0fa0d99-a3df-4663-8677-b14af0891c8a-kube-api-access-jvqdn\") pod \"e0fa0d99-a3df-4663-8677-b14af0891c8a\" (UID: \"e0fa0d99-a3df-4663-8677-b14af0891c8a\") "
Jul 22 13:25:24.079663 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:24.079547    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0fa0d99-a3df-4663-8677-b14af0891c8a-openshift-service-ca\") pod \"e0fa0d99-a3df-4663-8677-b14af0891c8a\" (UID: \"e0fa0d99-a3df-4663-8677-b14af0891c8a\") "
Jul 22 13:25:24.079994 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:24.079965    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0fa0d99-a3df-4663-8677-b14af0891c8a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e0fa0d99-a3df-4663-8677-b14af0891c8a" (UID: "e0fa0d99-a3df-4663-8677-b14af0891c8a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:25:24.081875 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:24.081848    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0fa0d99-a3df-4663-8677-b14af0891c8a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e0fa0d99-a3df-4663-8677-b14af0891c8a" (UID: "e0fa0d99-a3df-4663-8677-b14af0891c8a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:25:24.081989 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:24.081942    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0fa0d99-a3df-4663-8677-b14af0891c8a-kube-api-access-jvqdn" (OuterVolumeSpecName: "kube-api-access-jvqdn") pod "e0fa0d99-a3df-4663-8677-b14af0891c8a" (UID: "e0fa0d99-a3df-4663-8677-b14af0891c8a"). InnerVolumeSpecName "kube-api-access-jvqdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:25:24.180617 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:24.180573    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0fa0d99-a3df-4663-8677-b14af0891c8a-maas-api-tls\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:25:24.180617 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:24.180612    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvqdn\" (UniqueName: \"kubernetes.io/projected/e0fa0d99-a3df-4663-8677-b14af0891c8a-kube-api-access-jvqdn\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:25:24.180617 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:24.180625    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0fa0d99-a3df-4663-8677-b14af0891c8a-openshift-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:25:24.948399 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:24.948367    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"
Jul 22 13:25:24.948914 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:24.948362    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw" event={"ID":"e0fa0d99-a3df-4663-8677-b14af0891c8a","Type":"ContainerDied","Data":"07fec0fa7fdfb388aed0e5a9e8320dcfa945928469134085586b3fdb637b955c"}
Jul 22 13:25:24.948914 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:24.948527    2556 scope.go:117] "RemoveContainer" containerID="d0e0127f5306bdd03654e34e966efbccbde5e5d9b5052f44593f01ad316d435d"
Jul 22 13:25:24.975357 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:24.975294    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"]
Jul 22 13:25:24.977845 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:24.977814    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-634440-5b4d748679-tbgpw"]
Jul 22 13:25:25.901731 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:25.901664    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0fa0d99-a3df-4663-8677-b14af0891c8a" path="/var/lib/kubelet/pods/e0fa0d99-a3df-4663-8677-b14af0891c8a/volumes"
Jul 22 13:25:28.553601 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:28.553565    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-634440-42bdf"]
Jul 22 13:25:28.565317 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:28.565286    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-634440-42bdf"]
Jul 22 13:25:29.902170 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:29.902133    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c776377d-1c2c-4727-80c9-ed0618365deb" path="/var/lib/kubelet/pods/c776377d-1c2c-4727-80c9-ed0618365deb/volumes"
Jul 22 13:25:36.775102 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:36.775065    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb"]
Jul 22 13:25:36.775571 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:36.775497    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0fa0d99-a3df-4663-8677-b14af0891c8a" containerName="maas-api"
Jul 22 13:25:36.775571 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:36.775516    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0fa0d99-a3df-4663-8677-b14af0891c8a" containerName="maas-api"
Jul 22 13:25:36.775571 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:36.775536    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c776377d-1c2c-4727-80c9-ed0618365deb" containerName="revoke-keys"
Jul 22 13:25:36.775571 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:36.775542    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c776377d-1c2c-4727-80c9-ed0618365deb" containerName="revoke-keys"
Jul 22 13:25:36.775764 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:36.775649    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c776377d-1c2c-4727-80c9-ed0618365deb" containerName="revoke-keys"
Jul 22 13:25:36.775764 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:36.775666    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0fa0d99-a3df-4663-8677-b14af0891c8a" containerName="maas-api"
Jul 22 13:25:36.779294 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:36.779273    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb"
Jul 22 13:25:36.782377 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:36.782353    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qrrb5\""
Jul 22 13:25:36.789461 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:36.789433    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb"]
Jul 22 13:25:36.902543 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:36.902509    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b860429-2614-4035-a257-73f5f9187bfd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb\" (UID: \"9b860429-2614-4035-a257-73f5f9187bfd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb"
Jul 22 13:25:37.003494 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:37.003460    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b860429-2614-4035-a257-73f5f9187bfd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb\" (UID: \"9b860429-2614-4035-a257-73f5f9187bfd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb"
Jul 22 13:25:37.004240 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:37.004216    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b860429-2614-4035-a257-73f5f9187bfd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb\" (UID: \"9b860429-2614-4035-a257-73f5f9187bfd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb"
Jul 22 13:25:37.090830 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:37.090743    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb"
Jul 22 13:25:37.231609 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:37.231586    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb"]
Jul 22 13:25:37.234066 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:25:37.234038    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b860429_2614_4035_a257_73f5f9187bfd.slice/crio-d522a839b3439964fa35094a1d3b604fa10b8488334bf9f6e9700e07ebf7064f WatchSource:0}: Error finding container d522a839b3439964fa35094a1d3b604fa10b8488334bf9f6e9700e07ebf7064f: Status 404 returned error can't find the container with id d522a839b3439964fa35094a1d3b604fa10b8488334bf9f6e9700e07ebf7064f
Jul 22 13:25:38.014988 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:38.014951    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb" event={"ID":"9b860429-2614-4035-a257-73f5f9187bfd","Type":"ContainerStarted","Data":"9f8f4313d90ef69a122f6dfa94057900ecd1ab1dc61d6068710d3161d1bf89ad"}
Jul 22 13:25:38.015394 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:38.015008    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb" event={"ID":"9b860429-2614-4035-a257-73f5f9187bfd","Type":"ContainerStarted","Data":"d522a839b3439964fa35094a1d3b604fa10b8488334bf9f6e9700e07ebf7064f"}
Jul 22 13:25:38.033913 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:38.033854    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb" podStartSLOduration=2.033832021 podStartE2EDuration="2.033832021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:25:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:25:38.031789211 +0000 UTC m=+2900.672035461" watchObservedRunningTime="2026-07-22 13:25:38.033832021 +0000 UTC m=+2900.674078288"
Jul 22 13:25:39.021205 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:39.021168    2556 generic.go:356] "Generic (PLEG): container finished" podID="9b860429-2614-4035-a257-73f5f9187bfd" containerID="9f8f4313d90ef69a122f6dfa94057900ecd1ab1dc61d6068710d3161d1bf89ad" exitCode=0
Jul 22 13:25:39.021602 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:39.021249    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb" event={"ID":"9b860429-2614-4035-a257-73f5f9187bfd","Type":"ContainerDied","Data":"9f8f4313d90ef69a122f6dfa94057900ecd1ab1dc61d6068710d3161d1bf89ad"}
Jul 22 13:25:40.158615 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:40.158583    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb"
Jul 22 13:25:40.232030 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:40.231995    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b860429-2614-4035-a257-73f5f9187bfd-maas-api-service-ca\") pod \"9b860429-2614-4035-a257-73f5f9187bfd\" (UID: \"9b860429-2614-4035-a257-73f5f9187bfd\") "
Jul 22 13:25:40.232375 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:40.232353    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b860429-2614-4035-a257-73f5f9187bfd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9b860429-2614-4035-a257-73f5f9187bfd" (UID: "9b860429-2614-4035-a257-73f5f9187bfd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:25:40.333251 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:40.333162    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b860429-2614-4035-a257-73f5f9187bfd-maas-api-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:25:41.033123 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:41.033094    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb"
Jul 22 13:25:41.033305 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:41.033125    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb" event={"ID":"9b860429-2614-4035-a257-73f5f9187bfd","Type":"ContainerDied","Data":"d522a839b3439964fa35094a1d3b604fa10b8488334bf9f6e9700e07ebf7064f"}
Jul 22 13:25:41.033305 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:41.033173    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d522a839b3439964fa35094a1d3b604fa10b8488334bf9f6e9700e07ebf7064f"
Jul 22 13:25:47.387234 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:47.387197    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"]
Jul 22 13:25:47.387734 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:47.387404    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg" podUID="12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f" containerName="maas-api" containerID="cri-o://e64318fd42ce1695e3c89ed8730556ba2bbba0e1adf8ccbc82103754ab18dda3" gracePeriod=30
Jul 22 13:25:47.643129 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:47.643046    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"
Jul 22 13:25:47.799918 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:47.799881    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs994\" (UniqueName: \"kubernetes.io/projected/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f-kube-api-access-vs994\") pod \"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f\" (UID: \"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f\") "
Jul 22 13:25:47.799918 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:47.799919    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f-maas-api-tls\") pod \"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f\" (UID: \"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f\") "
Jul 22 13:25:47.800150 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:47.799951    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f-openshift-service-ca\") pod \"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f\" (UID: \"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f\") "
Jul 22 13:25:47.800375 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:47.800350    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f" (UID: "12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:25:47.802210 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:47.802178    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f" (UID: "12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:25:47.802334 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:47.802307    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f-kube-api-access-vs994" (OuterVolumeSpecName: "kube-api-access-vs994") pod "12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f" (UID: "12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f"). InnerVolumeSpecName "kube-api-access-vs994". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:25:47.903948 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:47.902974    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs994\" (UniqueName: \"kubernetes.io/projected/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f-kube-api-access-vs994\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:25:47.903948 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:47.903033    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f-maas-api-tls\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:25:47.903948 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:47.903049    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f-openshift-service-ca\") on node \"ip-10-0-130-160.ec2.internal\" DevicePath \"\""
Jul 22 13:25:48.067740 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:48.067698    2556 generic.go:356] "Generic (PLEG): container finished" podID="12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f" containerID="e64318fd42ce1695e3c89ed8730556ba2bbba0e1adf8ccbc82103754ab18dda3" exitCode=0
Jul 22 13:25:48.067920 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:48.067763    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"
Jul 22 13:25:48.067920 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:48.067780    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg" event={"ID":"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f","Type":"ContainerDied","Data":"e64318fd42ce1695e3c89ed8730556ba2bbba0e1adf8ccbc82103754ab18dda3"}
Jul 22 13:25:48.067920 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:48.067835    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg" event={"ID":"12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f","Type":"ContainerDied","Data":"8dea75928e57b6210edb0135debe6a6adea1a72872bb49c84caeee1352ad666e"}
Jul 22 13:25:48.067920 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:48.067856    2556 scope.go:117] "RemoveContainer" containerID="e64318fd42ce1695e3c89ed8730556ba2bbba0e1adf8ccbc82103754ab18dda3"
Jul 22 13:25:48.076817 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:48.076796    2556 scope.go:117] "RemoveContainer" containerID="e64318fd42ce1695e3c89ed8730556ba2bbba0e1adf8ccbc82103754ab18dda3"
Jul 22 13:25:48.077109 ip-10-0-130-160 kubenswrapper[2556]: E0722 13:25:48.077083    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e64318fd42ce1695e3c89ed8730556ba2bbba0e1adf8ccbc82103754ab18dda3\": container with ID starting with e64318fd42ce1695e3c89ed8730556ba2bbba0e1adf8ccbc82103754ab18dda3 not found: ID does not exist" containerID="e64318fd42ce1695e3c89ed8730556ba2bbba0e1adf8ccbc82103754ab18dda3"
Jul 22 13:25:48.077164 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:48.077111    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e64318fd42ce1695e3c89ed8730556ba2bbba0e1adf8ccbc82103754ab18dda3"} err="failed to get container status \"e64318fd42ce1695e3c89ed8730556ba2bbba0e1adf8ccbc82103754ab18dda3\": rpc error: code = NotFound desc = could not find container \"e64318fd42ce1695e3c89ed8730556ba2bbba0e1adf8ccbc82103754ab18dda3\": container with ID starting with e64318fd42ce1695e3c89ed8730556ba2bbba0e1adf8ccbc82103754ab18dda3 not found: ID does not exist"
Jul 22 13:25:48.086773 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:48.086745    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"]
Jul 22 13:25:48.092365 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:48.092337    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-494b12-78fd847789-gqrxg"]
Jul 22 13:25:49.901605 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:49.901574    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f" path="/var/lib/kubelet/pods/12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f/volumes"
Jul 22 13:25:51.855838 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:51.855801    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb"]
Jul 22 13:25:51.857510 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:51.857483    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-494b12-z8nlb"]
Jul 22 13:25:51.902285 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:25:51.902249    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b860429-2614-4035-a257-73f5f9187bfd" path="/var/lib/kubelet/pods/9b860429-2614-4035-a257-73f5f9187bfd/volumes"
Jul 22 13:26:05.250321 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:05.250286    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7646889cfb-2h96g_e693d09e-2348-42b0-b866-f988dc1b4eea/manager/0.log"
Jul 22 13:26:05.639876 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:05.639848    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d99b87cc7-dnvgz_3d28b833-e189-403c-a273-bf70485a73f5/copy-manifests/0.log"
Jul 22 13:26:05.653582 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:05.653550    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d99b87cc7-dnvgz_3d28b833-e189-403c-a273-bf70485a73f5/manager/0.log"
Jul 22 13:26:06.396773 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:06.396748    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29745420-8tlf9_25501c0c-5dd5-461a-9f42-5df7a12c1d55/cleanup/0.log"
Jul 22 13:26:06.510762 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:06.510668    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29745435-jzr79_5f83750f-1d94-4ac5-812f-0d8fe65d81c7/cleanup/0.log"
Jul 22 13:26:08.562272 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:08.562243    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rmhrv_367b4b39-9dbc-479c-9992-8b1bef034b71/manager/0.log"
Jul 22 13:26:09.314508 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:09.314479    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9dwnn_3c0d6b03-17c9-4668-805f-65c733666a58/discovery/0.log"
Jul 22 13:26:10.389378 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:10.389350    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-98vvh_f799b733-a369-4bbb-8c62-a39e14abb707/main/0.log"
Jul 22 13:26:10.757527 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:10.757449    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9cqwc_b3521d2c-0a00-48f6-96a7-8ae02a8e0518/main/0.log"
Jul 22 13:26:20.015017 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:20.014984    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f5xrr_053dcfaf-ab25-4783-ad4a-4aa9693b8f6c/global-pull-secret-syncer/0.log"
Jul 22 13:26:20.219819 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:20.219780    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kjbch_a214fc4b-db41-4fd7-b2ac-59aaa1720409/konnectivity-agent/0.log"
Jul 22 13:26:20.316316 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:20.316290    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-160.ec2.internal_7976a83d9e3242dd32fc595d5fadaffb/haproxy/0.log"
Jul 22 13:26:25.747434 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:25.747350    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rmhrv_367b4b39-9dbc-479c-9992-8b1bef034b71/manager/0.log"
Jul 22 13:26:27.552123 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:27.552091    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a99ead0-077f-4105-832e-18e7bdb21c95/alertmanager/0.log"
Jul 22 13:26:27.582078 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:27.582048    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a99ead0-077f-4105-832e-18e7bdb21c95/config-reloader/0.log"
Jul 22 13:26:27.608564 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:27.608533    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a99ead0-077f-4105-832e-18e7bdb21c95/kube-rbac-proxy-web/0.log"
Jul 22 13:26:27.633246 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:27.633213    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a99ead0-077f-4105-832e-18e7bdb21c95/kube-rbac-proxy/0.log"
Jul 22 13:26:27.661030 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:27.660980    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a99ead0-077f-4105-832e-18e7bdb21c95/kube-rbac-proxy-metric/0.log"
Jul 22 13:26:27.694365 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:27.694292    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a99ead0-077f-4105-832e-18e7bdb21c95/prom-label-proxy/0.log"
Jul 22 13:26:27.722147 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:27.722122    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0a99ead0-077f-4105-832e-18e7bdb21c95/init-config-reloader/0.log"
Jul 22 13:26:27.922772 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:27.922743    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-xmcs8_992af211-2ed0-4604-ba11-2ed428cd37bd/monitoring-plugin/0.log"
Jul 22 13:26:27.961015 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:27.960932    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-787mc_6e58265b-a1fc-46d6-be7c-65fb231c8a08/node-exporter/0.log"
Jul 22 13:26:27.984892 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:27.984870    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-787mc_6e58265b-a1fc-46d6-be7c-65fb231c8a08/kube-rbac-proxy/0.log"
Jul 22 13:26:28.012784 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:28.012759    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-787mc_6e58265b-a1fc-46d6-be7c-65fb231c8a08/init-textfile/0.log"
Jul 22 13:26:28.216092 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:28.216013    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-fxxsm_7d21c7c7-a270-4615-bcfe-9f0dcc12c049/kube-rbac-proxy-main/0.log"
Jul 22 13:26:28.239214 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:28.239173    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-fxxsm_7d21c7c7-a270-4615-bcfe-9f0dcc12c049/kube-rbac-proxy-self/0.log"
Jul 22 13:26:28.265118 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:28.265077    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-fxxsm_7d21c7c7-a270-4615-bcfe-9f0dcc12c049/openshift-state-metrics/0.log"
Jul 22 13:26:28.306095 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:28.306065    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36a657c1-02b0-4782-9d4d-b1e31a1a4d96/prometheus/0.log"
Jul 22 13:26:28.334578 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:28.334548    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36a657c1-02b0-4782-9d4d-b1e31a1a4d96/config-reloader/0.log"
Jul 22 13:26:28.360976 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:28.360943    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36a657c1-02b0-4782-9d4d-b1e31a1a4d96/thanos-sidecar/0.log"
Jul 22 13:26:28.386812 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:28.386773    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36a657c1-02b0-4782-9d4d-b1e31a1a4d96/kube-rbac-proxy-web/0.log"
Jul 22 13:26:28.410858 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:28.410832    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36a657c1-02b0-4782-9d4d-b1e31a1a4d96/kube-rbac-proxy/0.log"
Jul 22 13:26:28.434383 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:28.434353    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36a657c1-02b0-4782-9d4d-b1e31a1a4d96/kube-rbac-proxy-thanos/0.log"
Jul 22 13:26:28.456624 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:28.456599    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36a657c1-02b0-4782-9d4d-b1e31a1a4d96/init-config-reloader/0.log"
Jul 22 13:26:28.667952 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:28.667926    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f84766c77-c47db_51144f25-a093-4099-bb89-2387561ac66c/thanos-query/0.log"
Jul 22 13:26:28.692185 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:28.692160    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f84766c77-c47db_51144f25-a093-4099-bb89-2387561ac66c/kube-rbac-proxy-web/0.log"
Jul 22 13:26:28.722489 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:28.722466    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f84766c77-c47db_51144f25-a093-4099-bb89-2387561ac66c/kube-rbac-proxy/0.log"
Jul 22 13:26:28.750990 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:28.750967    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f84766c77-c47db_51144f25-a093-4099-bb89-2387561ac66c/prom-label-proxy/0.log"
Jul 22 13:26:28.775989 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:28.775962    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f84766c77-c47db_51144f25-a093-4099-bb89-2387561ac66c/kube-rbac-proxy-rules/0.log"
Jul 22 13:26:28.806025 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:28.805999    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f84766c77-c47db_51144f25-a093-4099-bb89-2387561ac66c/kube-rbac-proxy-metrics/0.log"
Jul 22 13:26:30.029686 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.029652    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-ppbq2_a34dcc90-9f0b-4076-b343-79a57fd6e3a6/networking-console-plugin/0.log"
Jul 22 13:26:30.270559 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.270524    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"]
Jul 22 13:26:30.270924 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.270911    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f" containerName="maas-api"
Jul 22 13:26:30.270973 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.270925    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f" containerName="maas-api"
Jul 22 13:26:30.270973 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.270939    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b860429-2614-4035-a257-73f5f9187bfd" containerName="revoke-keys"
Jul 22 13:26:30.270973 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.270945    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b860429-2614-4035-a257-73f5f9187bfd" containerName="revoke-keys"
Jul 22 13:26:30.271068 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.270996    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b860429-2614-4035-a257-73f5f9187bfd" containerName="revoke-keys"
Jul 22 13:26:30.271068 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.271010    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="12f2ab05-d2f4-43bf-909d-d2fe4c0f3c9f" containerName="maas-api"
Jul 22 13:26:30.274425 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.274402    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:30.277080 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.277033    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wsp6t\"/\"openshift-service-ca.crt\""
Jul 22 13:26:30.277080 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.277075    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wsp6t\"/\"default-dockercfg-hpnfs\""
Jul 22 13:26:30.278318 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.278299    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wsp6t\"/\"kube-root-ca.crt\""
Jul 22 13:26:30.286487 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.286459    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"]
Jul 22 13:26:30.399746 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.399667    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d46101aa-b069-4233-8c86-c820f170edf2-proc\") pod \"perf-node-gather-daemonset-wxqkx\" (UID: \"d46101aa-b069-4233-8c86-c820f170edf2\") " pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:30.399936 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.399760    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d46101aa-b069-4233-8c86-c820f170edf2-lib-modules\") pod \"perf-node-gather-daemonset-wxqkx\" (UID: \"d46101aa-b069-4233-8c86-c820f170edf2\") " pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:30.399936 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.399782    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d46101aa-b069-4233-8c86-c820f170edf2-sys\") pod \"perf-node-gather-daemonset-wxqkx\" (UID: \"d46101aa-b069-4233-8c86-c820f170edf2\") " pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:30.399936 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.399846    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz7ql\" (UniqueName: \"kubernetes.io/projected/d46101aa-b069-4233-8c86-c820f170edf2-kube-api-access-rz7ql\") pod \"perf-node-gather-daemonset-wxqkx\" (UID: \"d46101aa-b069-4233-8c86-c820f170edf2\") " pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:30.399936 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.399917    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d46101aa-b069-4233-8c86-c820f170edf2-podres\") pod \"perf-node-gather-daemonset-wxqkx\" (UID: \"d46101aa-b069-4233-8c86-c820f170edf2\") " pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:30.500362 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.500308    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d46101aa-b069-4233-8c86-c820f170edf2-lib-modules\") pod \"perf-node-gather-daemonset-wxqkx\" (UID: \"d46101aa-b069-4233-8c86-c820f170edf2\") " pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:30.500497 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.500373    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d46101aa-b069-4233-8c86-c820f170edf2-sys\") pod \"perf-node-gather-daemonset-wxqkx\" (UID: \"d46101aa-b069-4233-8c86-c820f170edf2\") " pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:30.500497 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.500413    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz7ql\" (UniqueName: \"kubernetes.io/projected/d46101aa-b069-4233-8c86-c820f170edf2-kube-api-access-rz7ql\") pod \"perf-node-gather-daemonset-wxqkx\" (UID: \"d46101aa-b069-4233-8c86-c820f170edf2\") " pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:30.500497 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.500459    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d46101aa-b069-4233-8c86-c820f170edf2-podres\") pod \"perf-node-gather-daemonset-wxqkx\" (UID: \"d46101aa-b069-4233-8c86-c820f170edf2\") " pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:30.500602 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.500514    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d46101aa-b069-4233-8c86-c820f170edf2-sys\") pod \"perf-node-gather-daemonset-wxqkx\" (UID: \"d46101aa-b069-4233-8c86-c820f170edf2\") " pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:30.500602 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.500540    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d46101aa-b069-4233-8c86-c820f170edf2-proc\") pod \"perf-node-gather-daemonset-wxqkx\" (UID: \"d46101aa-b069-4233-8c86-c820f170edf2\") " pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:30.500602 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.500515    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d46101aa-b069-4233-8c86-c820f170edf2-lib-modules\") pod \"perf-node-gather-daemonset-wxqkx\" (UID: \"d46101aa-b069-4233-8c86-c820f170edf2\") " pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:30.500741 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.500597    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d46101aa-b069-4233-8c86-c820f170edf2-proc\") pod \"perf-node-gather-daemonset-wxqkx\" (UID: \"d46101aa-b069-4233-8c86-c820f170edf2\") " pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:30.500741 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.500605    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d46101aa-b069-4233-8c86-c820f170edf2-podres\") pod \"perf-node-gather-daemonset-wxqkx\" (UID: \"d46101aa-b069-4233-8c86-c820f170edf2\") " pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:30.509992 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.509964    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz7ql\" (UniqueName: \"kubernetes.io/projected/d46101aa-b069-4233-8c86-c820f170edf2-kube-api-access-rz7ql\") pod \"perf-node-gather-daemonset-wxqkx\" (UID: \"d46101aa-b069-4233-8c86-c820f170edf2\") " pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:30.586192 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.586100    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:30.725599 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.725571    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"]
Jul 22 13:26:30.727917 ip-10-0-130-160 kubenswrapper[2556]: W0722 13:26:30.727890    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd46101aa_b069_4233_8c86_c820f170edf2.slice/crio-5615b978f9a398b5fe185cc9163a6130f51a62a0fc29cbf00e49a0fa48f9a5d3 WatchSource:0}: Error finding container 5615b978f9a398b5fe185cc9163a6130f51a62a0fc29cbf00e49a0fa48f9a5d3: Status 404 returned error can't find the container with id 5615b978f9a398b5fe185cc9163a6130f51a62a0fc29cbf00e49a0fa48f9a5d3
Jul 22 13:26:30.772798 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.772774    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/2.log"
Jul 22 13:26:30.777248 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:30.777224    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-89cqz_3f5ea1e0-8d3b-4303-883d-8ddd3d5c8d0e/console-operator/3.log"
Jul 22 13:26:31.286108 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:31.286077    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx" event={"ID":"d46101aa-b069-4233-8c86-c820f170edf2","Type":"ContainerStarted","Data":"d4d59a5d1d26ae583839591ee37beb3be5073f3a4035c8b859823dfbf6fa5a6e"}
Jul 22 13:26:31.286533 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:31.286127    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx" event={"ID":"d46101aa-b069-4233-8c86-c820f170edf2","Type":"ContainerStarted","Data":"5615b978f9a398b5fe185cc9163a6130f51a62a0fc29cbf00e49a0fa48f9a5d3"}
Jul 22 13:26:31.286533 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:31.286182    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:31.307554 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:31.307504    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx" podStartSLOduration=1.307486787 podStartE2EDuration="1.307486787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:26:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:26:31.305301361 +0000 UTC m=+2953.945547613" watchObservedRunningTime="2026-07-22 13:26:31.307486787 +0000 UTC m=+2953.947733065"
Jul 22 13:26:31.394191 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:31.394114    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-kt2xp_fb6be504-30f3-42cc-a1c4-2e8f7b877b10/download-server/0.log"
Jul 22 13:26:33.104423 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:33.104391    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qsxlb_c6a5585b-fbfa-40ab-af2c-a35ad338a96e/dns/0.log"
Jul 22 13:26:33.126772 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:33.126740    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qsxlb_c6a5585b-fbfa-40ab-af2c-a35ad338a96e/kube-rbac-proxy/0.log"
Jul 22 13:26:33.225050 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:33.225023    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bpdhv_aec9d056-2cee-42b8-bb4e-f333e1269945/dns-node-resolver/0.log"
Jul 22 13:26:33.784163 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:33.784119    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d7c7864bb-b8bbp_20354fab-3de4-4bac-ab80-8882442c7948/registry/0.log"
Jul 22 13:26:33.807456 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:33.807422    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-br64g_8ffd5eeb-b641-4040-ba1b-14a54f34aef2/node-ca/0.log"
Jul 22 13:26:34.970011 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:34.969980    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9dwnn_3c0d6b03-17c9-4668-805f-65c733666a58/discovery/0.log"
Jul 22 13:26:35.959953 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:35.959927    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wd2pd_def9b785-e1bd-4ef9-8542-e4bba57d302c/serve-healthcheck-canary/0.log"
Jul 22 13:26:36.455418 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:36.455380    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-2nnm8_202073f3-d747-4118-ba9a-6fda23b5198f/insights-operator/0.log"
Jul 22 13:26:36.455989 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:36.455760    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-2nnm8_202073f3-d747-4118-ba9a-6fda23b5198f/insights-operator/1.log"
Jul 22 13:26:36.553862 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:36.553836    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ksc9h_8c7b90fe-1503-4530-81f4-40e14ac76906/kube-rbac-proxy/0.log"
Jul 22 13:26:36.574946 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:36.574913    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ksc9h_8c7b90fe-1503-4530-81f4-40e14ac76906/exporter/0.log"
Jul 22 13:26:36.598068 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:36.598043    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ksc9h_8c7b90fe-1503-4530-81f4-40e14ac76906/extractor/0.log"
Jul 22 13:26:37.301475 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:37.301449    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wsp6t/perf-node-gather-daemonset-wxqkx"
Jul 22 13:26:39.356507 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:39.356477    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7646889cfb-2h96g_e693d09e-2348-42b0-b866-f988dc1b4eea/manager/0.log"
Jul 22 13:26:39.599085 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:39.599051    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d99b87cc7-dnvgz_3d28b833-e189-403c-a273-bf70485a73f5/manager/0.log"
Jul 22 13:26:39.627747 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:39.627718    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d99b87cc7-dnvgz_3d28b833-e189-403c-a273-bf70485a73f5/copy-manifests/0.log"
Jul 22 13:26:40.812511 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:40.812481    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9dwnn_3c0d6b03-17c9-4668-805f-65c733666a58/discovery/0.log"
Jul 22 13:26:41.021265 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:41.021235    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d84f87864-8b6vc_12567fb4-ed34-4538-8e7d-efdabb121a70/manager/0.log"
Jul 22 13:26:42.356836 ip-10-0-130-160 kubenswrapper[2556]: I0722 13:26:42.356798    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9dwnn_3c0d6b03-17c9-4668-805f-65c733666a58/discovery/0.log"