Jul 08 02:56:30.059361 ip-10-0-129-199 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 02:56:30.059375 ip-10-0-129-199 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 02:56:30.059383 ip-10-0-129-199 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 02:56:30.059683 ip-10-0-129-199 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 02:56:40.308427 ip-10-0-129-199 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 08 02:56:40.308446 ip-10-0-129-199 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4311cb7a5d1a4afbbc1a44bab3f56bd9 --
Jul 08 02:58:34.514659 ip-10-0-129-199 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 02:58:34.849526 ip-10-0-129-199 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 02:58:34.849526 ip-10-0-129-199 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 02:58:34.849526 ip-10-0-129-199 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 02:58:34.849526 ip-10-0-129-199 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 02:58:34.849526 ip-10-0-129-199 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 02:58:34.851303 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.851218    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 02:58:34.857677 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857654    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 02:58:34.857677 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857671    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 02:58:34.857677 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857675    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 02:58:34.857677 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857682    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 02:58:34.857677 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857687    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857690    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857693    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857697    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857700    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857703    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857705    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857708    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857711    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857713    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857716    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857718    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857721    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857723    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857726    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857729    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857731    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857733    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857736    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857738    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 02:58:34.857990 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857741    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857743    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857747    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857750    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857753    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857755    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857758    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857761    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857763    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857766    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857768    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857771    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857773    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857776    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857778    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857781    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857783    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857786    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857788    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 02:58:34.858477 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857790    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857793    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857795    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857798    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857800    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857804    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857807    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857811    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857814    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857816    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857819    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857821    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857824    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857826    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857829    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857832    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857834    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857836    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857839    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 02:58:34.858956 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857842    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857846    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857849    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857852    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857854    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857858    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857862    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857865    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857868    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857871    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857874    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857876    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857879    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857881    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857884    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857886    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857889    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857891    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857894    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 02:58:34.859441 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857896    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857900    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857907    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857910    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857912    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857915    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857918    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857920    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857923    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857925    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857928    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857931    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857933    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857936    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857939    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857941    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857944    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.857947    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858683    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858690    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 02:58:34.859925 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858692    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858695    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858698    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858701    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858705    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858710    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858713    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858716    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858718    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858733    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858736    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858741    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858743    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858746    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858748    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858752    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858755    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858757    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858759    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 02:58:34.860408 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858764    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858767    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858769    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858772    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858774    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858777    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858780    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858783    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858785    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858788    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858790    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858793    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858795    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858798    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858800    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858803    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858806    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858809    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858811    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858814    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 02:58:34.860929 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858816    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858839    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858842    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858845    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858848    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858851    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858854    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858856    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858859    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858861    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858864    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858866    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858869    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858871    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858874    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858876    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858879    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858881    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858884    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858886    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 02:58:34.861436 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858889    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858892    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858894    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858896    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858899    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858901    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858904    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858906    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858909    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858911    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858914    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858916    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858918    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858921    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858923    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858926    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858931    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858934    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858937    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 02:58:34.861916 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858939    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858941    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858944    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858947    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858949    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858952    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858954    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858956    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858959    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858961    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858964    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858967    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858970    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858972    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858975    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858977    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858980    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858982    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.858984    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 02:58:34.862386 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859367    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859373    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859376    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859379    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859381    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859384    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859387    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859389    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859392    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859394    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859397    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859399    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859402    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859404    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859407    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859409    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859412    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859416    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859420    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 02:58:34.862854 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859423    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859425    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859428    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859430    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859433    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859435    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859438    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859441    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859443    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859446    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859448    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859451    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859454    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859456    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859459    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859462    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859464    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859467    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859469    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 02:58:34.863316 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859472    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859474    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859476    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859479    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859481    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859483    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859486    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859488    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859490    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859493    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859495    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859498    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859501    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859504    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859506    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859508    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859511    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859513    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859519    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859521    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 02:58:34.863791 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859524    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859526    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859529    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859531    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859534    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859537    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859540    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859542    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859544    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859547    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859549    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859554    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859557    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859560    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859563    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859566    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859568    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859572    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859575    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859577    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 02:58:34.864267 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859580    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859583    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859586    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859588    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859592    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859594    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859597    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859600    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859602    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859605    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859609    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859612    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859615    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859618    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859620    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859623    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859625    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859628    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859630    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859632    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 02:58:34.864788 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.859635    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859705    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859712    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859718    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859722    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859726    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859730    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859744    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859748    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859751    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859753    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859757    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859760    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859763    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859765    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859768    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859771    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859775    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859778    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859782    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859784    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859787    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859793    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859796    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 02:58:34.865270 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859800    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859802    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859805    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859808    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859811    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859814    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859816    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859819    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859822    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859826    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859829    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859831    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859834    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859837    2578 flags.go:64] FLAG: --enable-server="true"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859840    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859844    2578 flags.go:64] FLAG: --event-burst="100"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859847    2578 flags.go:64] FLAG: --event-qps="50"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859849    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859852    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859855    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859860    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859863    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859866    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859868    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859871    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 02:58:34.865877 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859874    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859877    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859880    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859883    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859885    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859889    2578 flags.go:64] FLAG: --feature-gates=""
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859893    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859895    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859898    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859901    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859904    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859907    2578 flags.go:64] FLAG: --help="false"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859909    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-129-199.ec2.internal"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859912    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859915    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859918    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859921    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859924    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859926    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859929    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859932    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859935    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859938    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859940    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 02:58:34.866516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859943    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859946    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859948    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859952    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859955    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859957    2578 flags.go:64] FLAG: --lock-file=""
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859960    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859963    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859966    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859971    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859974    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859976    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859979    2578 flags.go:64] FLAG: --logging-format="text"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859982    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859986    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859988    2578 flags.go:64] FLAG: --manifest-url=""
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859991    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859994    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.859997    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860001    2578 flags.go:64] FLAG: --max-pods="110"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860003    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860006    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860009    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860012    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860014    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 02:58:34.867117 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860017    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860020    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860026    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860029    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860032    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860035    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860038    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860042    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860045    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860047    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860051    2578 flags.go:64] FLAG: --port="10250"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860054    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860057    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-002244425be471006"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860060    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860062    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860065    2578 flags.go:64] FLAG: --register-node="true"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860068    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860071    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860074    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860077    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860079    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860083    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860086    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860089    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860092    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 02:58:34.867733 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860094    2578 flags.go:64] FLAG: --runonce="false"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860097    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860100    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860103    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860105    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860108    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860111    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860113    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860116    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860119    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860122    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860124    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860127    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860130    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860132    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860135    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860140    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860144    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860146    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860150    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860152    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860155    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860158    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860161    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860163    2578 flags.go:64] FLAG: --v="2"
Jul 08 02:58:34.868339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860167    2578 flags.go:64] FLAG: --version="false"
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860171    2578 flags.go:64] FLAG: --vmodule=""
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860174    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.860178    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860288    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860292    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860295    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860298    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860300    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860303    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860306    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860309    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860311    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860313    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860316    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860318    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860320    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860323    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860327    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860330    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 02:58:34.869047 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860333    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860335    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860338    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860340    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860343    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860360    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860362    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860365    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860367    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860370    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860372    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860375    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860377    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860379    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860382    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860385    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860387    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860390    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860393    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 02:58:34.869569 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860397    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860400    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860403    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860405    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860408    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860411    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860414    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860416    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860419    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860421    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860424    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860426    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860429    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860431    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860433    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860436    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860438    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860443    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860445    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 02:58:34.870030 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860448    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860451    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860454    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860457    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860460    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860462    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860465    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860468    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860470    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860474    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860476    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860479    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860482    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860484    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860487    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860489    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860491    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860494    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860496    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860498    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 02:58:34.870501 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860501    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860503    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860506    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860508    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860511    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860513    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860516    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860518    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860520    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860523    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860526    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860529    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860531    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860535    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860539    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860542    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860545    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860548    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860550    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860553    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 02:58:34.871015 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860555    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 02:58:34.871521 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860558    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 02:58:34.871521 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860561    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 02:58:34.871521 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860563    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 02:58:34.871521 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.860565    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 02:58:34.871521 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.861109    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 02:58:34.871521 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.868000    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 02:58:34.871521 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.868016    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 02:58:34.871521 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.868815    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 02:58:34.871521 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.868823    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 02:58:34.871521 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868886    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 02:58:34.871521 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868891    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 02:58:34.871521 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868894    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 02:58:34.871521 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868897    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 02:58:34.871521 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868900    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 02:58:34.871521 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868903    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868905    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868908    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868911    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868913    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868916    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868918    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868921    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868923    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868926    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868928    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868931    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868934    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868936    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868939    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868941    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868944    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868946    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868948    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868951    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 02:58:34.871899 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868967    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868971    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868974    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868977    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868981    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868983    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868986    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868990    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868994    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868997    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.868999    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869002    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869005    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869008    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869011    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869013    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869016    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869018    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869021    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 02:58:34.872428 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869024    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869026    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869028    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869031    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869034    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869038    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869041    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869043    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869046    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869049    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869052    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869055    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869057    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869060    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869062    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869065    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869067    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869070    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869074    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869076    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 02:58:34.872914 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869079    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869081    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869084    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869086    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869089    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869091    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869093    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869095    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869098    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869100    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869103    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869105    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869107    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869110    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869112    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869114    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869117    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869120    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869122    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869124    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 02:58:34.873416 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869127    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 02:58:34.873885 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869129    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 02:58:34.873885 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869131    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 02:58:34.873885 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869134    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 02:58:34.873885 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869136    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 02:58:34.873885 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869140    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 02:58:34.873885 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869143    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 02:58:34.873885 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869146    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 02:58:34.873885 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869149    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 02:58:34.873885 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869152    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 02:58:34.873885 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869155    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 02:58:34.873885 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869163    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 02:58:34.873885 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869165    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 02:58:34.873885 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869168    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 02:58:34.873885 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869170    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 02:58:34.873885 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.869176    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869337    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869341    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869343    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869359    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869361    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869364    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869368    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869371    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869374    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869377    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869380    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869382    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869385    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869387    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869390    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869392    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869395    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869397    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869399    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 02:58:34.874249 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869402    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869404    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869406    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869409    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869412    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869415    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869419    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869422    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869424    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869433    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869436    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869438    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869441    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869444    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869446    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869448    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869451    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869453    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869455    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869458    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 02:58:34.874771 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869460    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869462    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869465    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869467    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869469    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869471    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869474    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869476    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869479    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869481    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869484    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869492    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869495    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869498    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869500    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869503    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869505    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869507    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869510    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 02:58:34.875257 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869513    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869515    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869517    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869525    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869528    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869530    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869532    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869535    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869537    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869539    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869541    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869544    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869546    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869548    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869551    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869553    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869555    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869557    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869560    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 02:58:34.875714 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869562    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869564    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869567    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869569    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869571    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869574    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869576    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869579    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869581    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869584    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869586    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869588    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869591    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869593    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869596    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869598    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869600    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869608    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869610    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869613    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 02:58:34.876160 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869615    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 02:58:34.876639 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:34.869618    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 02:58:34.876639 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.869622    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 02:58:34.876639 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.869737    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 02:58:34.876639 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.871748    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 02:58:34.876639 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.873126    2578 server.go:1019] "Starting client certificate rotation"
Jul 08 02:58:34.876639 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.873242    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 02:58:34.876639 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.873275    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 02:58:34.876639 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.875317    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 02:58:34.876888 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.876861    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 02:58:34.890558 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.890535    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 08 02:58:34.892494 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.892479    2578 log.go:25] "Validated CRI v1 image API"
Jul 08 02:58:34.895449 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.895427    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 02:58:34.897873 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.897854    2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b1857964-3c04-42b6-bb02-3eb3b73a3a7b:/dev/nvme0n1p4 e3895421-829e-4146-bdb5-b4aae1c8269a:/dev/nvme0n1p3]
Jul 08 02:58:34.897926 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.897873    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 02:58:34.902753 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.902628    2578 manager.go:216] Machine: {Timestamp:2026-07-08 02:58:34.902125091 +0000 UTC m=+0.280797609 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3059177 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23660af39bd7d0db2b84aa2035783d SystemUUID:ec23660a-f39b-d7d0-db2b-84aa2035783d BootID:4311cb7a-5d1a-4afb-bc1a-44bab3f56bd9 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b5:a8:f2:fc:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b5:a8:f2:fc:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:11:e3:de:f8:52 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 02:58:34.902753 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.902733    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 02:58:34.902857 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.902801    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 02:58:34.905595 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.905573    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 02:58:34.905774 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.905598    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-199.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 02:58:34.906328 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.906318    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 02:58:34.906374 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.906331    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 02:58:34.906374 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.906337    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 02:58:34.906878 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.906867    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 02:58:34.908086 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.908076    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 02:58:34.911669 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.911653    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 02:58:34.911914 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.911902    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 02:58:34.912171 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.912161    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 02:58:34.912200 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.912191    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 02:58:34.912231 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.912201    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 02:58:34.912231 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.912217    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 02:58:34.912231 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.912227    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 08 02:58:34.912317 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.912236    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 02:58:34.912665 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.912652    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 02:58:34.912704 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.912682    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 02:58:34.914486 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.914459    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 02:58:34.916442 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.916422    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 02:58:34.916489 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.916459    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 02:58:34.917890 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.917867    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 02:58:34.917965 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.917898    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 02:58:34.917965 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.917908    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 02:58:34.917965 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.917917    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 02:58:34.917965 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.917937    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 02:58:34.917965 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.917947    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 02:58:34.917965 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.917960    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 02:58:34.917965 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.917967    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 02:58:34.918261 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.917979    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 02:58:34.918261 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.917989    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 02:58:34.918261 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.918003    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 02:58:34.918261 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.918012    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 02:58:34.918261 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.918044    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 02:58:34.918261 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.918053    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 02:58:34.921485 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.921471    2578 server.go:1268] "Started kubelet"
Jul 08 02:58:34.921666 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.921625    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 02:58:34.921726 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.921565    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 02:58:34.921726 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.921692    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 02:58:34.922470 ip-10-0-129-199 systemd[1]: Started Kubernetes Kubelet.
Jul 08 02:58:34.922823 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.922749    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 02:58:34.922975 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:34.922947    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 02:58:34.923072 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.923025    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-199.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 02:58:34.923072 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:34.923048    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 02:58:34.924995 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.923901    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 02:58:34.925880 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:34.925862    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 02:58:34.928387 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.928370    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 02:58:34.928469 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.928372    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 02:58:34.928536 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:34.928488    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-199.ec2.internal\" not found"
Jul 08 02:58:34.929036 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.929020    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 02:58:34.929111 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.929023    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 02:58:34.929111 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.929048    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 02:58:34.929203 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.929117    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 02:58:34.929203 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.929130    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 02:58:34.929613 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.929593    2578 factory.go:55] Registering systemd factory
Jul 08 02:58:34.929689 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.929633    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 08 02:58:34.929868 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.929855    2578 factory.go:153] Registering CRI-O factory
Jul 08 02:58:34.929915 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.929872    2578 factory.go:223] Registration of the crio container factory successfully
Jul 08 02:58:34.929945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.929921    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 02:58:34.929945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.929941    2578 factory.go:103] Registering Raw factory
Jul 08 02:58:34.930018 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.929951    2578 manager.go:1196] Started watching for new ooms in manager
Jul 08 02:58:34.930813 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.930792    2578 manager.go:349] Starting recovery of all containers
Jul 08 02:58:34.934705 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:34.934677    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 02:58:34.934895 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:34.934871    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 02:58:34.935877 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:34.934902    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-199.ec2.internal.18c0312b6713a1b4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-199.ec2.internal,UID:ip-10-0-129-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-199.ec2.internal,},FirstTimestamp:2026-07-08 02:58:34.921410996 +0000 UTC m=+0.300083518,LastTimestamp:2026-07-08 02:58:34.921410996 +0000 UTC m=+0.300083518,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-199.ec2.internal,}"
Jul 08 02:58:34.942553 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.942302    2578 manager.go:354] Recovery completed
Jul 08 02:58:34.943164 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.943136    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 02:58:34.947271 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.947247    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 02:58:34.949285 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.949255    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 02:58:34.949375 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.949299    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 02:58:34.949375 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.949310    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasSufficientPID"
Jul 08 02:58:34.949843 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.949827    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 02:58:34.949898 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.949841    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 02:58:34.949898 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.949842    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 02:58:34.949965 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.949899    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 02:58:34.950638 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.950622    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 02:58:34.950699 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.950649    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 02:58:34.950699 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.950660    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasSufficientPID"
Jul 08 02:58:34.951832 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:34.951766    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-199.ec2.internal.18c0312b68bcf34a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-199.ec2.internal,UID:ip-10-0-129-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-199.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-199.ec2.internal,},FirstTimestamp:2026-07-08 02:58:34.949284682 +0000 UTC m=+0.327957202,LastTimestamp:2026-07-08 02:58:34.949284682 +0000 UTC m=+0.327957202,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-199.ec2.internal,}"
Jul 08 02:58:34.952043 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.952031    2578 policy_none.go:49] "None policy: Start"
Jul 08 02:58:34.952082 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.952047    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 02:58:34.952082 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.952059    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 02:58:34.954001 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.953990    2578 policy_none.go:47] "Start"
Jul 08 02:58:34.958883 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.958867    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k74sf"
Jul 08 02:58:34.960713 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:34.960644    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-199.ec2.internal.18c0312b68bd407f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-199.ec2.internal,UID:ip-10-0-129-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-199.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-199.ec2.internal,},FirstTimestamp:2026-07-08 02:58:34.949304447 +0000 UTC m=+0.327976963,LastTimestamp:2026-07-08 02:58:34.949304447 +0000 UTC m=+0.327976963,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-199.ec2.internal,}"
Jul 08 02:58:34.969135 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.969119    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k74sf"
Jul 08 02:58:34.971979 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:34.971920    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-199.ec2.internal.18c0312b68bd6710  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-199.ec2.internal,UID:ip-10-0-129-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-199.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-199.ec2.internal,},FirstTimestamp:2026-07-08 02:58:34.94931432 +0000 UTC m=+0.327986839,LastTimestamp:2026-07-08 02:58:34.94931432 +0000 UTC m=+0.327986839,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-199.ec2.internal,}"
Jul 08 02:58:34.987875 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.987861    2578 manager.go:337] "Starting Device Plugin manager"
Jul 08 02:58:34.987941 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:34.987889    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 02:58:34.987941 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.987899    2578 server.go:87] "Starting device plugin registration server"
Jul 08 02:58:34.988130 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.988117    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 02:58:34.988209 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.988136    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 02:58:34.988267 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.988219    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 02:58:34.988320 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.988288    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 02:58:34.988320 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:34.988296    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 02:58:34.988797 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:34.988781    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 02:58:34.988874 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:34.988825    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-199.ec2.internal\" not found"
Jul 08 02:58:35.088633 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.088605    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 02:58:35.090849 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.089768    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 02:58:35.090849 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.089800    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 02:58:35.090849 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.089812    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasSufficientPID"
Jul 08 02:58:35.090849 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.089840    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-199.ec2.internal"
Jul 08 02:58:35.090849 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.090462    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 02:58:35.090849 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.090496    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 02:58:35.090849 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.090514    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 02:58:35.090849 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:35.090548    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 02:58:35.092984 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.092963    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 02:58:35.098686 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.098672    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-199.ec2.internal"
Jul 08 02:58:35.098756 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:35.098692    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-199.ec2.internal\": node \"ip-10-0-129-199.ec2.internal\" not found"
Jul 08 02:58:35.115413 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:35.115366    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-199.ec2.internal\" not found"
Jul 08 02:58:35.191484 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.191455    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-199.ec2.internal"]
Jul 08 02:58:35.191609 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.191536    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 02:58:35.192528 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.192507    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 02:58:35.192613 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.192540    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 02:58:35.192613 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.192553    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasSufficientPID"
Jul 08 02:58:35.194920 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.194908    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 02:58:35.195048 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.195023    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal"
Jul 08 02:58:35.195084 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.195064    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 02:58:35.195638 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.195621    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 02:58:35.195718 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.195649    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 02:58:35.195718 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.195659    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasSufficientPID"
Jul 08 02:58:35.195718 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.195623    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 02:58:35.195828 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.195729    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 02:58:35.195828 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.195745    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasSufficientPID"
Jul 08 02:58:35.198047 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.198034    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-199.ec2.internal"
Jul 08 02:58:35.198092 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.198059    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 02:58:35.198763 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.198749    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 02:58:35.198837 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.198780    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 02:58:35.198837 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.198790    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasSufficientPID"
Jul 08 02:58:35.216463 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:35.216442    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-199.ec2.internal\" not found"
Jul 08 02:58:35.223963 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:35.223939    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-199.ec2.internal\" not found" node="ip-10-0-129-199.ec2.internal"
Jul 08 02:58:35.228219 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:35.228205    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-199.ec2.internal\" not found" node="ip-10-0-129-199.ec2.internal"
Jul 08 02:58:35.230601 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.230586    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/28c3d83165714afd5c813ea9bf1f9be6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal\" (UID: \"28c3d83165714afd5c813ea9bf1f9be6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal"
Jul 08 02:58:35.230660 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.230608    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28c3d83165714afd5c813ea9bf1f9be6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal\" (UID: \"28c3d83165714afd5c813ea9bf1f9be6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal"
Jul 08 02:58:35.230660 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.230629    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f0d215397ef53c1ac6c0801c250e71f7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-199.ec2.internal\" (UID: \"f0d215397ef53c1ac6c0801c250e71f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-199.ec2.internal"
Jul 08 02:58:35.317050 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:35.317023    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-199.ec2.internal\" not found"
Jul 08 02:58:35.331398 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.331377    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28c3d83165714afd5c813ea9bf1f9be6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal\" (UID: \"28c3d83165714afd5c813ea9bf1f9be6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal"
Jul 08 02:58:35.331455 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.331408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f0d215397ef53c1ac6c0801c250e71f7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-199.ec2.internal\" (UID: \"f0d215397ef53c1ac6c0801c250e71f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-199.ec2.internal"
Jul 08 02:58:35.331455 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.331434    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/28c3d83165714afd5c813ea9bf1f9be6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal\" (UID: \"28c3d83165714afd5c813ea9bf1f9be6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal"
Jul 08 02:58:35.331516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.331470    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28c3d83165714afd5c813ea9bf1f9be6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal\" (UID: \"28c3d83165714afd5c813ea9bf1f9be6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal"
Jul 08 02:58:35.331516 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.331470    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f0d215397ef53c1ac6c0801c250e71f7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-199.ec2.internal\" (UID: \"f0d215397ef53c1ac6c0801c250e71f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-199.ec2.internal"
Jul 08 02:58:35.331578 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.331550    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/28c3d83165714afd5c813ea9bf1f9be6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal\" (UID: \"28c3d83165714afd5c813ea9bf1f9be6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal"
Jul 08 02:58:35.417849 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:35.417776    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-199.ec2.internal\" not found"
Jul 08 02:58:35.518388 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:35.518332    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-199.ec2.internal\" not found"
Jul 08 02:58:35.526511 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.526490    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal"
Jul 08 02:58:35.531751 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:35.531343    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-199.ec2.internal"
Jul 08 02:58:35.618466 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:35.618432    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-199.ec2.internal\" not found"
Jul 08 02:58:35.718966 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:35.718890    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-199.ec2.internal\" not found"
Jul 08 02:58:36.885810 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:36.885790    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-199.ec2.internal\" not found"
Jul 08 02:58:36.939263 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:36.939235    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 02:58:36.939838 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:36.939379    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 02:58:36.986721 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:36.986697    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-199.ec2.internal\" not found"
Jul 08 02:58:37.040898 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.040818    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 02:53:36 +0000 UTC" deadline="2027-12-23 23:40:28.788140452 +0000 UTC"
Jul 08 02:58:37.040898 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.040848    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12812h41m51.747295221s"
Jul 08 02:58:37.087108 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:37.087084    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-199.ec2.internal\" not found"
Jul 08 02:58:37.162772 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.162735    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 02:58:37.163693 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.163675    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 02:58:37.164114 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.164092    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 02:58:37.164172 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.164123    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeHasSufficientPID"
Jul 08 02:58:37.187712 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:37.187686    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-199.ec2.internal\" not found"
Jul 08 02:58:37.238967 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:37.238942    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0d215397ef53c1ac6c0801c250e71f7.slice/crio-b58fe17e3869b7239160d388626161f51a4c2baa7310949c9137da167bd5ffc1 WatchSource:0}: Error finding container b58fe17e3869b7239160d388626161f51a4c2baa7310949c9137da167bd5ffc1: Status 404 returned error can't find the container with id b58fe17e3869b7239160d388626161f51a4c2baa7310949c9137da167bd5ffc1
Jul 08 02:58:37.239506 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:37.239486    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28c3d83165714afd5c813ea9bf1f9be6.slice/crio-be9984c70ff157fb508f1be325b167ae173781da18238af243f6648b4b8cd930 WatchSource:0}: Error finding container be9984c70ff157fb508f1be325b167ae173781da18238af243f6648b4b8cd930: Status 404 returned error can't find the container with id be9984c70ff157fb508f1be325b167ae173781da18238af243f6648b4b8cd930
Jul 08 02:58:37.244007 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.243993    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 02:58:37.287986 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:37.287954    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-199.ec2.internal\" not found"
Jul 08 02:58:37.330759 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.330694    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 02:58:37.344554 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.344533    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 02:58:37.388668 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:37.388646    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-199.ec2.internal\" not found"
Jul 08 02:58:37.429432 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.429414    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 02:58:37.495356 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.495332    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal"
Jul 08 02:58:37.509752 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.509724    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 02:58:37.510579 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.510565    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-199.ec2.internal"
Jul 08 02:58:37.518938 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.518916    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 02:58:37.979870 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.979839    2578 apiserver.go:52] "Watching apiserver"
Jul 08 02:58:37.987167 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.987139    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 02:58:37.987694 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.987662    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-g4z7x","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr","openshift-dns/node-resolver-xkw9w","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal","openshift-multus/multus-additional-cni-plugins-jmppx","openshift-multus/network-metrics-daemon-x592x","openshift-network-operator/iptables-alerter-qnc7h","kube-system/konnectivity-agent-ckmrk","kube-system/kube-apiserver-proxy-ip-10-0-129-199.ec2.internal","openshift-cluster-node-tuning-operator/tuned-bnrlz","openshift-image-registry/node-ca-n6xhm","openshift-multus/multus-mjsmm","openshift-network-diagnostics/network-check-target-25r5t","openshift-ovn-kubernetes/ovnkube-node-9qk6k"]
Jul 08 02:58:37.990310 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.990290    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:37.992469 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.992445    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 02:58:37.992564 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.992507    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:58:37.992564 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.992519    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 02:58:37.992664 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:37.992605    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:58:37.993076 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.992865    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v22j4\""
Jul 08 02:58:37.995371 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.995353    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xkw9w"
Jul 08 02:58:37.996103 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.996087    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 02:58:37.997494 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.997475    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lxsm9\""
Jul 08 02:58:37.998005 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.997988    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 02:58:37.998193 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.998176    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 02:58:37.998646 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:37.998623    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.000537 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.000522    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 02:58:38.000974 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.000957    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 02:58:38.001204 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.001188    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5bjbp\""
Jul 08 02:58:38.001383 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.001367    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 02:58:38.001547 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.001532    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 02:58:38.002162 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.002143    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 02:58:38.002263 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.002245    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 02:58:38.002454 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.002403    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.004891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.004203    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:38.004891 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:38.004285    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:58:38.004891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.004718    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 02:58:38.006891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-host\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.006891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005429    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkjsn\" (UniqueName: \"kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn\") pod \"network-check-target-25r5t\" (UID: \"45d27e40-2605-4821-b3de-ddb132f8e960\") " pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:58:38.006891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005455    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7185a770-f816-4a15-a0d4-96f547358ca4-hosts-file\") pod \"node-resolver-xkw9w\" (UID: \"7185a770-f816-4a15-a0d4-96f547358ca4\") " pod="openshift-dns/node-resolver-xkw9w"
Jul 08 02:58:38.006891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-node-log\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.006891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005526    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-cni-netd\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.006891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-systemd\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.006891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-modprobe-d\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.006891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005605    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-sysconfig\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.006891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005635    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9be83672-3189-422e-a337-6c904734991f-ovn-node-metrics-cert\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.006891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005664    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-lib-modules\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.006891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fd76711-4ffb-4e0c-8fac-6521dda5af88-tmp\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.006891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7185a770-f816-4a15-a0d4-96f547358ca4-tmp-dir\") pod \"node-resolver-xkw9w\" (UID: \"7185a770-f816-4a15-a0d4-96f547358ca4\") " pod="openshift-dns/node-resolver-xkw9w"
Jul 08 02:58:38.006891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005770    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-systemd-units\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.006891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005797    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-var-lib-openvswitch\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.006891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005823    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-run-ovn\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.006891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-cni-bin\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.006891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005872    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 02:58:38.007731 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005883    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.007731 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-sysctl-d\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.007731 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005941    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-etc-openvswitch\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.007731 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9be83672-3189-422e-a337-6c904734991f-ovnkube-script-lib\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.007731 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.005997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-run\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.007731 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-sys\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.007731 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006054    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzsqv\" (UniqueName: \"kubernetes.io/projected/7185a770-f816-4a15-a0d4-96f547358ca4-kube-api-access-hzsqv\") pod \"node-resolver-xkw9w\" (UID: \"7185a770-f816-4a15-a0d4-96f547358ca4\") " pod="openshift-dns/node-resolver-xkw9w"
Jul 08 02:58:38.007731 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006081    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 02:58:38.007731 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006279    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9d7lj\""
Jul 08 02:58:38.007731 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006082    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-run-netns\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.007731 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006360    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-run-systemd\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.007731 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006391    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.007731 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006421    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-run-openvswitch\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.007731 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006433    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 02:58:38.007731 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006450    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-log-socket\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.007731 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006473    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9be83672-3189-422e-a337-6c904734991f-ovnkube-config\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.007731 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncxwl\" (UniqueName: \"kubernetes.io/projected/9be83672-3189-422e-a337-6c904734991f-kube-api-access-ncxwl\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.007731 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006534    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-var-lib-kubelet\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.008568 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5p7p\" (UniqueName: \"kubernetes.io/projected/1fd76711-4ffb-4e0c-8fac-6521dda5af88-kube-api-access-m5p7p\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.008568 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006586    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-kubelet\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.008568 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006603    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 02:58:38.008568 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006612    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9be83672-3189-422e-a337-6c904734991f-env-overrides\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.008568 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006639    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-kubernetes\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.008568 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-sysctl-conf\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.008568 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006693    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-tuned\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.008568 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.006718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-slash\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.010315 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.009661    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ckmrk"
Jul 08 02:58:38.014452 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.012337    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 02:58:38.014452 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.012633    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 02:58:38.014452 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.013697    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fms2t\""
Jul 08 02:58:38.015578 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.015547    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 02:58:38.016688 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.016672    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qnc7h"
Jul 08 02:58:38.018801 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.018764    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 02:58:38.019077 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.019056    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h2vcg\""
Jul 08 02:58:38.019359 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.019340    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 02:58:38.019623 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.019606    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 02:58:38.020421 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.020407    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.024092 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.022260    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 02:58:38.024092 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.022638    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 02:58:38.024092 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.022882    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-84b7w\""
Jul 08 02:58:38.024092 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.023091    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 02:58:38.024092 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.023944    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:38.024092 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:38.024010    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:58:38.026372 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.026351    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n6xhm"
Jul 08 02:58:38.028641 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.028619    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.029521 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.029503    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 02:58:38.029892 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.029873    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 02:58:38.029966 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.029901    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 02:58:38.030020 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.029876    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-54l6t\""
Jul 08 02:58:38.030365 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.030337    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 02:58:38.030712 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.030698    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6rhz5\""
Jul 08 02:58:38.032901 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.032876    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p787g"
Jul 08 02:58:38.040407 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.040392    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p787g"
Jul 08 02:58:38.096824 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.096805    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 02:58:38.107018 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.106993    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9be83672-3189-422e-a337-6c904734991f-ovn-node-metrics-cert\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.107018 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107022    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wf6g\" (UniqueName: \"kubernetes.io/projected/647808da-5f74-4c15-911c-579b771d7dfc-kube-api-access-5wf6g\") pod \"iptables-alerter-qnc7h\" (UID: \"647808da-5f74-4c15-911c-579b771d7dfc\") " pod="openshift-network-operator/iptables-alerter-qnc7h"
Jul 08 02:58:38.107239 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-cnibin\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.107239 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107063    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7185a770-f816-4a15-a0d4-96f547358ca4-tmp-dir\") pod \"node-resolver-xkw9w\" (UID: \"7185a770-f816-4a15-a0d4-96f547358ca4\") " pod="openshift-dns/node-resolver-xkw9w"
Jul 08 02:58:38.107239 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107079    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-systemd-units\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.107239 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107099    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-var-lib-openvswitch\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.107239 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-run-ovn\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.107239 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7bad4d47-f01a-458a-97e6-ed54b119e2f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.107239 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-sysctl-d\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.107239 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9be83672-3189-422e-a337-6c904734991f-ovnkube-script-lib\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.107239 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107197    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2b7k\" (UniqueName: \"kubernetes.io/projected/5e6bae47-a81a-461c-94da-98c89694c300-kube-api-access-z2b7k\") pod \"network-metrics-daemon-x592x\" (UID: \"5e6bae47-a81a-461c-94da-98c89694c300\") " pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:38.107239 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c039d8af-51c0-4e88-b104-9c7ec5d407aa-dbus\") pod \"global-pull-secret-syncer-g4z7x\" (UID: \"c039d8af-51c0-4e88-b104-9c7ec5d407aa\") " pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:38.107239 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107223    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-system-cni-dir\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.107714 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107255    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a341499c-4d33-4b75-8da2-7d2f54ef4919-cni-binary-copy\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.107714 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzsqv\" (UniqueName: \"kubernetes.io/projected/7185a770-f816-4a15-a0d4-96f547358ca4-kube-api-access-hzsqv\") pod \"node-resolver-xkw9w\" (UID: \"7185a770-f816-4a15-a0d4-96f547358ca4\") " pod="openshift-dns/node-resolver-xkw9w"
Jul 08 02:58:38.107714 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107285    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-run-netns\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.107714 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-run-systemd\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.107714 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107315    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7bad4d47-f01a-458a-97e6-ed54b119e2f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.107714 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107331    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-etc-kubernetes\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.107714 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107347    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9be83672-3189-422e-a337-6c904734991f-ovnkube-config\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.107714 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncxwl\" (UniqueName: \"kubernetes.io/projected/9be83672-3189-422e-a337-6c904734991f-kube-api-access-ncxwl\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.107714 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bad4d47-f01a-458a-97e6-ed54b119e2f5-system-cni-dir\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.107714 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107430    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 02:58:38.107714 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107433    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-host-var-lib-cni-multus\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.107714 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-var-lib-kubelet\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.107714 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107480    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bad4d47-f01a-458a-97e6-ed54b119e2f5-os-release\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.107714 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107496    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.107714 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107509    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-etc-selinux\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.107714 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107523    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhqtw\" (UniqueName: \"kubernetes.io/projected/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-kube-api-access-nhqtw\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.107714 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107522    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-systemd-units\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.108375 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c039d8af-51c0-4e88-b104-9c7ec5d407aa-kubelet-config\") pod \"global-pull-secret-syncer-g4z7x\" (UID: \"c039d8af-51c0-4e88-b104-9c7ec5d407aa\") " pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:38.108375 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-host-var-lib-cni-bin\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.108375 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107614    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwhc4\" (UniqueName: \"kubernetes.io/projected/a341499c-4d33-4b75-8da2-7d2f54ef4919-kube-api-access-hwhc4\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.108375 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107646    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-slash\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.108375 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.107670    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-sys-fs\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.113504 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.111792    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-multus-socket-dir-parent\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.113504 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.111846    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-run-ovn\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.113504 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.111857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-host\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.113504 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.111863    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-var-lib-openvswitch\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.113504 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.111893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7185a770-f816-4a15-a0d4-96f547358ca4-hosts-file\") pod \"node-resolver-xkw9w\" (UID: \"7185a770-f816-4a15-a0d4-96f547358ca4\") " pod="openshift-dns/node-resolver-xkw9w"
Jul 08 02:58:38.113504 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.111945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-cni-netd\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.113504 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.111950    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7185a770-f816-4a15-a0d4-96f547358ca4-hosts-file\") pod \"node-resolver-xkw9w\" (UID: \"7185a770-f816-4a15-a0d4-96f547358ca4\") " pod="openshift-dns/node-resolver-xkw9w"
Jul 08 02:58:38.113504 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.111951    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-sysctl-d\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.113504 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.111985    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-multus-conf-dir\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.113504 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112078    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-run-netns\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.113504 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112116    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a341499c-4d33-4b75-8da2-7d2f54ef4919-multus-daemon-config\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.113504 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112138    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-run-systemd\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.113504 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112155    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-sysconfig\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.113504 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112204    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-cni-netd\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.113504 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112219    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-sysconfig\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.113504 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112259    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/85004f35-1268-4e27-baef-42b30549f61a-serviceca\") pod \"node-ca-n6xhm\" (UID: \"85004f35-1268-4e27-baef-42b30549f61a\") " pod="openshift-image-registry/node-ca-n6xhm"
Jul 08 02:58:38.113504 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112294    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-host-run-k8s-cni-cncf-io\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.113504 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112346    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-lib-modules\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.114722 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112373    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9be83672-3189-422e-a337-6c904734991f-ovn-node-metrics-cert\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.114722 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112392    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fd76711-4ffb-4e0c-8fac-6521dda5af88-tmp\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.114722 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112425    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-cni-bin\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.114722 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.114722 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-etc-openvswitch\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.114722 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112492    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-host\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.114722 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.111948    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-slash\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.114722 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112530    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9be83672-3189-422e-a337-6c904734991f-ovnkube-script-lib\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.114722 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112650    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-var-lib-kubelet\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.114722 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112727    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-lib-modules\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.114722 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112734    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9be83672-3189-422e-a337-6c904734991f-ovnkube-config\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.114722 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112781    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-os-release\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.114722 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112824    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-host-var-lib-kubelet\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.114722 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112896    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-run\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.114722 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112921    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-sys\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.114722 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112930    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7185a770-f816-4a15-a0d4-96f547358ca4-tmp-dir\") pod \"node-resolver-xkw9w\" (UID: \"7185a770-f816-4a15-a0d4-96f547358ca4\") " pod="openshift-dns/node-resolver-xkw9w"
Jul 08 02:58:38.114722 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.112951    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.114722 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113020    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-etc-openvswitch\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.115581 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113051    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.115581 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113081    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.115581 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113106    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-run\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.115581 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113157    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-sys\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.115581 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113193    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-cni-bin\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.115581 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113223    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-socket-dir\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.115581 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113268    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-multus-cni-dir\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.115581 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-run-openvswitch\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.115581 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-log-socket\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.115581 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113371    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bad4d47-f01a-458a-97e6-ed54b119e2f5-cnibin\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.115581 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113403    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bad4d47-f01a-458a-97e6-ed54b119e2f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.115581 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113411    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-run-openvswitch\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.115581 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113434    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bad4d47-f01a-458a-97e6-ed54b119e2f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.115581 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113442    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-log-socket\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.115581 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/647808da-5f74-4c15-911c-579b771d7dfc-host-slash\") pod \"iptables-alerter-qnc7h\" (UID: \"647808da-5f74-4c15-911c-579b771d7dfc\") " pod="openshift-network-operator/iptables-alerter-qnc7h"
Jul 08 02:58:38.115581 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret\") pod \"global-pull-secret-syncer-g4z7x\" (UID: \"c039d8af-51c0-4e88-b104-9c7ec5d407aa\") " pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:38.115581 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5p7p\" (UniqueName: \"kubernetes.io/projected/1fd76711-4ffb-4e0c-8fac-6521dda5af88-kube-api-access-m5p7p\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.116337 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113593    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-kubelet\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.116337 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9be83672-3189-422e-a337-6c904734991f-env-overrides\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.116337 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113676    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-host-kubelet\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.116337 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113735    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs\") pod \"network-metrics-daemon-x592x\" (UID: \"5e6bae47-a81a-461c-94da-98c89694c300\") " pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:38.116337 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113787    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-host-run-netns\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.116337 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-host-run-multus-certs\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.116337 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-kubernetes\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.116337 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-sysctl-conf\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.116337 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.113986    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-kubernetes\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.116337 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114013    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-sysctl-conf\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.116337 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114032    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9be83672-3189-422e-a337-6c904734991f-env-overrides\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.116337 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-tuned\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.116337 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2126287b-3317-43ab-988a-c76c4a29c0ac-agent-certs\") pod \"konnectivity-agent-ckmrk\" (UID: \"2126287b-3317-43ab-988a-c76c4a29c0ac\") " pod="kube-system/konnectivity-agent-ckmrk"
Jul 08 02:58:38.116337 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114137    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-registration-dir\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.116337 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114164    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-hostroot\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.116337 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114195    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkjsn\" (UniqueName: \"kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn\") pod \"network-check-target-25r5t\" (UID: \"45d27e40-2605-4821-b3de-ddb132f8e960\") " pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:58:38.116337 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-node-log\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.116915 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114272    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blcz2\" (UniqueName: \"kubernetes.io/projected/7bad4d47-f01a-458a-97e6-ed54b119e2f5-kube-api-access-blcz2\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.116915 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114306    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2126287b-3317-43ab-988a-c76c4a29c0ac-konnectivity-ca\") pod \"konnectivity-agent-ckmrk\" (UID: \"2126287b-3317-43ab-988a-c76c4a29c0ac\") " pod="kube-system/konnectivity-agent-ckmrk"
Jul 08 02:58:38.116915 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/647808da-5f74-4c15-911c-579b771d7dfc-iptables-alerter-script\") pod \"iptables-alerter-qnc7h\" (UID: \"647808da-5f74-4c15-911c-579b771d7dfc\") " pod="openshift-network-operator/iptables-alerter-qnc7h"
Jul 08 02:58:38.116915 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114380    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-device-dir\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.116915 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85004f35-1268-4e27-baef-42b30549f61a-host\") pod \"node-ca-n6xhm\" (UID: \"85004f35-1268-4e27-baef-42b30549f61a\") " pod="openshift-image-registry/node-ca-n6xhm"
Jul 08 02:58:38.116915 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114522    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9be83672-3189-422e-a337-6c904734991f-node-log\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.116915 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114523    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhgdx\" (UniqueName: \"kubernetes.io/projected/85004f35-1268-4e27-baef-42b30549f61a-kube-api-access-zhgdx\") pod \"node-ca-n6xhm\" (UID: \"85004f35-1268-4e27-baef-42b30549f61a\") " pod="openshift-image-registry/node-ca-n6xhm"
Jul 08 02:58:38.116915 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114581    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-systemd\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.116915 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114628    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-modprobe-d\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.116915 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114660    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-systemd\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.116915 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.114799    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-modprobe-d\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.116915 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.116881    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1fd76711-4ffb-4e0c-8fac-6521dda5af88-etc-tuned\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.118437 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.118016    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fd76711-4ffb-4e0c-8fac-6521dda5af88-tmp\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.120453 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:38.120176    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 02:58:38.120453 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:38.120200    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 02:58:38.120453 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:38.120213    2578 projected.go:196] Error preparing data for projected volume kube-api-access-tkjsn for pod openshift-network-diagnostics/network-check-target-25r5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:58:38.120453 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:38.120281    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn podName:45d27e40-2605-4821-b3de-ddb132f8e960 nodeName:}" failed. No retries permitted until 2026-07-08 02:58:38.620252059 +0000 UTC m=+2.932530577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tkjsn" (UniqueName: "kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn") pod "network-check-target-25r5t" (UID: "45d27e40-2605-4821-b3de-ddb132f8e960") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:58:38.122667 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.122642    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5p7p\" (UniqueName: \"kubernetes.io/projected/1fd76711-4ffb-4e0c-8fac-6521dda5af88-kube-api-access-m5p7p\") pod \"tuned-bnrlz\" (UID: \"1fd76711-4ffb-4e0c-8fac-6521dda5af88\") " pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.123871 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.123829    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncxwl\" (UniqueName: \"kubernetes.io/projected/9be83672-3189-422e-a337-6c904734991f-kube-api-access-ncxwl\") pod \"ovnkube-node-9qk6k\" (UID: \"9be83672-3189-422e-a337-6c904734991f\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.124918 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.124894    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzsqv\" (UniqueName: \"kubernetes.io/projected/7185a770-f816-4a15-a0d4-96f547358ca4-kube-api-access-hzsqv\") pod \"node-resolver-xkw9w\" (UID: \"7185a770-f816-4a15-a0d4-96f547358ca4\") " pod="openshift-dns/node-resolver-xkw9w"
Jul 08 02:58:38.161937 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.161878    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-199.ec2.internal" event={"ID":"f0d215397ef53c1ac6c0801c250e71f7","Type":"ContainerStarted","Data":"b58fe17e3869b7239160d388626161f51a4c2baa7310949c9137da167bd5ffc1"}
Jul 08 02:58:38.163252 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.163224    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal" event={"ID":"28c3d83165714afd5c813ea9bf1f9be6","Type":"ContainerStarted","Data":"be9984c70ff157fb508f1be325b167ae173781da18238af243f6648b4b8cd930"}
Jul 08 02:58:38.216028 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.215995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-sys-fs\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.216184 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216044    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-multus-socket-dir-parent\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.216184 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216065    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-sys-fs\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.216184 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216073    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-multus-conf-dir\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.216184 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216111    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-multus-conf-dir\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.216184 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a341499c-4d33-4b75-8da2-7d2f54ef4919-multus-daemon-config\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.216184 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216136    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-multus-socket-dir-parent\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.216184 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/85004f35-1268-4e27-baef-42b30549f61a-serviceca\") pod \"node-ca-n6xhm\" (UID: \"85004f35-1268-4e27-baef-42b30549f61a\") " pod="openshift-image-registry/node-ca-n6xhm"
Jul 08 02:58:38.216184 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-host-run-k8s-cni-cncf-io\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.216615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216205    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-os-release\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.216615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-host-var-lib-kubelet\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.216615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216278    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-host-run-k8s-cni-cncf-io\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.216615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216302    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-os-release\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.216615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216331    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-socket-dir\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.216615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-multus-cni-dir\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.216615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216415    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bad4d47-f01a-458a-97e6-ed54b119e2f5-cnibin\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.216615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216430    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-socket-dir\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.216615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216440    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bad4d47-f01a-458a-97e6-ed54b119e2f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.216615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216466    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bad4d47-f01a-458a-97e6-ed54b119e2f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.216615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216484    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-multus-cni-dir\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.216615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216488    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/647808da-5f74-4c15-911c-579b771d7dfc-host-slash\") pod \"iptables-alerter-qnc7h\" (UID: \"647808da-5f74-4c15-911c-579b771d7dfc\") " pod="openshift-network-operator/iptables-alerter-qnc7h"
Jul 08 02:58:38.216615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216336    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-host-var-lib-kubelet\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.216615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret\") pod \"global-pull-secret-syncer-g4z7x\" (UID: \"c039d8af-51c0-4e88-b104-9c7ec5d407aa\") " pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:38.216615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs\") pod \"network-metrics-daemon-x592x\" (UID: \"5e6bae47-a81a-461c-94da-98c89694c300\") " pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:38.216615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-host-run-netns\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.216615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216587    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-host-run-multus-certs\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.217480 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216614    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2126287b-3317-43ab-988a-c76c4a29c0ac-agent-certs\") pod \"konnectivity-agent-ckmrk\" (UID: \"2126287b-3317-43ab-988a-c76c4a29c0ac\") " pod="kube-system/konnectivity-agent-ckmrk"
Jul 08 02:58:38.217480 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-registration-dir\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.217480 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216657    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-hostroot\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.217480 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216678    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/85004f35-1268-4e27-baef-42b30549f61a-serviceca\") pod \"node-ca-n6xhm\" (UID: \"85004f35-1268-4e27-baef-42b30549f61a\") " pod="openshift-image-registry/node-ca-n6xhm"
Jul 08 02:58:38.217480 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blcz2\" (UniqueName: \"kubernetes.io/projected/7bad4d47-f01a-458a-97e6-ed54b119e2f5-kube-api-access-blcz2\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.217480 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2126287b-3317-43ab-988a-c76c4a29c0ac-konnectivity-ca\") pod \"konnectivity-agent-ckmrk\" (UID: \"2126287b-3317-43ab-988a-c76c4a29c0ac\") " pod="kube-system/konnectivity-agent-ckmrk"
Jul 08 02:58:38.217480 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216729    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-host-run-netns\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.217480 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216763    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/647808da-5f74-4c15-911c-579b771d7dfc-iptables-alerter-script\") pod \"iptables-alerter-qnc7h\" (UID: \"647808da-5f74-4c15-911c-579b771d7dfc\") " pod="openshift-network-operator/iptables-alerter-qnc7h"
Jul 08 02:58:38.217480 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216789    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-device-dir\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.217480 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85004f35-1268-4e27-baef-42b30549f61a-host\") pod \"node-ca-n6xhm\" (UID: \"85004f35-1268-4e27-baef-42b30549f61a\") " pod="openshift-image-registry/node-ca-n6xhm"
Jul 08 02:58:38.217480 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhgdx\" (UniqueName: \"kubernetes.io/projected/85004f35-1268-4e27-baef-42b30549f61a-kube-api-access-zhgdx\") pod \"node-ca-n6xhm\" (UID: \"85004f35-1268-4e27-baef-42b30549f61a\") " pod="openshift-image-registry/node-ca-n6xhm"
Jul 08 02:58:38.217480 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216857    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a341499c-4d33-4b75-8da2-7d2f54ef4919-multus-daemon-config\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.217480 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216865    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wf6g\" (UniqueName: \"kubernetes.io/projected/647808da-5f74-4c15-911c-579b771d7dfc-kube-api-access-5wf6g\") pod \"iptables-alerter-qnc7h\" (UID: \"647808da-5f74-4c15-911c-579b771d7dfc\") " pod="openshift-network-operator/iptables-alerter-qnc7h"
Jul 08 02:58:38.217480 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216884    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7bad4d47-f01a-458a-97e6-ed54b119e2f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.217480 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.216923    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/647808da-5f74-4c15-911c-579b771d7dfc-host-slash\") pod \"iptables-alerter-qnc7h\" (UID: \"647808da-5f74-4c15-911c-579b771d7dfc\") " pod="openshift-network-operator/iptables-alerter-qnc7h"
Jul 08 02:58:38.217480 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:38.216999    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 02:58:38.217480 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217025    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7bad4d47-f01a-458a-97e6-ed54b119e2f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.218271 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:38.217069    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret podName:c039d8af-51c0-4e88-b104-9c7ec5d407aa nodeName:}" failed. No retries permitted until 2026-07-08 02:58:38.717053601 +0000 UTC m=+3.029332133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret") pod "global-pull-secret-syncer-g4z7x" (UID: "c039d8af-51c0-4e88-b104-9c7ec5d407aa") : object "kube-system"/"original-pull-secret" not registered
Jul 08 02:58:38.218271 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217084    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7bad4d47-f01a-458a-97e6-ed54b119e2f5-cnibin\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.218271 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217097    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-host-run-multus-certs\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.218271 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:38.217136    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:58:38.218271 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217137    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85004f35-1268-4e27-baef-42b30549f61a-host\") pod \"node-ca-n6xhm\" (UID: \"85004f35-1268-4e27-baef-42b30549f61a\") " pod="openshift-image-registry/node-ca-n6xhm"
Jul 08 02:58:38.218271 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:38.217170    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs podName:5e6bae47-a81a-461c-94da-98c89694c300 nodeName:}" failed. No retries permitted until 2026-07-08 02:58:38.717158485 +0000 UTC m=+3.029437000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs") pod "network-metrics-daemon-x592x" (UID: "5e6bae47-a81a-461c-94da-98c89694c300") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:58:38.218271 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217326    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-hostroot\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.218271 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217368    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-registration-dir\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.218271 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217370    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-device-dir\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.218271 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217400    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-cnibin\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.218271 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217432    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7bad4d47-f01a-458a-97e6-ed54b119e2f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.218271 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2b7k\" (UniqueName: \"kubernetes.io/projected/5e6bae47-a81a-461c-94da-98c89694c300-kube-api-access-z2b7k\") pod \"network-metrics-daemon-x592x\" (UID: \"5e6bae47-a81a-461c-94da-98c89694c300\") " pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:38.218271 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217483    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c039d8af-51c0-4e88-b104-9c7ec5d407aa-dbus\") pod \"global-pull-secret-syncer-g4z7x\" (UID: \"c039d8af-51c0-4e88-b104-9c7ec5d407aa\") " pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:38.218271 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217500    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2126287b-3317-43ab-988a-c76c4a29c0ac-konnectivity-ca\") pod \"konnectivity-agent-ckmrk\" (UID: \"2126287b-3317-43ab-988a-c76c4a29c0ac\") " pod="kube-system/konnectivity-agent-ckmrk"
Jul 08 02:58:38.218271 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-system-cni-dir\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.218271 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217533    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a341499c-4d33-4b75-8da2-7d2f54ef4919-cni-binary-copy\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.218945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217561    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7bad4d47-f01a-458a-97e6-ed54b119e2f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.218945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217591    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-etc-kubernetes\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.218945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217603    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-cnibin\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.218945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217616    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bad4d47-f01a-458a-97e6-ed54b119e2f5-system-cni-dir\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.218945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217757    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7bad4d47-f01a-458a-97e6-ed54b119e2f5-system-cni-dir\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.218945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217901    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c039d8af-51c0-4e88-b104-9c7ec5d407aa-dbus\") pod \"global-pull-secret-syncer-g4z7x\" (UID: \"c039d8af-51c0-4e88-b104-9c7ec5d407aa\") " pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:38.218945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217955    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7bad4d47-f01a-458a-97e6-ed54b119e2f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.218945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217959    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-system-cni-dir\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.218945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.217986    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-host-var-lib-cni-multus\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.218945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.218003    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-etc-kubernetes\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.218945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.218005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bad4d47-f01a-458a-97e6-ed54b119e2f5-os-release\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.218945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.218041    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7bad4d47-f01a-458a-97e6-ed54b119e2f5-os-release\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.218945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.218039    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.218945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.218062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-etc-selinux\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.218945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.218078    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhqtw\" (UniqueName: \"kubernetes.io/projected/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-kube-api-access-nhqtw\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.218945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.218078    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.218945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.218094    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c039d8af-51c0-4e88-b104-9c7ec5d407aa-kubelet-config\") pod \"global-pull-secret-syncer-g4z7x\" (UID: \"c039d8af-51c0-4e88-b104-9c7ec5d407aa\") " pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:38.219756 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.218109    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/647808da-5f74-4c15-911c-579b771d7dfc-iptables-alerter-script\") pod \"iptables-alerter-qnc7h\" (UID: \"647808da-5f74-4c15-911c-579b771d7dfc\") " pod="openshift-network-operator/iptables-alerter-qnc7h"
Jul 08 02:58:38.219756 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.218130    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c039d8af-51c0-4e88-b104-9c7ec5d407aa-kubelet-config\") pod \"global-pull-secret-syncer-g4z7x\" (UID: \"c039d8af-51c0-4e88-b104-9c7ec5d407aa\") " pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:38.219756 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.218131    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-host-var-lib-cni-multus\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.219756 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.218162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-host-var-lib-cni-bin\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.219756 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.218180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwhc4\" (UniqueName: \"kubernetes.io/projected/a341499c-4d33-4b75-8da2-7d2f54ef4919-kube-api-access-hwhc4\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.219756 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.218233    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-etc-selinux\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.219756 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.218273    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a341499c-4d33-4b75-8da2-7d2f54ef4919-host-var-lib-cni-bin\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.219756 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.218320    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7bad4d47-f01a-458a-97e6-ed54b119e2f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.219756 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.218618    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a341499c-4d33-4b75-8da2-7d2f54ef4919-cni-binary-copy\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.220181 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.219924    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2126287b-3317-43ab-988a-c76c4a29c0ac-agent-certs\") pod \"konnectivity-agent-ckmrk\" (UID: \"2126287b-3317-43ab-988a-c76c4a29c0ac\") " pod="kube-system/konnectivity-agent-ckmrk"
Jul 08 02:58:38.226519 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.226498    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wf6g\" (UniqueName: \"kubernetes.io/projected/647808da-5f74-4c15-911c-579b771d7dfc-kube-api-access-5wf6g\") pod \"iptables-alerter-qnc7h\" (UID: \"647808da-5f74-4c15-911c-579b771d7dfc\") " pod="openshift-network-operator/iptables-alerter-qnc7h"
Jul 08 02:58:38.226824 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.226803    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blcz2\" (UniqueName: \"kubernetes.io/projected/7bad4d47-f01a-458a-97e6-ed54b119e2f5-kube-api-access-blcz2\") pod \"multus-additional-cni-plugins-jmppx\" (UID: \"7bad4d47-f01a-458a-97e6-ed54b119e2f5\") " pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.227277 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.227254    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhqtw\" (UniqueName: \"kubernetes.io/projected/d2eb5b7a-8d76-48be-9d03-a805f8ef0362-kube-api-access-nhqtw\") pod \"aws-ebs-csi-driver-node-rnmpr\" (UID: \"d2eb5b7a-8d76-48be-9d03-a805f8ef0362\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.227845 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.227600    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhgdx\" (UniqueName: \"kubernetes.io/projected/85004f35-1268-4e27-baef-42b30549f61a-kube-api-access-zhgdx\") pod \"node-ca-n6xhm\" (UID: \"85004f35-1268-4e27-baef-42b30549f61a\") " pod="openshift-image-registry/node-ca-n6xhm"
Jul 08 02:58:38.227845 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.227806    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2b7k\" (UniqueName: \"kubernetes.io/projected/5e6bae47-a81a-461c-94da-98c89694c300-kube-api-access-z2b7k\") pod \"network-metrics-daemon-x592x\" (UID: \"5e6bae47-a81a-461c-94da-98c89694c300\") " pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:38.228195 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.228175    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwhc4\" (UniqueName: \"kubernetes.io/projected/a341499c-4d33-4b75-8da2-7d2f54ef4919-kube-api-access-hwhc4\") pod \"multus-mjsmm\" (UID: \"a341499c-4d33-4b75-8da2-7d2f54ef4919\") " pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.301395 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.301318    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 02:58:38.305035 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.305014    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bnrlz"
Jul 08 02:58:38.315842 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:38.315818    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd76711_4ffb_4e0c_8fac_6521dda5af88.slice/crio-43684e4259f2f61188687e98fafdfd68f23f6a652e00aae510210cd1e66b6e23 WatchSource:0}: Error finding container 43684e4259f2f61188687e98fafdfd68f23f6a652e00aae510210cd1e66b6e23: Status 404 returned error can't find the container with id 43684e4259f2f61188687e98fafdfd68f23f6a652e00aae510210cd1e66b6e23
Jul 08 02:58:38.317760 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.317718    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xkw9w"
Jul 08 02:58:38.330455 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.330423    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ckmrk"
Jul 08 02:58:38.338624 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.338601    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:58:38.340653 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:38.340630    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2126287b_3317_43ab_988a_c76c4a29c0ac.slice/crio-99fcd309897009beae01b5dbf1c77f70165a7bf902924fb9555617e9b5665985 WatchSource:0}: Error finding container 99fcd309897009beae01b5dbf1c77f70165a7bf902924fb9555617e9b5665985: Status 404 returned error can't find the container with id 99fcd309897009beae01b5dbf1c77f70165a7bf902924fb9555617e9b5665985
Jul 08 02:58:38.345541 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.345517    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jmppx"
Jul 08 02:58:38.349927 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:38.349905    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9be83672_3189_422e_a337_6c904734991f.slice/crio-c630dd9ec7083db5e700c3325cce59b1b88903c0c70295ebecbe3c2a98da9043 WatchSource:0}: Error finding container c630dd9ec7083db5e700c3325cce59b1b88903c0c70295ebecbe3c2a98da9043: Status 404 returned error can't find the container with id c630dd9ec7083db5e700c3325cce59b1b88903c0c70295ebecbe3c2a98da9043
Jul 08 02:58:38.353605 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.353578    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qnc7h"
Jul 08 02:58:38.357681 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:38.357662    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bad4d47_f01a_458a_97e6_ed54b119e2f5.slice/crio-93c6c43d83bbd17d36d1d2c68e29a75ffcbec93d5beba183d3c763a694c28b3b WatchSource:0}: Error finding container 93c6c43d83bbd17d36d1d2c68e29a75ffcbec93d5beba183d3c763a694c28b3b: Status 404 returned error can't find the container with id 93c6c43d83bbd17d36d1d2c68e29a75ffcbec93d5beba183d3c763a694c28b3b
Jul 08 02:58:38.359530 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.359509    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr"
Jul 08 02:58:38.363496 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:38.363472    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647808da_5f74_4c15_911c_579b771d7dfc.slice/crio-18eb7fcfdd8c62597359a84d58ea15421804b01b95028ee47d115cd209bcf29f WatchSource:0}: Error finding container 18eb7fcfdd8c62597359a84d58ea15421804b01b95028ee47d115cd209bcf29f: Status 404 returned error can't find the container with id 18eb7fcfdd8c62597359a84d58ea15421804b01b95028ee47d115cd209bcf29f
Jul 08 02:58:38.368243 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.368216    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n6xhm"
Jul 08 02:58:38.373694 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.373673    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mjsmm"
Jul 08 02:58:38.621060 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.620974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkjsn\" (UniqueName: \"kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn\") pod \"network-check-target-25r5t\" (UID: \"45d27e40-2605-4821-b3de-ddb132f8e960\") " pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:58:38.621212 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:38.621104    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 02:58:38.621212 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:38.621133    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 02:58:38.621212 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:38.621143    2578 projected.go:196] Error preparing data for projected volume kube-api-access-tkjsn for pod openshift-network-diagnostics/network-check-target-25r5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:58:38.621212 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:38.621192    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn podName:45d27e40-2605-4821-b3de-ddb132f8e960 nodeName:}" failed. No retries permitted until 2026-07-08 02:58:39.621180354 +0000 UTC m=+3.933458865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkjsn" (UniqueName: "kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn") pod "network-check-target-25r5t" (UID: "45d27e40-2605-4821-b3de-ddb132f8e960") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:58:38.721957 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.721924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret\") pod \"global-pull-secret-syncer-g4z7x\" (UID: \"c039d8af-51c0-4e88-b104-9c7ec5d407aa\") " pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:38.722110 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:38.721975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs\") pod \"network-metrics-daemon-x592x\" (UID: \"5e6bae47-a81a-461c-94da-98c89694c300\") " pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:38.722110 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:38.722076    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:58:38.722201 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:38.722139    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs podName:5e6bae47-a81a-461c-94da-98c89694c300 nodeName:}" failed. No retries permitted until 2026-07-08 02:58:39.722124333 +0000 UTC m=+4.034402845 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs") pod "network-metrics-daemon-x592x" (UID: "5e6bae47-a81a-461c-94da-98c89694c300") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:58:38.722201 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:38.722076    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 02:58:38.722282 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:38.722203    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret podName:c039d8af-51c0-4e88-b104-9c7ec5d407aa nodeName:}" failed. No retries permitted until 2026-07-08 02:58:39.722190713 +0000 UTC m=+4.034469244 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret") pod "global-pull-secret-syncer-g4z7x" (UID: "c039d8af-51c0-4e88-b104-9c7ec5d407aa") : object "kube-system"/"original-pull-secret" not registered
Jul 08 02:58:39.043525 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:39.043478    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 02:53:38 +0000 UTC" deadline="2028-04-15 02:32:59.1811316 +0000 UTC"
Jul 08 02:58:39.043525 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:39.043522    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15527h34m20.137614341s"
Jul 08 02:58:39.167243 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:39.167204    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmppx" event={"ID":"7bad4d47-f01a-458a-97e6-ed54b119e2f5","Type":"ContainerStarted","Data":"93c6c43d83bbd17d36d1d2c68e29a75ffcbec93d5beba183d3c763a694c28b3b"}
Jul 08 02:58:39.168705 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:39.168670    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k" event={"ID":"9be83672-3189-422e-a337-6c904734991f","Type":"ContainerStarted","Data":"c630dd9ec7083db5e700c3325cce59b1b88903c0c70295ebecbe3c2a98da9043"}
Jul 08 02:58:39.170644 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:39.170590    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ckmrk" event={"ID":"2126287b-3317-43ab-988a-c76c4a29c0ac","Type":"ContainerStarted","Data":"99fcd309897009beae01b5dbf1c77f70165a7bf902924fb9555617e9b5665985"}
Jul 08 02:58:39.171840 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:39.171805    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xkw9w" event={"ID":"7185a770-f816-4a15-a0d4-96f547358ca4","Type":"ContainerStarted","Data":"e827e6422be4bda99628e7d5dae508f0fd608ee1bc445096833676fd2bd5f499"}
Jul 08 02:58:39.173045 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:39.173024    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bnrlz" event={"ID":"1fd76711-4ffb-4e0c-8fac-6521dda5af88","Type":"ContainerStarted","Data":"43684e4259f2f61188687e98fafdfd68f23f6a652e00aae510210cd1e66b6e23"}
Jul 08 02:58:39.174310 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:39.174285    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qnc7h" event={"ID":"647808da-5f74-4c15-911c-579b771d7dfc","Type":"ContainerStarted","Data":"18eb7fcfdd8c62597359a84d58ea15421804b01b95028ee47d115cd209bcf29f"}
Jul 08 02:58:39.482594 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:39.482560    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2eb5b7a_8d76_48be_9d03_a805f8ef0362.slice/crio-a1f7caec4ca2936bbad5b92468fafdd8cf5893b7976b0b73f222d0ffa3f2cd44 WatchSource:0}: Error finding container a1f7caec4ca2936bbad5b92468fafdd8cf5893b7976b0b73f222d0ffa3f2cd44: Status 404 returned error can't find the container with id a1f7caec4ca2936bbad5b92468fafdd8cf5893b7976b0b73f222d0ffa3f2cd44
Jul 08 02:58:39.497371 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:58:39.497258    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda341499c_4d33_4b75_8da2_7d2f54ef4919.slice/crio-d161a77a6cafa08777d434422a02bf8201ea006a795961ec69f1bd9cc7b05fb6 WatchSource:0}: Error finding container d161a77a6cafa08777d434422a02bf8201ea006a795961ec69f1bd9cc7b05fb6: Status 404 returned error can't find the container with id d161a77a6cafa08777d434422a02bf8201ea006a795961ec69f1bd9cc7b05fb6
Jul 08 02:58:39.628360 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:39.627599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkjsn\" (UniqueName: \"kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn\") pod \"network-check-target-25r5t\" (UID: \"45d27e40-2605-4821-b3de-ddb132f8e960\") " pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:58:39.628360 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:39.628049    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 02:58:39.628360 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:39.628073    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 02:58:39.628360 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:39.628087    2578 projected.go:196] Error preparing data for projected volume kube-api-access-tkjsn for pod openshift-network-diagnostics/network-check-target-25r5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:58:39.628360 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:39.628153    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn podName:45d27e40-2605-4821-b3de-ddb132f8e960 nodeName:}" failed. No retries permitted until 2026-07-08 02:58:41.628133633 +0000 UTC m=+5.940412159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkjsn" (UniqueName: "kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn") pod "network-check-target-25r5t" (UID: "45d27e40-2605-4821-b3de-ddb132f8e960") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:58:39.730628 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:39.729602    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret\") pod \"global-pull-secret-syncer-g4z7x\" (UID: \"c039d8af-51c0-4e88-b104-9c7ec5d407aa\") " pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:39.730628 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:39.729656    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs\") pod \"network-metrics-daemon-x592x\" (UID: \"5e6bae47-a81a-461c-94da-98c89694c300\") " pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:39.730628 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:39.729863    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:58:39.730628 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:39.729926    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs podName:5e6bae47-a81a-461c-94da-98c89694c300 nodeName:}" failed. No retries permitted until 2026-07-08 02:58:41.729907731 +0000 UTC m=+6.042186263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs") pod "network-metrics-daemon-x592x" (UID: "5e6bae47-a81a-461c-94da-98c89694c300") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:58:39.730628 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:39.730294    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 02:58:39.730628 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:39.730345    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret podName:c039d8af-51c0-4e88-b104-9c7ec5d407aa nodeName:}" failed. No retries permitted until 2026-07-08 02:58:41.730327733 +0000 UTC m=+6.042606246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret") pod "global-pull-secret-syncer-g4z7x" (UID: "c039d8af-51c0-4e88-b104-9c7ec5d407aa") : object "kube-system"/"original-pull-secret" not registered
Jul 08 02:58:40.043718 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:40.043660    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 02:53:38 +0000 UTC" deadline="2028-02-22 14:57:56.783835278 +0000 UTC"
Jul 08 02:58:40.043718 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:40.043718    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14267h59m16.740121054s"
Jul 08 02:58:40.160512 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:40.159704    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:40.160512 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:40.159858    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:58:40.160512 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:40.160241    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:40.160512 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:40.160332    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:58:40.160512 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:40.160389    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:58:40.160512 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:40.160451    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:58:40.194769 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:40.194215    2578 generic.go:356] "Generic (PLEG): container finished" podID="28c3d83165714afd5c813ea9bf1f9be6" containerID="f75e4fdadef2c486654a313a883879f191aac3c452a3c9f2c4c4235bdccecfc9" exitCode=0
Jul 08 02:58:40.194769 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:40.194304    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal" event={"ID":"28c3d83165714afd5c813ea9bf1f9be6","Type":"ContainerDied","Data":"f75e4fdadef2c486654a313a883879f191aac3c452a3c9f2c4c4235bdccecfc9"}
Jul 08 02:58:40.201221 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:40.201192    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-199.ec2.internal" event={"ID":"f0d215397ef53c1ac6c0801c250e71f7","Type":"ContainerStarted","Data":"268834fc0a7d5eb3ee4eb41edd4f5d7b6bc178d26dd34672ceb5b64ca2c08719"}
Jul 08 02:58:40.218441 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:40.218367    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mjsmm" event={"ID":"a341499c-4d33-4b75-8da2-7d2f54ef4919","Type":"ContainerStarted","Data":"d161a77a6cafa08777d434422a02bf8201ea006a795961ec69f1bd9cc7b05fb6"}
Jul 08 02:58:40.223170 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:40.223093    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr" event={"ID":"d2eb5b7a-8d76-48be-9d03-a805f8ef0362","Type":"ContainerStarted","Data":"a1f7caec4ca2936bbad5b92468fafdd8cf5893b7976b0b73f222d0ffa3f2cd44"}
Jul 08 02:58:40.231355 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:40.231327    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n6xhm" event={"ID":"85004f35-1268-4e27-baef-42b30549f61a","Type":"ContainerStarted","Data":"294e2eeb587cca838c6c204c1194ff442d89e4a4cb26f0a1ddf0e5088368feb9"}
Jul 08 02:58:41.237129 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:41.236999    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal" event={"ID":"28c3d83165714afd5c813ea9bf1f9be6","Type":"ContainerStarted","Data":"1054eb3a93e8e45bc086bc6a099a36d177b502ee9501cc49ad3bbfb24e0268f7"}
Jul 08 02:58:41.252721 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:41.252349    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-199.ec2.internal" podStartSLOduration=4.252327289 podStartE2EDuration="4.252327289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:58:40.225206627 +0000 UTC m=+4.537485162" watchObservedRunningTime="2026-07-08 02:58:41.252327289 +0000 UTC m=+5.564605824"
Jul 08 02:58:41.647808 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:41.647700    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkjsn\" (UniqueName: \"kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn\") pod \"network-check-target-25r5t\" (UID: \"45d27e40-2605-4821-b3de-ddb132f8e960\") " pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:58:41.647973 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:41.647950    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 02:58:41.647973 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:41.647970    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 02:58:41.648080 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:41.647983    2578 projected.go:196] Error preparing data for projected volume kube-api-access-tkjsn for pod openshift-network-diagnostics/network-check-target-25r5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:58:41.648080 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:41.648066    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn podName:45d27e40-2605-4821-b3de-ddb132f8e960 nodeName:}" failed. No retries permitted until 2026-07-08 02:58:45.648022701 +0000 UTC m=+9.960301215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkjsn" (UniqueName: "kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn") pod "network-check-target-25r5t" (UID: "45d27e40-2605-4821-b3de-ddb132f8e960") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:58:41.749775 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:41.749095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret\") pod \"global-pull-secret-syncer-g4z7x\" (UID: \"c039d8af-51c0-4e88-b104-9c7ec5d407aa\") " pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:41.749775 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:41.749177    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs\") pod \"network-metrics-daemon-x592x\" (UID: \"5e6bae47-a81a-461c-94da-98c89694c300\") " pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:41.749775 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:41.749335    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:58:41.749775 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:41.749397    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs podName:5e6bae47-a81a-461c-94da-98c89694c300 nodeName:}" failed. No retries permitted until 2026-07-08 02:58:45.749377368 +0000 UTC m=+10.061655881 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs") pod "network-metrics-daemon-x592x" (UID: "5e6bae47-a81a-461c-94da-98c89694c300") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:58:41.750095 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:41.749791    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 02:58:41.750095 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:41.749839    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret podName:c039d8af-51c0-4e88-b104-9c7ec5d407aa nodeName:}" failed. No retries permitted until 2026-07-08 02:58:45.749823275 +0000 UTC m=+10.062101792 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret") pod "global-pull-secret-syncer-g4z7x" (UID: "c039d8af-51c0-4e88-b104-9c7ec5d407aa") : object "kube-system"/"original-pull-secret" not registered
Jul 08 02:58:42.158949 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:42.158865    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:42.158949 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:42.158865    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:58:42.159197 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:42.159038    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:42.159197 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:42.159046    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:58:42.159197 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:42.159146    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:58:42.159329 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:42.159225    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:58:44.157902 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:44.157858    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:44.158292 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:44.157981    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:44.158292 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:44.157871    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:58:44.158292 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:44.158006    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:58:44.158292 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:44.158094    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:58:44.158292 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:44.158159    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:58:45.681197 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:45.681147    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkjsn\" (UniqueName: \"kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn\") pod \"network-check-target-25r5t\" (UID: \"45d27e40-2605-4821-b3de-ddb132f8e960\") " pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:58:45.681662 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:45.681323    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 02:58:45.681662 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:45.681345    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 02:58:45.681662 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:45.681359    2578 projected.go:196] Error preparing data for projected volume kube-api-access-tkjsn for pod openshift-network-diagnostics/network-check-target-25r5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:58:45.681662 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:45.681417    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn podName:45d27e40-2605-4821-b3de-ddb132f8e960 nodeName:}" failed. No retries permitted until 2026-07-08 02:58:53.68139876 +0000 UTC m=+17.993677291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkjsn" (UniqueName: "kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn") pod "network-check-target-25r5t" (UID: "45d27e40-2605-4821-b3de-ddb132f8e960") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:58:45.782047 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:45.782011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret\") pod \"global-pull-secret-syncer-g4z7x\" (UID: \"c039d8af-51c0-4e88-b104-9c7ec5d407aa\") " pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:45.782047 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:45.782052    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs\") pod \"network-metrics-daemon-x592x\" (UID: \"5e6bae47-a81a-461c-94da-98c89694c300\") " pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:45.782241 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:45.782166    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:58:45.782241 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:45.782166    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 02:58:45.782241 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:45.782232    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs podName:5e6bae47-a81a-461c-94da-98c89694c300 nodeName:}" failed. No retries permitted until 2026-07-08 02:58:53.782213748 +0000 UTC m=+18.094492260 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs") pod "network-metrics-daemon-x592x" (UID: "5e6bae47-a81a-461c-94da-98c89694c300") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:58:45.782349 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:45.782248    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret podName:c039d8af-51c0-4e88-b104-9c7ec5d407aa nodeName:}" failed. No retries permitted until 2026-07-08 02:58:53.782240237 +0000 UTC m=+18.094518750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret") pod "global-pull-secret-syncer-g4z7x" (UID: "c039d8af-51c0-4e88-b104-9c7ec5d407aa") : object "kube-system"/"original-pull-secret" not registered
Jul 08 02:58:46.158323 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:46.157847    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:46.158323 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:46.157964    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:58:46.158323 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:46.157988    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:46.158323 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:46.157964    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:58:46.158323 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:46.158082    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:58:46.158323 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:46.158153    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:58:48.157766 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:48.157307    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:58:48.157766 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:48.157341    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:48.157766 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:48.157422    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:58:48.157766 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:48.157458    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:48.157766 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:48.157526    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:58:48.157766 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:48.157598    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:58:50.157613 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:50.157578    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:50.158091 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:50.157579    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:58:50.158091 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:50.157727    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:50.158091 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:50.157722    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:58:50.158091 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:50.157834    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:58:50.158091 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:50.157910    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:58:52.157982 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:52.157924    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:52.157982 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:52.157975    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:52.158468 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:52.157924    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:58:52.158468 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:52.158067    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:58:52.158468 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:52.158167    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:58:52.158468 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:52.158251    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:58:53.743449 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:53.743402    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkjsn\" (UniqueName: \"kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn\") pod \"network-check-target-25r5t\" (UID: \"45d27e40-2605-4821-b3de-ddb132f8e960\") " pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:58:53.743903 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:53.743605    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 02:58:53.743903 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:53.743626    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 02:58:53.743903 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:53.743640    2578 projected.go:196] Error preparing data for projected volume kube-api-access-tkjsn for pod openshift-network-diagnostics/network-check-target-25r5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:58:53.743903 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:53.743707    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn podName:45d27e40-2605-4821-b3de-ddb132f8e960 nodeName:}" failed. No retries permitted until 2026-07-08 02:59:09.743691234 +0000 UTC m=+34.055969758 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkjsn" (UniqueName: "kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn") pod "network-check-target-25r5t" (UID: "45d27e40-2605-4821-b3de-ddb132f8e960") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:58:53.844410 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:53.844374    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret\") pod \"global-pull-secret-syncer-g4z7x\" (UID: \"c039d8af-51c0-4e88-b104-9c7ec5d407aa\") " pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:53.844583 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:53.844422    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs\") pod \"network-metrics-daemon-x592x\" (UID: \"5e6bae47-a81a-461c-94da-98c89694c300\") " pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:53.844583 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:53.844554    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 02:58:53.844583 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:53.844566    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:58:53.844713 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:53.844630    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs podName:5e6bae47-a81a-461c-94da-98c89694c300 nodeName:}" failed. No retries permitted until 2026-07-08 02:59:09.844611234 +0000 UTC m=+34.156889791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs") pod "network-metrics-daemon-x592x" (UID: "5e6bae47-a81a-461c-94da-98c89694c300") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:58:53.844713 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:53.844648    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret podName:c039d8af-51c0-4e88-b104-9c7ec5d407aa nodeName:}" failed. No retries permitted until 2026-07-08 02:59:09.844639884 +0000 UTC m=+34.156918396 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret") pod "global-pull-secret-syncer-g4z7x" (UID: "c039d8af-51c0-4e88-b104-9c7ec5d407aa") : object "kube-system"/"original-pull-secret" not registered
Jul 08 02:58:54.157755 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:54.157724    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:54.157755 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:54.157733    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:54.157893 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:54.157841    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:58:54.157936 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:54.157910    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:58:54.157968 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:54.157930    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:58:54.158029 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:54.158011    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:58:56.158530 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:56.158486    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:56.159047 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:56.158606    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:58:56.159047 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:56.158689    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:56.159047 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:56.158816    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:58:56.159047 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:56.158852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:58:56.159047 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:56.158924    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:58:58.158123 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:58.158092    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:58:58.158479 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:58.158152    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:58:58.158479 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:58.158167    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:58:58.158479 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:58.158272    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:58:58.158479 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:58.158341    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:58:58.158479 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:58:58.158428    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:58:58.273032 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:58.273007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xkw9w" event={"ID":"7185a770-f816-4a15-a0d4-96f547358ca4","Type":"ContainerStarted","Data":"5c741b1a9b4e26fca5cac9864b49f8468c9da068ed8bf1e2d596b9984123e7f4"}
Jul 08 02:58:58.274588 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:58.274568    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr" event={"ID":"d2eb5b7a-8d76-48be-9d03-a805f8ef0362","Type":"ContainerStarted","Data":"0c782de02d23cc1f5a6289cf9b7a23b21e24dc81f2618078d79780a0a3063e94"}
Jul 08 02:58:58.276016 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:58.275995    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ckmrk" event={"ID":"2126287b-3317-43ab-988a-c76c4a29c0ac","Type":"ContainerStarted","Data":"75b0a00cd152c4c7e72ecdd1449a533016629f3413e4f6e16e52f7b10ab685f9"}
Jul 08 02:58:58.291116 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:58.291068    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xkw9w" podStartSLOduration=2.570018151 podStartE2EDuration="22.291035928s" totalImagesPullingTime="19.721017777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:58:58.291030759 +0000 UTC m=+22.603309294" watchObservedRunningTime="2026-07-08 02:58:58.291035928 +0000 UTC m=+22.603314467"
Jul 08 02:58:58.291251 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:58.291227    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-199.ec2.internal" podStartSLOduration=21.291216585 podStartE2EDuration="21.291216585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:58:41.252674055 +0000 UTC m=+5.564952602" watchObservedRunningTime="2026-07-08 02:58:58.291216585 +0000 UTC m=+22.603495120"
Jul 08 02:58:58.307419 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:58.307352    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ckmrk" podStartSLOduration=2.5723986 podStartE2EDuration="22.307336569s" totalImagesPullingTime="19.734937969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:58:58.307255756 +0000 UTC m=+22.619534286" watchObservedRunningTime="2026-07-08 02:58:58.307336569 +0000 UTC m=+22.619615103"
Jul 08 02:58:58.719643 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:58.719347    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xkw9w_7185a770-f816-4a15-a0d4-96f547358ca4/dns-node-resolver/0.log"
Jul 08 02:58:59.280500 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:59.280462    2578 generic.go:356] "Generic (PLEG): container finished" podID="7bad4d47-f01a-458a-97e6-ed54b119e2f5" containerID="2f4d4d7446833425978b817aa69ffe51778281c75bcc8ddbe87d3e4f75348d6d" exitCode=0
Jul 08 02:58:59.281245 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:59.280550    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmppx" event={"ID":"7bad4d47-f01a-458a-97e6-ed54b119e2f5","Type":"ContainerDied","Data":"2f4d4d7446833425978b817aa69ffe51778281c75bcc8ddbe87d3e4f75348d6d"}
Jul 08 02:58:59.282259 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:59.282178    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n6xhm" event={"ID":"85004f35-1268-4e27-baef-42b30549f61a","Type":"ContainerStarted","Data":"6430c066d0129ff2943c7bddf195a3f16a230bc5d280e9c26e77ef70b27a022b"}
Jul 08 02:58:59.285872 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:59.285614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k" event={"ID":"9be83672-3189-422e-a337-6c904734991f","Type":"ContainerStarted","Data":"b673cb257c70c0e430c3a27347fae69277c16563cc3c7be660f7ed670eaca1d6"}
Jul 08 02:58:59.285872 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:59.285765    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k" event={"ID":"9be83672-3189-422e-a337-6c904734991f","Type":"ContainerStarted","Data":"d7f78366303dfa48913f7d3b3ea65d520209afe426c31874f610dcc927bd9619"}
Jul 08 02:58:59.285872 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:59.285848    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k" event={"ID":"9be83672-3189-422e-a337-6c904734991f","Type":"ContainerStarted","Data":"fc3989eeca9e85c6ccc17dc448bbf291e3f60069239156dc2fdd1aa0bf430697"}
Jul 08 02:58:59.286002 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:59.285882    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k" event={"ID":"9be83672-3189-422e-a337-6c904734991f","Type":"ContainerStarted","Data":"293dc0dc4d54532c6ba5d2d152ca66c2f786a1b4ea84cce224d18da14ed2cecb"}
Jul 08 02:58:59.286002 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:59.285913    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k" event={"ID":"9be83672-3189-422e-a337-6c904734991f","Type":"ContainerStarted","Data":"3a73b5be9eca99163c8fa71707a52048b59f662f0f13b5f43918d7580534a5c4"}
Jul 08 02:58:59.286002 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:59.285943    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k" event={"ID":"9be83672-3189-422e-a337-6c904734991f","Type":"ContainerStarted","Data":"1ef98e1d038411413ac93ebf898f2961c85e3dcbc2784866a6c32054c0038561"}
Jul 08 02:58:59.287360 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:59.287335    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bnrlz" event={"ID":"1fd76711-4ffb-4e0c-8fac-6521dda5af88","Type":"ContainerStarted","Data":"172b9852865543f2417c4e4a9c668e26a273c4edbfb413fca0b19328b49d656a"}
Jul 08 02:58:59.288826 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:59.288805    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mjsmm" event={"ID":"a341499c-4d33-4b75-8da2-7d2f54ef4919","Type":"ContainerStarted","Data":"5f950058f6f79c2d52f5514da53ac86a4e51d2865e3eb4fb397d90c9225eb0ba"}
Jul 08 02:58:59.319149 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:59.319101    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bnrlz" podStartSLOduration=3.553077693 podStartE2EDuration="23.319087994s" totalImagesPullingTime="19.766010301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:58:59.318559537 +0000 UTC m=+23.630838072" watchObservedRunningTime="2026-07-08 02:58:59.319087994 +0000 UTC m=+23.631366522"
Jul 08 02:58:59.341171 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:59.341125    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mjsmm" podStartSLOduration=4.464402614 podStartE2EDuration="23.341111779s" totalImagesPullingTime="18.876709165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:58:59.340193946 +0000 UTC m=+23.652472480" watchObservedRunningTime="2026-07-08 02:58:59.341111779 +0000 UTC m=+23.653390291"
Jul 08 02:58:59.355957 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:59.355919    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n6xhm" podStartSLOduration=4.774417612 podStartE2EDuration="23.355905431s" totalImagesPullingTime="18.581487819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:58:59.355602762 +0000 UTC m=+23.667881296" watchObservedRunningTime="2026-07-08 02:58:59.355905431 +0000 UTC m=+23.668183965"
Jul 08 02:58:59.687921 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:58:59.687895    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n6xhm_85004f35-1268-4e27-baef-42b30549f61a/node-ca/0.log"
Jul 08 02:59:00.149173 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:00.149144    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 02:59:00.157331 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:00.157309    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:00.157437 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:00.157412    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:59:00.157495 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:00.157482    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:00.157562 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:00.157549    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:59:00.157678 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:00.157667    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:00.157735 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:00.157723    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:59:00.293242 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:00.293204    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr" event={"ID":"d2eb5b7a-8d76-48be-9d03-a805f8ef0362","Type":"ContainerStarted","Data":"0b7fbb69b8f645d42ebf36254a7abb277841c8561fd98f02ae058205797d7bc0"}
Jul 08 02:59:00.294915 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:00.294883    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qnc7h" event={"ID":"647808da-5f74-4c15-911c-579b771d7dfc","Type":"ContainerStarted","Data":"9b0a43852cbbfeae840b6ebaaf7306c90f026ae5add63317e144d2ef1d57f022"}
Jul 08 02:59:00.314002 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:00.313952    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qnc7h" podStartSLOduration=4.629633415 podStartE2EDuration="24.313936818s" totalImagesPullingTime="19.684303403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:59:00.31252377 +0000 UTC m=+24.624802303" watchObservedRunningTime="2026-07-08 02:59:00.313936818 +0000 UTC m=+24.626215351"
Jul 08 02:59:01.072679 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:01.072569    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T02:59:00.14916652Z","UUID":"d34f0220-bfd8-4b36-8ff4-b1dfeefe2a2f","Handler":null,"Name":"","Endpoint":""}
Jul 08 02:59:01.074156 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:01.074137    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 02:59:01.074334 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:01.074180    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 02:59:01.754201 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:01.754127    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ckmrk"
Jul 08 02:59:01.754832 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:01.754815    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ckmrk"
Jul 08 02:59:02.158124 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:02.157862    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:02.158316 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:02.157925    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:02.158316 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:02.158219    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:59:02.158316 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:02.158303    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:59:02.158484 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:02.157965    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:02.158484 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:02.158447    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:59:02.303815 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:02.303775    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k" event={"ID":"9be83672-3189-422e-a337-6c904734991f","Type":"ContainerStarted","Data":"3152a55912f57252dd84d4d332796356135cedfb139719b9216cd37b2e78fbc1"}
Jul 08 02:59:02.305968 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:02.305935    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr" event={"ID":"d2eb5b7a-8d76-48be-9d03-a805f8ef0362","Type":"ContainerStarted","Data":"10d69481947262c80d744cea083c18f3dd37da697bf2791fd71898e7bdd75cbc"}
Jul 08 02:59:02.306363 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:02.306316    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ckmrk"
Jul 08 02:59:02.306615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:02.306600    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ckmrk"
Jul 08 02:59:02.328810 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:02.328725    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnmpr" podStartSLOduration=4.77930656 podStartE2EDuration="26.328705553s" totalImagesPullingTime="21.549398993s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:58:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:59:02.328557796 +0000 UTC m=+26.640836351" watchObservedRunningTime="2026-07-08 02:59:02.328705553 +0000 UTC m=+26.640984089"
Jul 08 02:59:04.158171 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:04.158076    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:04.158171 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:04.158114    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:04.159073 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:04.158207    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:59:04.159073 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:04.158267    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:59:04.159073 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:04.158307    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:04.159073 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:04.158388    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:59:04.314701 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:04.314664    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k" event={"ID":"9be83672-3189-422e-a337-6c904734991f","Type":"ContainerStarted","Data":"77b56cf09193abd8557242709efe3ae35c3e3d4da209cd554469c89f78e15c40"}
Jul 08 02:59:04.346801 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:04.346755    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k" podStartSLOduration=8.328454242 podStartE2EDuration="28.346718466s" totalImagesPullingTime="20.018264224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:59:04.345487808 +0000 UTC m=+28.657766341" watchObservedRunningTime="2026-07-08 02:59:04.346718466 +0000 UTC m=+28.658997001"
Jul 08 02:59:04.708240 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:04.708202    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:59:05.317556 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:05.317527    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:59:05.317972 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:05.317609    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:59:05.333347 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:05.333321    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:59:05.333581 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:05.333568    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:59:06.159045 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:06.158865    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:06.159263 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:06.158951    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:06.159263 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:06.158983    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:06.159263 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:06.159215    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:59:06.159378 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:06.159106    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:59:06.159378 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:06.159279    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:59:06.320624 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:06.320592    2578 generic.go:356] "Generic (PLEG): container finished" podID="7bad4d47-f01a-458a-97e6-ed54b119e2f5" containerID="b68433f3f6dc1653ece3b19a23c5efd3031d334bbbcf70ae249b6b4213a46fcf" exitCode=0
Jul 08 02:59:06.321066 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:06.320677    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmppx" event={"ID":"7bad4d47-f01a-458a-97e6-ed54b119e2f5","Type":"ContainerDied","Data":"b68433f3f6dc1653ece3b19a23c5efd3031d334bbbcf70ae249b6b4213a46fcf"}
Jul 08 02:59:08.158008 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:08.157972    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:08.158436 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:08.157976    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:08.158436 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:08.158072    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:59:08.158436 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:08.157976    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:08.158436 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:08.158173    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:59:08.158436 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:08.158248    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:59:08.326621 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:08.326590    2578 generic.go:356] "Generic (PLEG): container finished" podID="7bad4d47-f01a-458a-97e6-ed54b119e2f5" containerID="e94e7d9fb934c9d2e7cc4c2ad9c0a69edecdac7c8561d89d56583ca70acdfa15" exitCode=0
Jul 08 02:59:08.326804 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:08.326652    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmppx" event={"ID":"7bad4d47-f01a-458a-97e6-ed54b119e2f5","Type":"ContainerDied","Data":"e94e7d9fb934c9d2e7cc4c2ad9c0a69edecdac7c8561d89d56583ca70acdfa15"}
Jul 08 02:59:09.333975 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:09.333937    2578 generic.go:356] "Generic (PLEG): container finished" podID="7bad4d47-f01a-458a-97e6-ed54b119e2f5" containerID="f88134edf0e3791a55f46dcfc88addb105ff866d3edddb0bff0717edb97bbc52" exitCode=0
Jul 08 02:59:09.334429 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:09.334004    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmppx" event={"ID":"7bad4d47-f01a-458a-97e6-ed54b119e2f5","Type":"ContainerDied","Data":"f88134edf0e3791a55f46dcfc88addb105ff866d3edddb0bff0717edb97bbc52"}
Jul 08 02:59:09.763049 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:09.763004    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkjsn\" (UniqueName: \"kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn\") pod \"network-check-target-25r5t\" (UID: \"45d27e40-2605-4821-b3de-ddb132f8e960\") " pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:09.763220 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:09.763138    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 02:59:09.763220 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:09.763153    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 02:59:09.763220 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:09.763163    2578 projected.go:196] Error preparing data for projected volume kube-api-access-tkjsn for pod openshift-network-diagnostics/network-check-target-25r5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:59:09.763220 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:09.763217    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn podName:45d27e40-2605-4821-b3de-ddb132f8e960 nodeName:}" failed. No retries permitted until 2026-07-08 02:59:41.76320462 +0000 UTC m=+66.075483133 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkjsn" (UniqueName: "kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn") pod "network-check-target-25r5t" (UID: "45d27e40-2605-4821-b3de-ddb132f8e960") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 02:59:09.863548 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:09.863488    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret\") pod \"global-pull-secret-syncer-g4z7x\" (UID: \"c039d8af-51c0-4e88-b104-9c7ec5d407aa\") " pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:09.863548 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:09.863528    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs\") pod \"network-metrics-daemon-x592x\" (UID: \"5e6bae47-a81a-461c-94da-98c89694c300\") " pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:09.863805 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:09.863651    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:59:09.863805 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:09.863660    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 02:59:09.863805 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:09.863710    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs podName:5e6bae47-a81a-461c-94da-98c89694c300 nodeName:}" failed. No retries permitted until 2026-07-08 02:59:41.863692691 +0000 UTC m=+66.175971208 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs") pod "network-metrics-daemon-x592x" (UID: "5e6bae47-a81a-461c-94da-98c89694c300") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 02:59:09.863805 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:09.863728    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret podName:c039d8af-51c0-4e88-b104-9c7ec5d407aa nodeName:}" failed. No retries permitted until 2026-07-08 02:59:41.863719052 +0000 UTC m=+66.175997566 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret") pod "global-pull-secret-syncer-g4z7x" (UID: "c039d8af-51c0-4e88-b104-9c7ec5d407aa") : object "kube-system"/"original-pull-secret" not registered
Jul 08 02:59:10.157190 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:10.157153    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:10.157190 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:10.157180    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:10.157426 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:10.157201    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:10.157426 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:10.157277    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:59:10.157426 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:10.157392    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:59:10.157532 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:10.157494    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:59:12.157235 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:12.157207    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:12.157235 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:12.157219    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:12.157760 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:12.157353    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:12.157760 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:12.157364    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:59:12.157760 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:12.157449    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:59:12.157760 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:12.157522    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:59:14.158198 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:14.158159    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:14.158198 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:14.158184    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:14.158694 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:14.158174    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:14.158694 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:14.158289    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:59:14.158694 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:14.158391    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:59:14.158694 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:14.158492    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:59:15.350832 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:15.350801    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmppx" event={"ID":"7bad4d47-f01a-458a-97e6-ed54b119e2f5","Type":"ContainerStarted","Data":"d084cd8e03f1583b0cd3cc6ed9827078f91baba8e79559e253591a3e35721795"}
Jul 08 02:59:16.160834 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:16.160803    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:16.160834 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:16.160825    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:16.161027 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:16.160804    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:16.161027 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:16.160898    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:59:16.161027 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:16.160977    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:59:16.161135 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:16.161040    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:59:16.355140 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:16.355106    2578 generic.go:356] "Generic (PLEG): container finished" podID="7bad4d47-f01a-458a-97e6-ed54b119e2f5" containerID="d084cd8e03f1583b0cd3cc6ed9827078f91baba8e79559e253591a3e35721795" exitCode=0
Jul 08 02:59:16.355487 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:16.355155    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmppx" event={"ID":"7bad4d47-f01a-458a-97e6-ed54b119e2f5","Type":"ContainerDied","Data":"d084cd8e03f1583b0cd3cc6ed9827078f91baba8e79559e253591a3e35721795"}
Jul 08 02:59:17.360150 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:17.360117    2578 generic.go:356] "Generic (PLEG): container finished" podID="7bad4d47-f01a-458a-97e6-ed54b119e2f5" containerID="a392cfe14e4a23dd255b99fa691d99e40a2246a17640ff5b9cd548ba89145d1f" exitCode=0
Jul 08 02:59:17.360585 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:17.360156    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmppx" event={"ID":"7bad4d47-f01a-458a-97e6-ed54b119e2f5","Type":"ContainerDied","Data":"a392cfe14e4a23dd255b99fa691d99e40a2246a17640ff5b9cd548ba89145d1f"}
Jul 08 02:59:18.157278 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:18.157243    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:18.157278 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:18.157261    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:18.157498 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:18.157245    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:18.157498 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:18.157343    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:59:18.157498 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:18.157442    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:59:18.157609 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:18.157507    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:59:18.365131 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:18.365094    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmppx" event={"ID":"7bad4d47-f01a-458a-97e6-ed54b119e2f5","Type":"ContainerStarted","Data":"9d8a4c056d915938d84231fe816429a2d328c2a05c263de786d0be2a84892d3c"}
Jul 08 02:59:18.386935 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:18.386891    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jmppx" podStartSLOduration=8.609258065 podStartE2EDuration="42.386878249s" totalImagesPullingTime="33.777620184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:58:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:59:18.386635376 +0000 UTC m=+42.698913922" watchObservedRunningTime="2026-07-08 02:59:18.386878249 +0000 UTC m=+42.699156782"
Jul 08 02:59:20.160604 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:20.160575    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:20.160981 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:20.160579    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:20.160981 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:20.160584    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:20.160981 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:20.160764    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:59:20.160981 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:20.160661    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:59:20.160981 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:20.160808    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:59:22.160343 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:22.160309    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:22.160855 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:22.160432    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:22.160855 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:22.160445    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:59:22.160855 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:22.160460    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:22.160855 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:22.160537    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:59:22.160855 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:22.160594    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:59:24.157896 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:24.157858    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:24.157896 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:24.157877    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:24.158405 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:24.157868    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:24.158405 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:24.157987    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:59:24.158405 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:24.158085    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:59:24.158405 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:24.158150    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:59:26.158889 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:26.158709    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:26.159283 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:26.158815    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:26.159283 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:26.158840    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:26.159408 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:26.158946    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:59:26.159506 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:26.159468    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:59:26.160985 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:26.160901    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:59:26.501949 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:26.501212    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x592x"]
Jul 08 02:59:26.501949 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:26.501379    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:26.501949 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:26.501506    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:59:26.502253 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:26.502115    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g4z7x"]
Jul 08 02:59:26.502253 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:26.502208    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:26.502387 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:26.502326    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:59:26.503352 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:26.503329    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-25r5t"]
Jul 08 02:59:26.503487 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:26.503431    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:26.503549 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:26.503508    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:59:28.160891 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:28.160864    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:28.161450 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:28.160967    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:59:28.161450 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:28.161037    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:28.161450 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:28.161122    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:59:28.161450 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:28.161126    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:28.161450 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:28.161199    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:59:30.157852 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:30.157820    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:30.157852 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:30.157847    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:30.158424 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:30.157925    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4z7x" podUID="c039d8af-51c0-4e88-b104-9c7ec5d407aa"
Jul 08 02:59:30.158424 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:30.157980    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:30.158424 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:30.158081    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x592x" podUID="5e6bae47-a81a-461c-94da-98c89694c300"
Jul 08 02:59:30.158424 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:30.158138    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-25r5t" podUID="45d27e40-2605-4821-b3de-ddb132f8e960"
Jul 08 02:59:31.004979 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.004948    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-199.ec2.internal" event="NodeReady"
Jul 08 02:59:31.005154 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.005096    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 02:59:31.052729 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.052702    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55d5c74b8b-mzrwx"]
Jul 08 02:59:31.054586 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.054571    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.056842 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.056813    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xcxgk\""
Jul 08 02:59:31.056966 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.056849    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 02:59:31.056966 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.056956    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 02:59:31.057125 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.057095    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 02:59:31.062626 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.062608    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 02:59:31.068268 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.068245    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55d5c74b8b-mzrwx"]
Jul 08 02:59:31.071879 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.071859    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4l7xp"]
Jul 08 02:59:31.073807 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.073790    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4l7xp"
Jul 08 02:59:31.075398 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.075377    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lzlzt"]
Jul 08 02:59:31.076498 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.076482    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 02:59:31.076595 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.076565    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6djh2\""
Jul 08 02:59:31.076709 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.076693    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 02:59:31.077209 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.077195    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lzlzt"
Jul 08 02:59:31.079068 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.079049    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5d4df\""
Jul 08 02:59:31.079790 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.079772    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 02:59:31.079884 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.079790    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 02:59:31.079884 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.079780    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 02:59:31.079884 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.079778    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 02:59:31.088390 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.088371    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4l7xp"]
Jul 08 02:59:31.104941 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.104915    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lzlzt"]
Jul 08 02:59:31.116640 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.116608    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41a3dbb6-2a2f-4634-9140-eedc76a46180-trusted-ca\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.116772 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.116641    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41a3dbb6-2a2f-4634-9140-eedc76a46180-installation-pull-secrets\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.116772 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.116660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42809e4a-365b-407c-84fb-bf886bef4038-metrics-tls\") pod \"dns-default-4l7xp\" (UID: \"42809e4a-365b-407c-84fb-bf886bef4038\") " pod="openshift-dns/dns-default-4l7xp"
Jul 08 02:59:31.116772 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.116674    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42809e4a-365b-407c-84fb-bf886bef4038-tmp-dir\") pod \"dns-default-4l7xp\" (UID: \"42809e4a-365b-407c-84fb-bf886bef4038\") " pod="openshift-dns/dns-default-4l7xp"
Jul 08 02:59:31.116772 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.116708    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz9dd\" (UniqueName: \"kubernetes.io/projected/42809e4a-365b-407c-84fb-bf886bef4038-kube-api-access-hz9dd\") pod \"dns-default-4l7xp\" (UID: \"42809e4a-365b-407c-84fb-bf886bef4038\") " pod="openshift-dns/dns-default-4l7xp"
Jul 08 02:59:31.116772 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.116730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41a3dbb6-2a2f-4634-9140-eedc76a46180-image-registry-private-configuration\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.116772 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.116768    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41a3dbb6-2a2f-4634-9140-eedc76a46180-registry-certificates\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.116966 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.116785    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81c1f76e-7365-461b-97c3-f1d59ba67af9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lzlzt\" (UID: \"81c1f76e-7365-461b-97c3-f1d59ba67af9\") " pod="openshift-insights/insights-runtime-extractor-lzlzt"
Jul 08 02:59:31.116966 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.116809    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41a3dbb6-2a2f-4634-9140-eedc76a46180-ca-trust-extracted\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.116966 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.116830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81c1f76e-7365-461b-97c3-f1d59ba67af9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lzlzt\" (UID: \"81c1f76e-7365-461b-97c3-f1d59ba67af9\") " pod="openshift-insights/insights-runtime-extractor-lzlzt"
Jul 08 02:59:31.116966 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.116871    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwp7r\" (UniqueName: \"kubernetes.io/projected/41a3dbb6-2a2f-4634-9140-eedc76a46180-kube-api-access-zwp7r\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.116966 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.116886    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81c1f76e-7365-461b-97c3-f1d59ba67af9-crio-socket\") pod \"insights-runtime-extractor-lzlzt\" (UID: \"81c1f76e-7365-461b-97c3-f1d59ba67af9\") " pod="openshift-insights/insights-runtime-extractor-lzlzt"
Jul 08 02:59:31.116966 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.116923    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41a3dbb6-2a2f-4634-9140-eedc76a46180-bound-sa-token\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.116966 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.116949    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7t6l\" (UniqueName: \"kubernetes.io/projected/81c1f76e-7365-461b-97c3-f1d59ba67af9-kube-api-access-j7t6l\") pod \"insights-runtime-extractor-lzlzt\" (UID: \"81c1f76e-7365-461b-97c3-f1d59ba67af9\") " pod="openshift-insights/insights-runtime-extractor-lzlzt"
Jul 08 02:59:31.116966 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.116967    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41a3dbb6-2a2f-4634-9140-eedc76a46180-registry-tls\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.117202 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.116993    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81c1f76e-7365-461b-97c3-f1d59ba67af9-data-volume\") pod \"insights-runtime-extractor-lzlzt\" (UID: \"81c1f76e-7365-461b-97c3-f1d59ba67af9\") " pod="openshift-insights/insights-runtime-extractor-lzlzt"
Jul 08 02:59:31.117202 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.117007    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/42809e4a-365b-407c-84fb-bf886bef4038-config-volume\") pod \"dns-default-4l7xp\" (UID: \"42809e4a-365b-407c-84fb-bf886bef4038\") " pod="openshift-dns/dns-default-4l7xp"
Jul 08 02:59:31.170405 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.170374    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kxv7r"]
Jul 08 02:59:31.172512 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.172497    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kxv7r"
Jul 08 02:59:31.175225 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.175208    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 02:59:31.175318 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.175222    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 02:59:31.175361 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.175311    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kmjwn\""
Jul 08 02:59:31.175624 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.175609    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 02:59:31.183236 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.183212    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kxv7r"]
Jul 08 02:59:31.217401 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.217371    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7t6l\" (UniqueName: \"kubernetes.io/projected/81c1f76e-7365-461b-97c3-f1d59ba67af9-kube-api-access-j7t6l\") pod \"insights-runtime-extractor-lzlzt\" (UID: \"81c1f76e-7365-461b-97c3-f1d59ba67af9\") " pod="openshift-insights/insights-runtime-extractor-lzlzt"
Jul 08 02:59:31.217401 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.217401    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41a3dbb6-2a2f-4634-9140-eedc76a46180-registry-tls\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.217683 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.217426    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81c1f76e-7365-461b-97c3-f1d59ba67af9-data-volume\") pod \"insights-runtime-extractor-lzlzt\" (UID: \"81c1f76e-7365-461b-97c3-f1d59ba67af9\") " pod="openshift-insights/insights-runtime-extractor-lzlzt"
Jul 08 02:59:31.217683 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.217459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/42809e4a-365b-407c-84fb-bf886bef4038-config-volume\") pod \"dns-default-4l7xp\" (UID: \"42809e4a-365b-407c-84fb-bf886bef4038\") " pod="openshift-dns/dns-default-4l7xp"
Jul 08 02:59:31.217683 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.217589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41a3dbb6-2a2f-4634-9140-eedc76a46180-trusted-ca\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.217683 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.217626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41a3dbb6-2a2f-4634-9140-eedc76a46180-installation-pull-secrets\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.219310 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.218065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42809e4a-365b-407c-84fb-bf886bef4038-metrics-tls\") pod \"dns-default-4l7xp\" (UID: \"42809e4a-365b-407c-84fb-bf886bef4038\") " pod="openshift-dns/dns-default-4l7xp"
Jul 08 02:59:31.219310 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.218215    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81c1f76e-7365-461b-97c3-f1d59ba67af9-data-volume\") pod \"insights-runtime-extractor-lzlzt\" (UID: \"81c1f76e-7365-461b-97c3-f1d59ba67af9\") " pod="openshift-insights/insights-runtime-extractor-lzlzt"
Jul 08 02:59:31.219310 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.218128    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42809e4a-365b-407c-84fb-bf886bef4038-tmp-dir\") pod \"dns-default-4l7xp\" (UID: \"42809e4a-365b-407c-84fb-bf886bef4038\") " pod="openshift-dns/dns-default-4l7xp"
Jul 08 02:59:31.219310 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.218318    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz9dd\" (UniqueName: \"kubernetes.io/projected/42809e4a-365b-407c-84fb-bf886bef4038-kube-api-access-hz9dd\") pod \"dns-default-4l7xp\" (UID: \"42809e4a-365b-407c-84fb-bf886bef4038\") " pod="openshift-dns/dns-default-4l7xp"
Jul 08 02:59:31.219310 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.218321    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/42809e4a-365b-407c-84fb-bf886bef4038-config-volume\") pod \"dns-default-4l7xp\" (UID: \"42809e4a-365b-407c-84fb-bf886bef4038\") " pod="openshift-dns/dns-default-4l7xp"
Jul 08 02:59:31.219310 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.218360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41a3dbb6-2a2f-4634-9140-eedc76a46180-image-registry-private-configuration\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.219310 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.218606    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42809e4a-365b-407c-84fb-bf886bef4038-tmp-dir\") pod \"dns-default-4l7xp\" (UID: \"42809e4a-365b-407c-84fb-bf886bef4038\") " pod="openshift-dns/dns-default-4l7xp"
Jul 08 02:59:31.219310 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.219247    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41a3dbb6-2a2f-4634-9140-eedc76a46180-registry-certificates\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.223027 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.218398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/41a3dbb6-2a2f-4634-9140-eedc76a46180-registry-certificates\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.223027 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.219796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81c1f76e-7365-461b-97c3-f1d59ba67af9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lzlzt\" (UID: \"81c1f76e-7365-461b-97c3-f1d59ba67af9\") " pod="openshift-insights/insights-runtime-extractor-lzlzt"
Jul 08 02:59:31.223027 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.219832    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c8fcdd1-b268-4c5b-b089-7ce11183cd27-cert\") pod \"ingress-canary-kxv7r\" (UID: \"0c8fcdd1-b268-4c5b-b089-7ce11183cd27\") " pod="openshift-ingress-canary/ingress-canary-kxv7r"
Jul 08 02:59:31.223027 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.219868    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41a3dbb6-2a2f-4634-9140-eedc76a46180-ca-trust-extracted\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.223027 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.219897    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gnsm\" (UniqueName: \"kubernetes.io/projected/0c8fcdd1-b268-4c5b-b089-7ce11183cd27-kube-api-access-8gnsm\") pod \"ingress-canary-kxv7r\" (UID: \"0c8fcdd1-b268-4c5b-b089-7ce11183cd27\") " pod="openshift-ingress-canary/ingress-canary-kxv7r"
Jul 08 02:59:31.223027 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.219931    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81c1f76e-7365-461b-97c3-f1d59ba67af9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lzlzt\" (UID: \"81c1f76e-7365-461b-97c3-f1d59ba67af9\") " pod="openshift-insights/insights-runtime-extractor-lzlzt"
Jul 08 02:59:31.223027 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.219999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwp7r\" (UniqueName: \"kubernetes.io/projected/41a3dbb6-2a2f-4634-9140-eedc76a46180-kube-api-access-zwp7r\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.223027 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.220029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81c1f76e-7365-461b-97c3-f1d59ba67af9-crio-socket\") pod \"insights-runtime-extractor-lzlzt\" (UID: \"81c1f76e-7365-461b-97c3-f1d59ba67af9\") " pod="openshift-insights/insights-runtime-extractor-lzlzt"
Jul 08 02:59:31.223027 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.220087    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41a3dbb6-2a2f-4634-9140-eedc76a46180-bound-sa-token\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.223027 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.220290    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81c1f76e-7365-461b-97c3-f1d59ba67af9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lzlzt\" (UID: \"81c1f76e-7365-461b-97c3-f1d59ba67af9\") " pod="openshift-insights/insights-runtime-extractor-lzlzt"
Jul 08 02:59:31.223027 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.220689    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/41a3dbb6-2a2f-4634-9140-eedc76a46180-ca-trust-extracted\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.223027 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.221172    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81c1f76e-7365-461b-97c3-f1d59ba67af9-crio-socket\") pod \"insights-runtime-extractor-lzlzt\" (UID: \"81c1f76e-7365-461b-97c3-f1d59ba67af9\") " pod="openshift-insights/insights-runtime-extractor-lzlzt"
Jul 08 02:59:31.223027 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.221258    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/41a3dbb6-2a2f-4634-9140-eedc76a46180-trusted-ca\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.224224 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.223727    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/41a3dbb6-2a2f-4634-9140-eedc76a46180-registry-tls\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.224224 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.223953    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/41a3dbb6-2a2f-4634-9140-eedc76a46180-image-registry-private-configuration\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.224615 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.224590    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/41a3dbb6-2a2f-4634-9140-eedc76a46180-installation-pull-secrets\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.224834 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.224815    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42809e4a-365b-407c-84fb-bf886bef4038-metrics-tls\") pod \"dns-default-4l7xp\" (UID: \"42809e4a-365b-407c-84fb-bf886bef4038\") " pod="openshift-dns/dns-default-4l7xp"
Jul 08 02:59:31.225406 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.225386    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81c1f76e-7365-461b-97c3-f1d59ba67af9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lzlzt\" (UID: \"81c1f76e-7365-461b-97c3-f1d59ba67af9\") " pod="openshift-insights/insights-runtime-extractor-lzlzt"
Jul 08 02:59:31.226312 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.226292    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7t6l\" (UniqueName: \"kubernetes.io/projected/81c1f76e-7365-461b-97c3-f1d59ba67af9-kube-api-access-j7t6l\") pod \"insights-runtime-extractor-lzlzt\" (UID: \"81c1f76e-7365-461b-97c3-f1d59ba67af9\") " pod="openshift-insights/insights-runtime-extractor-lzlzt"
Jul 08 02:59:31.228129 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.228071    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz9dd\" (UniqueName: \"kubernetes.io/projected/42809e4a-365b-407c-84fb-bf886bef4038-kube-api-access-hz9dd\") pod \"dns-default-4l7xp\" (UID: \"42809e4a-365b-407c-84fb-bf886bef4038\") " pod="openshift-dns/dns-default-4l7xp"
Jul 08 02:59:31.229800 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.229774    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwp7r\" (UniqueName: \"kubernetes.io/projected/41a3dbb6-2a2f-4634-9140-eedc76a46180-kube-api-access-zwp7r\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.230022 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.229997    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/41a3dbb6-2a2f-4634-9140-eedc76a46180-bound-sa-token\") pod \"image-registry-55d5c74b8b-mzrwx\" (UID: \"41a3dbb6-2a2f-4634-9140-eedc76a46180\") " pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.321294 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.321220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c8fcdd1-b268-4c5b-b089-7ce11183cd27-cert\") pod \"ingress-canary-kxv7r\" (UID: \"0c8fcdd1-b268-4c5b-b089-7ce11183cd27\") " pod="openshift-ingress-canary/ingress-canary-kxv7r"
Jul 08 02:59:31.321294 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.321253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gnsm\" (UniqueName: \"kubernetes.io/projected/0c8fcdd1-b268-4c5b-b089-7ce11183cd27-kube-api-access-8gnsm\") pod \"ingress-canary-kxv7r\" (UID: \"0c8fcdd1-b268-4c5b-b089-7ce11183cd27\") " pod="openshift-ingress-canary/ingress-canary-kxv7r"
Jul 08 02:59:31.323529 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.323511    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c8fcdd1-b268-4c5b-b089-7ce11183cd27-cert\") pod \"ingress-canary-kxv7r\" (UID: \"0c8fcdd1-b268-4c5b-b089-7ce11183cd27\") " pod="openshift-ingress-canary/ingress-canary-kxv7r"
Jul 08 02:59:31.329694 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.329672    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gnsm\" (UniqueName: \"kubernetes.io/projected/0c8fcdd1-b268-4c5b-b089-7ce11183cd27-kube-api-access-8gnsm\") pod \"ingress-canary-kxv7r\" (UID: \"0c8fcdd1-b268-4c5b-b089-7ce11183cd27\") " pod="openshift-ingress-canary/ingress-canary-kxv7r"
Jul 08 02:59:31.364618 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.364574    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:31.383260 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.383232    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4l7xp"
Jul 08 02:59:31.387852 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.387833    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lzlzt"
Jul 08 02:59:31.481454 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.481227    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kxv7r"
Jul 08 02:59:31.530995 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.530963    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55d5c74b8b-mzrwx"]
Jul 08 02:59:31.534180 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:59:31.534140    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a3dbb6_2a2f_4634_9140_eedc76a46180.slice/crio-9f2dec43671633dcc9051afb68d371ac9e4ea1dd342a06d1d4d5695dd200480a WatchSource:0}: Error finding container 9f2dec43671633dcc9051afb68d371ac9e4ea1dd342a06d1d4d5695dd200480a: Status 404 returned error can't find the container with id 9f2dec43671633dcc9051afb68d371ac9e4ea1dd342a06d1d4d5695dd200480a
Jul 08 02:59:31.539166 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.538712    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lzlzt"]
Jul 08 02:59:31.543258 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.542233    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4l7xp"]
Jul 08 02:59:31.548391 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:59:31.547321    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42809e4a_365b_407c_84fb_bf886bef4038.slice/crio-34957f026ac171b3406e4eb8d5fe7ebb5622c9418da6fc3156c131d191b3ab0f WatchSource:0}: Error finding container 34957f026ac171b3406e4eb8d5fe7ebb5622c9418da6fc3156c131d191b3ab0f: Status 404 returned error can't find the container with id 34957f026ac171b3406e4eb8d5fe7ebb5622c9418da6fc3156c131d191b3ab0f
Jul 08 02:59:31.618945 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:31.618928    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kxv7r"]
Jul 08 02:59:31.621108 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:59:31.621084    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8fcdd1_b268_4c5b_b089_7ce11183cd27.slice/crio-d26310b4078224a1cf861f3ab8f150d602a8685771aa07c5b735808331418dd5 WatchSource:0}: Error finding container d26310b4078224a1cf861f3ab8f150d602a8685771aa07c5b735808331418dd5: Status 404 returned error can't find the container with id d26310b4078224a1cf861f3ab8f150d602a8685771aa07c5b735808331418dd5
Jul 08 02:59:32.164030 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:32.163136    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:32.164030 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:32.163142    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:32.164030 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:32.163291    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:32.167090 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:32.167064    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 02:59:32.167339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:32.167294    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 02:59:32.167339 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:32.167309    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v7mdx\""
Jul 08 02:59:32.167518 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:32.167499    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fsx5r\""
Jul 08 02:59:32.167620 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:32.167602    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 02:59:32.167892 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:32.167875    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 02:59:32.398247 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:32.398161    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4l7xp" event={"ID":"42809e4a-365b-407c-84fb-bf886bef4038","Type":"ContainerStarted","Data":"34957f026ac171b3406e4eb8d5fe7ebb5622c9418da6fc3156c131d191b3ab0f"}
Jul 08 02:59:32.402029 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:32.401938    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kxv7r" event={"ID":"0c8fcdd1-b268-4c5b-b089-7ce11183cd27","Type":"ContainerStarted","Data":"d26310b4078224a1cf861f3ab8f150d602a8685771aa07c5b735808331418dd5"}
Jul 08 02:59:32.403558 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:32.403526    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lzlzt" event={"ID":"81c1f76e-7365-461b-97c3-f1d59ba67af9","Type":"ContainerStarted","Data":"13e30e2773773b74c9472239c69be615e119beb03c54c1d69ebdc9360114c92f"}
Jul 08 02:59:32.406713 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:32.406646    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx" event={"ID":"41a3dbb6-2a2f-4634-9140-eedc76a46180","Type":"ContainerStarted","Data":"998c2fb37db850ccf218677c86b6c1da693b70c7ee042b6fe9d6bbeb2db3c859"}
Jul 08 02:59:32.406713 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:32.406689    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx" event={"ID":"41a3dbb6-2a2f-4634-9140-eedc76a46180","Type":"ContainerStarted","Data":"9f2dec43671633dcc9051afb68d371ac9e4ea1dd342a06d1d4d5695dd200480a"}
Jul 08 02:59:32.407412 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:32.407392    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:32.428055 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:32.427962    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx" podStartSLOduration=7.427949139 podStartE2EDuration="7.427949139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:59:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:59:32.427931926 +0000 UTC m=+56.740210460" watchObservedRunningTime="2026-07-08 02:59:32.427949139 +0000 UTC m=+56.740227672"
Jul 08 02:59:37.339558 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:37.339529    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qk6k"
Jul 08 02:59:37.423107 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:37.423072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4l7xp" event={"ID":"42809e4a-365b-407c-84fb-bf886bef4038","Type":"ContainerStarted","Data":"23744edd63091dac33925d998b21a094ed471c214813a983708d232a551658e2"}
Jul 08 02:59:37.423241 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:37.423130    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4l7xp" event={"ID":"42809e4a-365b-407c-84fb-bf886bef4038","Type":"ContainerStarted","Data":"ac054617b92b73a552f53ee190034cb04fc3b75dbaebf35e4ed20d66479f2b3f"}
Jul 08 02:59:37.423241 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:37.423151    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4l7xp"
Jul 08 02:59:37.424550 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:37.424525    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kxv7r" event={"ID":"0c8fcdd1-b268-4c5b-b089-7ce11183cd27","Type":"ContainerStarted","Data":"60781065d7bebadb904255b6f9558e367927e09078ae5b7dadf6788c6af957a8"}
Jul 08 02:59:37.445683 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:37.445634    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4l7xp" podStartSLOduration=0.998638764 podStartE2EDuration="6.445613543s" totalImagesPullingTime="5.446974779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:59:37.444579421 +0000 UTC m=+61.756857957" watchObservedRunningTime="2026-07-08 02:59:37.445613543 +0000 UTC m=+61.757892079"
Jul 08 02:59:37.465660 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:37.465615    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kxv7r" podStartSLOduration=1.090598856 podStartE2EDuration="6.465598369s" totalImagesPullingTime="5.374999513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:59:37.464732525 +0000 UTC m=+61.777011069" watchObservedRunningTime="2026-07-08 02:59:37.465598369 +0000 UTC m=+61.777876902"
Jul 08 02:59:38.429408 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:38.429370    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lzlzt" event={"ID":"81c1f76e-7365-461b-97c3-f1d59ba67af9","Type":"ContainerStarted","Data":"dc0e98c242f96021fe44b275589ca9d018a3851bb23c81b9886ac2c4ad687afa"}
Jul 08 02:59:38.429825 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:38.429437    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lzlzt" event={"ID":"81c1f76e-7365-461b-97c3-f1d59ba67af9","Type":"ContainerStarted","Data":"29eba961a7cdd0dfad3e6fd62409ca09cc9688269eedd819534659ce754da274"}
Jul 08 02:59:41.441264 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:41.441228    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lzlzt" event={"ID":"81c1f76e-7365-461b-97c3-f1d59ba67af9","Type":"ContainerStarted","Data":"a84803deac40bb661397ae58e8793708ccee2e8c78a4024bb8468b2da88877df"}
Jul 08 02:59:41.456924 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:41.456876    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lzlzt" podStartSLOduration=1.596823848 podStartE2EDuration="10.456862011s" totalImagesPullingTime="8.860038163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:59:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:59:41.456690755 +0000 UTC m=+65.768969290" watchObservedRunningTime="2026-07-08 02:59:41.456862011 +0000 UTC m=+65.769140544"
Jul 08 02:59:41.810858 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:41.810821    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkjsn\" (UniqueName: \"kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn\") pod \"network-check-target-25r5t\" (UID: \"45d27e40-2605-4821-b3de-ddb132f8e960\") " pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:41.813391 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:41.813372    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 02:59:41.823906 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:41.823886    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 02:59:41.836451 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:41.836428    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkjsn\" (UniqueName: \"kubernetes.io/projected/45d27e40-2605-4821-b3de-ddb132f8e960-kube-api-access-tkjsn\") pod \"network-check-target-25r5t\" (UID: \"45d27e40-2605-4821-b3de-ddb132f8e960\") " pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:41.911813 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:41.911775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret\") pod \"global-pull-secret-syncer-g4z7x\" (UID: \"c039d8af-51c0-4e88-b104-9c7ec5d407aa\") " pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:41.911813 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:41.911814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs\") pod \"network-metrics-daemon-x592x\" (UID: \"5e6bae47-a81a-461c-94da-98c89694c300\") " pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:41.913926 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:41.913909    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 02:59:41.913975 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:41.913950    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 02:59:41.924673 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:41.924637    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e6bae47-a81a-461c-94da-98c89694c300-metrics-certs\") pod \"network-metrics-daemon-x592x\" (UID: \"5e6bae47-a81a-461c-94da-98c89694c300\") " pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:41.924807 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:41.924729    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c039d8af-51c0-4e88-b104-9c7ec5d407aa-original-pull-secret\") pod \"global-pull-secret-syncer-g4z7x\" (UID: \"c039d8af-51c0-4e88-b104-9c7ec5d407aa\") " pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:42.082549 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.082465    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fsx5r\""
Jul 08 02:59:42.089980 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.089960    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4z7x"
Jul 08 02:59:42.091043 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.091025    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x592x"
Jul 08 02:59:42.100239 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.100209    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v7mdx\""
Jul 08 02:59:42.108862 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.108837    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:42.241178 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.241144    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g4z7x"]
Jul 08 02:59:42.244982 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:59:42.244941    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc039d8af_51c0_4e88_b104_9c7ec5d407aa.slice/crio-538eb72e515f90bcbf7e8f6aaecf2bd8a9b72203354f7d50c6dee4037d39b60a WatchSource:0}: Error finding container 538eb72e515f90bcbf7e8f6aaecf2bd8a9b72203354f7d50c6dee4037d39b60a: Status 404 returned error can't find the container with id 538eb72e515f90bcbf7e8f6aaecf2bd8a9b72203354f7d50c6dee4037d39b60a
Jul 08 02:59:42.258712 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.258640    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x592x"]
Jul 08 02:59:42.262177 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:59:42.262144    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e6bae47_a81a_461c_94da_98c89694c300.slice/crio-88343b00d8697cac32bb0c918dd6653b3087e696ff1c1cfb8bf824d4ed29faa1 WatchSource:0}: Error finding container 88343b00d8697cac32bb0c918dd6653b3087e696ff1c1cfb8bf824d4ed29faa1: Status 404 returned error can't find the container with id 88343b00d8697cac32bb0c918dd6653b3087e696ff1c1cfb8bf824d4ed29faa1
Jul 08 02:59:42.274050 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.274029    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-25r5t"]
Jul 08 02:59:42.277280 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:59:42.277261    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45d27e40_2605_4821_b3de_ddb132f8e960.slice/crio-782c5729ea6b89198beaa854fc06c1bd69c118c6fd9d8460960f073e5fdea785 WatchSource:0}: Error finding container 782c5729ea6b89198beaa854fc06c1bd69c118c6fd9d8460960f073e5fdea785: Status 404 returned error can't find the container with id 782c5729ea6b89198beaa854fc06c1bd69c118c6fd9d8460960f073e5fdea785
Jul 08 02:59:42.445298 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.445214    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-25r5t" event={"ID":"45d27e40-2605-4821-b3de-ddb132f8e960","Type":"ContainerStarted","Data":"782c5729ea6b89198beaa854fc06c1bd69c118c6fd9d8460960f073e5fdea785"}
Jul 08 02:59:42.446293 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.446265    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g4z7x" event={"ID":"c039d8af-51c0-4e88-b104-9c7ec5d407aa","Type":"ContainerStarted","Data":"538eb72e515f90bcbf7e8f6aaecf2bd8a9b72203354f7d50c6dee4037d39b60a"}
Jul 08 02:59:42.447369 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.447350    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x592x" event={"ID":"5e6bae47-a81a-461c-94da-98c89694c300","Type":"ContainerStarted","Data":"88343b00d8697cac32bb0c918dd6653b3087e696ff1c1cfb8bf824d4ed29faa1"}
Jul 08 02:59:42.674297 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.674266    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw"]
Jul 08 02:59:42.678455 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.678439    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw"
Jul 08 02:59:42.681220 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.681195    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 08 02:59:42.681340 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.681243    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 02:59:42.681706 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.681688    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-sh2np\""
Jul 08 02:59:42.681764 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.681700    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 02:59:42.681764 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.681705    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 02:59:42.681855 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.681777    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 08 02:59:42.687016 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.686994    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw"]
Jul 08 02:59:42.721623 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.721538    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h7qr6"]
Jul 08 02:59:42.724754 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.724717    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.726906 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.726885    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 02:59:42.727047 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.726941    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9rm8r\""
Jul 08 02:59:42.727347 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.727323    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 02:59:42.727478 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.727352    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 02:59:42.819980 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.819944    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0b7cd4d-577b-4d13-afaf-a0460fee4934-node-exporter-accelerators-collector-config\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.819980 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.819992    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0b7cd4d-577b-4d13-afaf-a0460fee4934-node-exporter-tls\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.820242 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.820023    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87871047-e75a-4fdc-9e4f-73891b052829-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-rc9gw\" (UID: \"87871047-e75a-4fdc-9e4f-73891b052829\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw"
Jul 08 02:59:42.820242 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.820094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/87871047-e75a-4fdc-9e4f-73891b052829-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-rc9gw\" (UID: \"87871047-e75a-4fdc-9e4f-73891b052829\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw"
Jul 08 02:59:42.820242 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.820136    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0b7cd4d-577b-4d13-afaf-a0460fee4934-sys\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.820242 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.820168    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0b7cd4d-577b-4d13-afaf-a0460fee4934-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.820242 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.820198    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d0b7cd4d-577b-4d13-afaf-a0460fee4934-node-exporter-textfile\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.820242 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.820238    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw9qc\" (UniqueName: \"kubernetes.io/projected/87871047-e75a-4fdc-9e4f-73891b052829-kube-api-access-cw9qc\") pod \"openshift-state-metrics-54cf96dfcf-rc9gw\" (UID: \"87871047-e75a-4fdc-9e4f-73891b052829\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw"
Jul 08 02:59:42.820608 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.820283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87871047-e75a-4fdc-9e4f-73891b052829-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-rc9gw\" (UID: \"87871047-e75a-4fdc-9e4f-73891b052829\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw"
Jul 08 02:59:42.820608 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.820311    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d0b7cd4d-577b-4d13-afaf-a0460fee4934-node-exporter-wtmp\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.820608 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.820334    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0b7cd4d-577b-4d13-afaf-a0460fee4934-metrics-client-ca\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.820608 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.820367    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp6d7\" (UniqueName: \"kubernetes.io/projected/d0b7cd4d-577b-4d13-afaf-a0460fee4934-kube-api-access-hp6d7\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.820608 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.820391    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d0b7cd4d-577b-4d13-afaf-a0460fee4934-root\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.921404 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.921364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d0b7cd4d-577b-4d13-afaf-a0460fee4934-root\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.921404 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.921409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0b7cd4d-577b-4d13-afaf-a0460fee4934-node-exporter-accelerators-collector-config\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.921656 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.921434    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0b7cd4d-577b-4d13-afaf-a0460fee4934-node-exporter-tls\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.921656 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.921461    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87871047-e75a-4fdc-9e4f-73891b052829-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-rc9gw\" (UID: \"87871047-e75a-4fdc-9e4f-73891b052829\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw"
Jul 08 02:59:42.921656 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.921498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/87871047-e75a-4fdc-9e4f-73891b052829-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-rc9gw\" (UID: \"87871047-e75a-4fdc-9e4f-73891b052829\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw"
Jul 08 02:59:42.921656 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.921529    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0b7cd4d-577b-4d13-afaf-a0460fee4934-sys\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.921656 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.921552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0b7cd4d-577b-4d13-afaf-a0460fee4934-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.921656 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.921581    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d0b7cd4d-577b-4d13-afaf-a0460fee4934-node-exporter-textfile\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.921656 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.921608    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw9qc\" (UniqueName: \"kubernetes.io/projected/87871047-e75a-4fdc-9e4f-73891b052829-kube-api-access-cw9qc\") pod \"openshift-state-metrics-54cf96dfcf-rc9gw\" (UID: \"87871047-e75a-4fdc-9e4f-73891b052829\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw"
Jul 08 02:59:42.921656 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.921632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87871047-e75a-4fdc-9e4f-73891b052829-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-rc9gw\" (UID: \"87871047-e75a-4fdc-9e4f-73891b052829\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw"
Jul 08 02:59:42.921656 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.921651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d0b7cd4d-577b-4d13-afaf-a0460fee4934-node-exporter-wtmp\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.922048 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.921673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0b7cd4d-577b-4d13-afaf-a0460fee4934-metrics-client-ca\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.922048 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.921699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp6d7\" (UniqueName: \"kubernetes.io/projected/d0b7cd4d-577b-4d13-afaf-a0460fee4934-kube-api-access-hp6d7\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.922370 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.922333    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d0b7cd4d-577b-4d13-afaf-a0460fee4934-root\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.923192 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.922945    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d0b7cd4d-577b-4d13-afaf-a0460fee4934-node-exporter-wtmp\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.923192 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.923049    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d0b7cd4d-577b-4d13-afaf-a0460fee4934-node-exporter-textfile\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.923192 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.923103    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0b7cd4d-577b-4d13-afaf-a0460fee4934-sys\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.923192 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.923130    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0b7cd4d-577b-4d13-afaf-a0460fee4934-node-exporter-accelerators-collector-config\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.924151 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.923795    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0b7cd4d-577b-4d13-afaf-a0460fee4934-metrics-client-ca\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.924736 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.924709    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87871047-e75a-4fdc-9e4f-73891b052829-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-rc9gw\" (UID: \"87871047-e75a-4fdc-9e4f-73891b052829\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw"
Jul 08 02:59:42.926247 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.926206    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/87871047-e75a-4fdc-9e4f-73891b052829-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-rc9gw\" (UID: \"87871047-e75a-4fdc-9e4f-73891b052829\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw"
Jul 08 02:59:42.926554 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.926367    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0b7cd4d-577b-4d13-afaf-a0460fee4934-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.927044 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.927014    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0b7cd4d-577b-4d13-afaf-a0460fee4934-node-exporter-tls\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.928065 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.928026    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87871047-e75a-4fdc-9e4f-73891b052829-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-rc9gw\" (UID: \"87871047-e75a-4fdc-9e4f-73891b052829\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw"
Jul 08 02:59:42.932327 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.932302    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw9qc\" (UniqueName: \"kubernetes.io/projected/87871047-e75a-4fdc-9e4f-73891b052829-kube-api-access-cw9qc\") pod \"openshift-state-metrics-54cf96dfcf-rc9gw\" (UID: \"87871047-e75a-4fdc-9e4f-73891b052829\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw"
Jul 08 02:59:42.932424 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.932329    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp6d7\" (UniqueName: \"kubernetes.io/projected/d0b7cd4d-577b-4d13-afaf-a0460fee4934-kube-api-access-hp6d7\") pod \"node-exporter-h7qr6\" (UID: \"d0b7cd4d-577b-4d13-afaf-a0460fee4934\") " pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:42.987621 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:42.987530    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw"
Jul 08 02:59:43.034980 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:43.034948    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h7qr6"
Jul 08 02:59:43.161278 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:43.161230    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw"]
Jul 08 02:59:43.164612 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:59:43.164585    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87871047_e75a_4fdc_9e4f_73891b052829.slice/crio-a61cca198c974e52beb3b6971a9ca05a2255653c892a61fe8c5413f6a4cf59cb WatchSource:0}: Error finding container a61cca198c974e52beb3b6971a9ca05a2255653c892a61fe8c5413f6a4cf59cb: Status 404 returned error can't find the container with id a61cca198c974e52beb3b6971a9ca05a2255653c892a61fe8c5413f6a4cf59cb
Jul 08 02:59:43.453414 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:43.453342    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h7qr6" event={"ID":"d0b7cd4d-577b-4d13-afaf-a0460fee4934","Type":"ContainerStarted","Data":"16c51dcd01ea80c19920d00af76d1bc7fbf4877bde346a0b7d8a1ddabd5b57de"}
Jul 08 02:59:43.455874 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:43.455716    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw" event={"ID":"87871047-e75a-4fdc-9e4f-73891b052829","Type":"ContainerStarted","Data":"587ce9cd5751873d606e559612f5cce2fc0be9161bb08168f1e32046187d5217"}
Jul 08 02:59:43.455874 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:43.455801    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw" event={"ID":"87871047-e75a-4fdc-9e4f-73891b052829","Type":"ContainerStarted","Data":"b4af66fefb4a8f8c23c164db467b570d247eef4a13554929649d3a84178927ac"}
Jul 08 02:59:43.455874 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:43.455834    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw" event={"ID":"87871047-e75a-4fdc-9e4f-73891b052829","Type":"ContainerStarted","Data":"a61cca198c974e52beb3b6971a9ca05a2255653c892a61fe8c5413f6a4cf59cb"}
Jul 08 02:59:44.461350 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:44.461244    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x592x" event={"ID":"5e6bae47-a81a-461c-94da-98c89694c300","Type":"ContainerStarted","Data":"b0e14cfe310d0f31cb9927d9f9b731089d548b80e3f0361504be919cee7f39d0"}
Jul 08 02:59:44.461350 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:44.461313    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x592x" event={"ID":"5e6bae47-a81a-461c-94da-98c89694c300","Type":"ContainerStarted","Data":"b27ac393775f5ba80b13bd0d13c36de38791473deee8fd2283f928a116d3eca9"}
Jul 08 02:59:44.478591 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:44.478539    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x592x" podStartSLOduration=67.059582577 podStartE2EDuration="1m8.478519369s" totalImagesPullingTime="1.418936792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:59:44.477453194 +0000 UTC m=+68.789731728" watchObservedRunningTime="2026-07-08 02:59:44.478519369 +0000 UTC m=+68.790797903"
Jul 08 02:59:45.469617 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:45.469578    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h7qr6" event={"ID":"d0b7cd4d-577b-4d13-afaf-a0460fee4934","Type":"ContainerStarted","Data":"8bf33d1b0ead2342fe45a74c4a83d1ff0d300fe68c3332f60a40994aa39f06dc"}
Jul 08 02:59:45.472044 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:45.472012    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw" event={"ID":"87871047-e75a-4fdc-9e4f-73891b052829","Type":"ContainerStarted","Data":"2960e20d7f92c3cdf5c2f77d43734a3d2703b65b280951de97541a5d70c33088"}
Jul 08 02:59:45.503611 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:45.503554    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rc9gw" podStartSLOduration=2.105976128 podStartE2EDuration="3.503539008s" totalImagesPullingTime="1.39756288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:59:45.501552278 +0000 UTC m=+69.813830813" watchObservedRunningTime="2026-07-08 02:59:45.503539008 +0000 UTC m=+69.815817541"
Jul 08 02:59:46.477998 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:46.477957    2578 generic.go:356] "Generic (PLEG): container finished" podID="d0b7cd4d-577b-4d13-afaf-a0460fee4934" containerID="8bf33d1b0ead2342fe45a74c4a83d1ff0d300fe68c3332f60a40994aa39f06dc" exitCode=0
Jul 08 02:59:46.478464 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:46.478053    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h7qr6" event={"ID":"d0b7cd4d-577b-4d13-afaf-a0460fee4934","Type":"ContainerDied","Data":"8bf33d1b0ead2342fe45a74c4a83d1ff0d300fe68c3332f60a40994aa39f06dc"}
Jul 08 02:59:47.199861 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.199825    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-678745d87-s7qx9"]
Jul 08 02:59:47.203304 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.203285    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.205616 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.205591    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 08 02:59:47.206390 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.206368    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 08 02:59:47.206511 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.206492    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 08 02:59:47.206661 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.206641    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-btphrhn4o1tl8\""
Jul 08 02:59:47.206790 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.206728    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rsjpv\""
Jul 08 02:59:47.206894 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.206873    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 08 02:59:47.214640 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.214615    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-678745d87-s7qx9"]
Jul 08 02:59:47.255948 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.255887    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvxdw\" (UniqueName: \"kubernetes.io/projected/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-kube-api-access-dvxdw\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.256112 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.255972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-secret-metrics-server-client-certs\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.256112 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.256018    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-secret-metrics-server-tls\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.256112 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.256043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-client-ca-bundle\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.256112 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.256085    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-metrics-server-audit-profiles\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.256288 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.256118    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-audit-log\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.256288 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.256198    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.357220 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.357197    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.357297 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.357233    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvxdw\" (UniqueName: \"kubernetes.io/projected/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-kube-api-access-dvxdw\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.357297 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.357256    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-secret-metrics-server-client-certs\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.357297 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.357276    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-secret-metrics-server-tls\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.357451 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.357301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-client-ca-bundle\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.357451 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.357322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-metrics-server-audit-profiles\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.357451 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.357343    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-audit-log\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.357770 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.357707    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-audit-log\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.358205 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.358148    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.358610 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.358582    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-metrics-server-audit-profiles\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.360853 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.360565    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-client-ca-bundle\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.360853 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.360602    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-secret-metrics-server-tls\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.360853 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.360661    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-secret-metrics-server-client-certs\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.367567 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.367543    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvxdw\" (UniqueName: \"kubernetes.io/projected/514b1b93-eea1-42bb-b74a-3a9c76cf21fe-kube-api-access-dvxdw\") pod \"metrics-server-678745d87-s7qx9\" (UID: \"514b1b93-eea1-42bb-b74a-3a9c76cf21fe\") " pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.433786 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.433018    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4l7xp"
Jul 08 02:59:47.464517 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.464487    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7964977668-dn9tw"]
Jul 08 02:59:47.467515 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.467494    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-xlpf7"]
Jul 08 02:59:47.469128 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.469082    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.470979 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.470959    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xlpf7"
Jul 08 02:59:47.473352 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.472860    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 02:59:47.473352 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.472867    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 02:59:47.473352 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.473182    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bh9f8\""
Jul 08 02:59:47.473352 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.472892    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 02:59:47.473352 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.473301    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 08 02:59:47.474900 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.474003    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 02:59:47.474900 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.474129    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 02:59:47.474900 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.474324    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dn6jz\""
Jul 08 02:59:47.474900 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.474676    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 02:59:47.474900 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.474730    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 02:59:47.487246 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.487215    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-25r5t" event={"ID":"45d27e40-2605-4821-b3de-ddb132f8e960","Type":"ContainerStarted","Data":"aeb34d4a318f68d0b9368f0ac32f2f9a69a31a87995d9ab63f01a72cb830bc44"}
Jul 08 02:59:47.487634 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.487275    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 02:59:47.487711 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.487663    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 02:59:47.490993 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.490861    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h7qr6" event={"ID":"d0b7cd4d-577b-4d13-afaf-a0460fee4934","Type":"ContainerStarted","Data":"d0dd2c67f78b21fd12bc8744cc0266b944181af9e1609eed53510db1943041ae"}
Jul 08 02:59:47.490993 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.490924    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-xlpf7"]
Jul 08 02:59:47.493529 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.493125    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g4z7x" event={"ID":"c039d8af-51c0-4e88-b104-9c7ec5d407aa","Type":"ContainerStarted","Data":"6bdbee37c5a1141c4f85a406bcfdeb0d29ce5ebb6587996d617168d60d0a31ed"}
Jul 08 02:59:47.502089 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.501979    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7964977668-dn9tw"]
Jul 08 02:59:47.515918 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.515888    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 02:59:47.546357 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.546308    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g4z7x" podStartSLOduration=66.431154866 podStartE2EDuration="1m11.546289951s" totalImagesPullingTime="5.115135085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 02:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:59:47.545961617 +0000 UTC m=+71.858240153" watchObservedRunningTime="2026-07-08 02:59:47.546289951 +0000 UTC m=+71.858568477"
Jul 08 02:59:47.561217 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.560049    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-console-config\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.561217 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.560107    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-oauth-serving-cert\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.561217 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.560169    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-service-ca\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.561217 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.560193    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-trusted-ca-bundle\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.561217 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.560246    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t288d\" (UniqueName: \"kubernetes.io/projected/d845517e-0eab-46da-a178-6195ea06e8d3-kube-api-access-t288d\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.561217 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.560293    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/47e6d129-dec3-4d58-8758-1e5eaa03596b-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-xlpf7\" (UID: \"47e6d129-dec3-4d58-8758-1e5eaa03596b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xlpf7"
Jul 08 02:59:47.561217 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.560325    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d845517e-0eab-46da-a178-6195ea06e8d3-console-oauth-config\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.561217 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.560373    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d845517e-0eab-46da-a178-6195ea06e8d3-console-serving-cert\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.561217 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.560406    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lg54\" (UniqueName: \"kubernetes.io/projected/47e6d129-dec3-4d58-8758-1e5eaa03596b-kube-api-access-9lg54\") pod \"monitoring-plugin-d5dcff7cf-xlpf7\" (UID: \"47e6d129-dec3-4d58-8758-1e5eaa03596b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xlpf7"
Jul 08 02:59:47.574963 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.574911    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-25r5t" podStartSLOduration=66.494571508 podStartE2EDuration="1m11.574896492s" totalImagesPullingTime="5.080324984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:59:47.574032873 +0000 UTC m=+71.886311409" watchObservedRunningTime="2026-07-08 02:59:47.574896492 +0000 UTC m=+71.887175025"
Jul 08 02:59:47.660453 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.660429    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-678745d87-s7qx9"]
Jul 08 02:59:47.660823 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.660795    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-oauth-serving-cert\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.660862 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.660838    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-service-ca\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.660910 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.660863    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-trusted-ca-bundle\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.661004 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.660913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t288d\" (UniqueName: \"kubernetes.io/projected/d845517e-0eab-46da-a178-6195ea06e8d3-kube-api-access-t288d\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.661004 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.660953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/47e6d129-dec3-4d58-8758-1e5eaa03596b-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-xlpf7\" (UID: \"47e6d129-dec3-4d58-8758-1e5eaa03596b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xlpf7"
Jul 08 02:59:47.661004 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.660986    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d845517e-0eab-46da-a178-6195ea06e8d3-console-oauth-config\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.661149 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.661018    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d845517e-0eab-46da-a178-6195ea06e8d3-console-serving-cert\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.661149 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.661054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lg54\" (UniqueName: \"kubernetes.io/projected/47e6d129-dec3-4d58-8758-1e5eaa03596b-kube-api-access-9lg54\") pod \"monitoring-plugin-d5dcff7cf-xlpf7\" (UID: \"47e6d129-dec3-4d58-8758-1e5eaa03596b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xlpf7"
Jul 08 02:59:47.661149 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.661099    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-console-config\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.661435 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:47.661335    2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 08 02:59:47.661435 ip-10-0-129-199 kubenswrapper[2578]: E0708 02:59:47.661402    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47e6d129-dec3-4d58-8758-1e5eaa03596b-monitoring-plugin-cert podName:47e6d129-dec3-4d58-8758-1e5eaa03596b nodeName:}" failed. No retries permitted until 2026-07-08 02:59:48.161381774 +0000 UTC m=+72.473660303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/47e6d129-dec3-4d58-8758-1e5eaa03596b-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-xlpf7" (UID: "47e6d129-dec3-4d58-8758-1e5eaa03596b") : secret "monitoring-plugin-cert" not found
Jul 08 02:59:47.661599 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.661579    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-service-ca\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.661882 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.661862    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-oauth-serving-cert\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.662061 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.662027    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-trusted-ca-bundle\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.662391 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.662337    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-console-config\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.663205 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:59:47.663182    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod514b1b93_eea1_42bb_b74a_3a9c76cf21fe.slice/crio-af5954f7d653e69584595d6a1e951b6c0874fa31a68bd591dbf3f854113c5c67 WatchSource:0}: Error finding container af5954f7d653e69584595d6a1e951b6c0874fa31a68bd591dbf3f854113c5c67: Status 404 returned error can't find the container with id af5954f7d653e69584595d6a1e951b6c0874fa31a68bd591dbf3f854113c5c67
Jul 08 02:59:47.664421 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.664401    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d845517e-0eab-46da-a178-6195ea06e8d3-console-serving-cert\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.664724 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.664699    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d845517e-0eab-46da-a178-6195ea06e8d3-console-oauth-config\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.669268 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.669245    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lg54\" (UniqueName: \"kubernetes.io/projected/47e6d129-dec3-4d58-8758-1e5eaa03596b-kube-api-access-9lg54\") pod \"monitoring-plugin-d5dcff7cf-xlpf7\" (UID: \"47e6d129-dec3-4d58-8758-1e5eaa03596b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xlpf7"
Jul 08 02:59:47.669387 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.669370    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t288d\" (UniqueName: \"kubernetes.io/projected/d845517e-0eab-46da-a178-6195ea06e8d3-kube-api-access-t288d\") pod \"console-7964977668-dn9tw\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") " pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.784100 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.784024    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:47.908349 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:47.908319    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7964977668-dn9tw"]
Jul 08 02:59:47.911278 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:59:47.911253    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd845517e_0eab_46da_a178_6195ea06e8d3.slice/crio-badafabfc641bef342d5f368425b09b9cd4038b9a778915c49589cdcade51a63 WatchSource:0}: Error finding container badafabfc641bef342d5f368425b09b9cd4038b9a778915c49589cdcade51a63: Status 404 returned error can't find the container with id badafabfc641bef342d5f368425b09b9cd4038b9a778915c49589cdcade51a63
Jul 08 02:59:48.166090 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:48.166058    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/47e6d129-dec3-4d58-8758-1e5eaa03596b-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-xlpf7\" (UID: \"47e6d129-dec3-4d58-8758-1e5eaa03596b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xlpf7"
Jul 08 02:59:48.168478 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:48.168460    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/47e6d129-dec3-4d58-8758-1e5eaa03596b-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-xlpf7\" (UID: \"47e6d129-dec3-4d58-8758-1e5eaa03596b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xlpf7"
Jul 08 02:59:48.393206 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:48.393168    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xlpf7"
Jul 08 02:59:48.510025 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:48.509144    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h7qr6" event={"ID":"d0b7cd4d-577b-4d13-afaf-a0460fee4934","Type":"ContainerStarted","Data":"c950d4556e27cae2d5c4434df879783f17d70ca66b86f6dd4ffa95a9e3b9b8a6"}
Jul 08 02:59:48.511962 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:48.511934    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7964977668-dn9tw" event={"ID":"d845517e-0eab-46da-a178-6195ea06e8d3","Type":"ContainerStarted","Data":"badafabfc641bef342d5f368425b09b9cd4038b9a778915c49589cdcade51a63"}
Jul 08 02:59:48.514614 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:48.514587    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-678745d87-s7qx9" event={"ID":"514b1b93-eea1-42bb-b74a-3a9c76cf21fe","Type":"ContainerStarted","Data":"af5954f7d653e69584595d6a1e951b6c0874fa31a68bd591dbf3f854113c5c67"}
Jul 08 02:59:48.529376 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:48.529322    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h7qr6" podStartSLOduration=4.781267382 podStartE2EDuration="6.529303107s" totalImagesPullingTime="1.664090698s" totalInitContainerRuntime="83.945027ms" isStatefulPod=true podCreationTimestamp="2026-07-08 02:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:59:48.527608734 +0000 UTC m=+72.839887268" watchObservedRunningTime="2026-07-08 02:59:48.529303107 +0000 UTC m=+72.841581645"
Jul 08 02:59:48.563442 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:48.563406    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-xlpf7"]
Jul 08 02:59:48.567654 ip-10-0-129-199 kubenswrapper[2578]: W0708 02:59:48.567625    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e6d129_dec3_4d58_8758_1e5eaa03596b.slice/crio-1fa0796a9392cfe317b994e60b61c138cd501144dd107e3148a0b104e5d3fd1b WatchSource:0}: Error finding container 1fa0796a9392cfe317b994e60b61c138cd501144dd107e3148a0b104e5d3fd1b: Status 404 returned error can't find the container with id 1fa0796a9392cfe317b994e60b61c138cd501144dd107e3148a0b104e5d3fd1b
Jul 08 02:59:49.519597 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:49.519561    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xlpf7" event={"ID":"47e6d129-dec3-4d58-8758-1e5eaa03596b","Type":"ContainerStarted","Data":"1fa0796a9392cfe317b994e60b61c138cd501144dd107e3148a0b104e5d3fd1b"}
Jul 08 02:59:50.527560 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:50.527521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-678745d87-s7qx9" event={"ID":"514b1b93-eea1-42bb-b74a-3a9c76cf21fe","Type":"ContainerStarted","Data":"bdf436b12a81fb8067a6402b2259f395f7637cb8a385b1ce62dc03355e3bc672"}
Jul 08 02:59:50.544705 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:50.544649    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-678745d87-s7qx9" podStartSLOduration=1.402451114 podStartE2EDuration="3.54463121s" totalImagesPullingTime="2.142180096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:59:50.544058905 +0000 UTC m=+74.856337437" watchObservedRunningTime="2026-07-08 02:59:50.54463121 +0000 UTC m=+74.856909823"
Jul 08 02:59:51.532828 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:51.532794    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7964977668-dn9tw" event={"ID":"d845517e-0eab-46da-a178-6195ea06e8d3","Type":"ContainerStarted","Data":"8014ed328eda726e1d1b1df958bce2c273ba149f4938e14a617fde3db3d27a88"}
Jul 08 02:59:51.534309 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:51.534283    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xlpf7" event={"ID":"47e6d129-dec3-4d58-8758-1e5eaa03596b","Type":"ContainerStarted","Data":"2c297cb8a1c3ebb544e9e2423db0092d4e864164f20eb876a6689b3837449b1b"}
Jul 08 02:59:51.550153 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:51.550110    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7964977668-dn9tw" podStartSLOduration=1.102053144 podStartE2EDuration="4.55009738s" totalImagesPullingTime="3.448044236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:59:51.548960291 +0000 UTC m=+75.861238825" watchObservedRunningTime="2026-07-08 02:59:51.55009738 +0000 UTC m=+75.862375915"
Jul 08 02:59:51.565709 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:51.565665    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xlpf7" podStartSLOduration=1.7738708060000001 podStartE2EDuration="4.565651929s" totalImagesPullingTime="2.791781123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 02:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 02:59:51.564732837 +0000 UTC m=+75.877011372" watchObservedRunningTime="2026-07-08 02:59:51.565651929 +0000 UTC m=+75.877930462"
Jul 08 02:59:52.537954 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:52.537912    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xlpf7"
Jul 08 02:59:52.543137 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:52.543117    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-xlpf7"
Jul 08 02:59:54.418039 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:54.418007    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55d5c74b8b-mzrwx"
Jul 08 02:59:57.785005 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:57.784892    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:57.785005 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:57.784948    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:57.789818 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:57.789796    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7964977668-dn9tw"
Jul 08 02:59:58.561784 ip-10-0-129-199 kubenswrapper[2578]: I0708 02:59:58.561734    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7964977668-dn9tw"
Jul 08 03:00:07.517019 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:00:07.516978    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 03:00:07.517407 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:00:07.517074    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 03:00:18.517393 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:00:18.517364    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-25r5t"
Jul 08 03:00:27.522067 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:00:27.522039    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 03:00:27.526020 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:00:27.525942    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-678745d87-s7qx9"
Jul 08 03:01:07.015758 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.015701    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7659658c45-mxxh2"]
Jul 08 03:01:07.019006 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.018990    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.021506 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.021480    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 08 03:01:07.021640 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.021593    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 08 03:01:07.021908 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.021888    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 08 03:01:07.022175 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.022156    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 08 03:01:07.022425 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.022405    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 08 03:01:07.022779 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.022762    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-n8m8m\""
Jul 08 03:01:07.028475 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.028457    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 08 03:01:07.035454 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.035436    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7659658c45-mxxh2"]
Jul 08 03:01:07.141568 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.141534    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/523e877e-d1a4-42c4-be4a-494b064d5822-secret-telemeter-client\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.141568 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.141576    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/523e877e-d1a4-42c4-be4a-494b064d5822-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.141855 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.141606    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/523e877e-d1a4-42c4-be4a-494b064d5822-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.141855 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.141631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5q8c\" (UniqueName: \"kubernetes.io/projected/523e877e-d1a4-42c4-be4a-494b064d5822-kube-api-access-m5q8c\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.141855 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.141652    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/523e877e-d1a4-42c4-be4a-494b064d5822-serving-certs-ca-bundle\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.141855 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.141726    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/523e877e-d1a4-42c4-be4a-494b064d5822-federate-client-tls\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.141855 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.141774    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/523e877e-d1a4-42c4-be4a-494b064d5822-metrics-client-ca\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.141855 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.141818    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/523e877e-d1a4-42c4-be4a-494b064d5822-telemeter-client-tls\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.242710 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.242662    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/523e877e-d1a4-42c4-be4a-494b064d5822-telemeter-client-tls\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.242926 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.242723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/523e877e-d1a4-42c4-be4a-494b064d5822-secret-telemeter-client\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.242926 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.242779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/523e877e-d1a4-42c4-be4a-494b064d5822-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.242926 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.242809    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/523e877e-d1a4-42c4-be4a-494b064d5822-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.242926 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.242831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5q8c\" (UniqueName: \"kubernetes.io/projected/523e877e-d1a4-42c4-be4a-494b064d5822-kube-api-access-m5q8c\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.242926 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.242853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/523e877e-d1a4-42c4-be4a-494b064d5822-serving-certs-ca-bundle\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.242926 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.242920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/523e877e-d1a4-42c4-be4a-494b064d5822-federate-client-tls\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.243205 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.242944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/523e877e-d1a4-42c4-be4a-494b064d5822-metrics-client-ca\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.243842 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.243765    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/523e877e-d1a4-42c4-be4a-494b064d5822-metrics-client-ca\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.243960 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.243897    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/523e877e-d1a4-42c4-be4a-494b064d5822-serving-certs-ca-bundle\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.244069 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.244046    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/523e877e-d1a4-42c4-be4a-494b064d5822-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.245369 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.245342    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/523e877e-d1a4-42c4-be4a-494b064d5822-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.245496 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.245477    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/523e877e-d1a4-42c4-be4a-494b064d5822-federate-client-tls\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.245563 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.245543    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/523e877e-d1a4-42c4-be4a-494b064d5822-telemeter-client-tls\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.245605 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.245591    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/523e877e-d1a4-42c4-be4a-494b064d5822-secret-telemeter-client\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.251959 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.251937    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5q8c\" (UniqueName: \"kubernetes.io/projected/523e877e-d1a4-42c4-be4a-494b064d5822-kube-api-access-m5q8c\") pod \"telemeter-client-7659658c45-mxxh2\" (UID: \"523e877e-d1a4-42c4-be4a-494b064d5822\") " pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.328497 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.328470    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2"
Jul 08 03:01:07.467957 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.467919    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7659658c45-mxxh2"]
Jul 08 03:01:07.471582 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:01:07.471562    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod523e877e_d1a4_42c4_be4a_494b064d5822.slice/crio-9fb80abbfb3c46ee3da861a9c105d705f99cc40ba5338fb8abb77d9fd23177fc WatchSource:0}: Error finding container 9fb80abbfb3c46ee3da861a9c105d705f99cc40ba5338fb8abb77d9fd23177fc: Status 404 returned error can't find the container with id 9fb80abbfb3c46ee3da861a9c105d705f99cc40ba5338fb8abb77d9fd23177fc
Jul 08 03:01:07.791821 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:07.791783    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2" event={"ID":"523e877e-d1a4-42c4-be4a-494b064d5822","Type":"ContainerStarted","Data":"9fb80abbfb3c46ee3da861a9c105d705f99cc40ba5338fb8abb77d9fd23177fc"}
Jul 08 03:01:09.800135 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:09.800100    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2" event={"ID":"523e877e-d1a4-42c4-be4a-494b064d5822","Type":"ContainerStarted","Data":"ecc44a1c21d46e126948f57bb58bae76000cbd91960486b3f8546c4a6108743a"}
Jul 08 03:01:11.809495 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:11.809455    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2" event={"ID":"523e877e-d1a4-42c4-be4a-494b064d5822","Type":"ContainerStarted","Data":"202d1dd9b45417acb7ab44fe6cea61399b25bb2d4f260e5d52a75c04fdb58a89"}
Jul 08 03:01:11.809909 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:11.809518    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2" event={"ID":"523e877e-d1a4-42c4-be4a-494b064d5822","Type":"ContainerStarted","Data":"fcbb6144cd0287c415b954e5df5e0afed4e6c5a3dfcf6f0264c623c9a5e7ef42"}
Jul 08 03:01:11.832828 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:11.832779    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7659658c45-mxxh2" podStartSLOduration=1.831206186 podStartE2EDuration="5.832737166s" totalImagesPullingTime="4.00153098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:01:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:01:11.832316743 +0000 UTC m=+156.144595279" watchObservedRunningTime="2026-07-08 03:01:11.832737166 +0000 UTC m=+156.145015700"
Jul 08 03:01:12.830381 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.830350    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b85486b88-hjlrq"]
Jul 08 03:01:12.833443 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.833423    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.845203 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.845183    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b85486b88-hjlrq"]
Jul 08 03:01:12.887946 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.887919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-oauth-serving-cert\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.888124 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.888004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94ca397e-aff8-416b-aac3-a2fbd47eedf2-console-serving-cert\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.888124 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.888070    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94ca397e-aff8-416b-aac3-a2fbd47eedf2-console-oauth-config\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.888124 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.888092    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b66gl\" (UniqueName: \"kubernetes.io/projected/94ca397e-aff8-416b-aac3-a2fbd47eedf2-kube-api-access-b66gl\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.888124 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.888116    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-trusted-ca-bundle\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.888280 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.888178    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-service-ca\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.888350 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.888332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-console-config\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.989248 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.989217    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-service-ca\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.989382 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.989258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-console-config\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.989382 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.989283    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-oauth-serving-cert\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.989382 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.989314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94ca397e-aff8-416b-aac3-a2fbd47eedf2-console-serving-cert\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.989382 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.989338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94ca397e-aff8-416b-aac3-a2fbd47eedf2-console-oauth-config\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.989382 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.989354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b66gl\" (UniqueName: \"kubernetes.io/projected/94ca397e-aff8-416b-aac3-a2fbd47eedf2-kube-api-access-b66gl\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.989615 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.989381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-trusted-ca-bundle\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.990057 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.990022    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-service-ca\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.990057 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.990022    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-console-config\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.990290 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.990269    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-oauth-serving-cert\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.990328 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.990306    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-trusted-ca-bundle\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.991868 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.991851    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94ca397e-aff8-416b-aac3-a2fbd47eedf2-console-serving-cert\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.991973 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.991955    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94ca397e-aff8-416b-aac3-a2fbd47eedf2-console-oauth-config\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:12.997836 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:12.997810    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b66gl\" (UniqueName: \"kubernetes.io/projected/94ca397e-aff8-416b-aac3-a2fbd47eedf2-kube-api-access-b66gl\") pod \"console-b85486b88-hjlrq\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") " pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:13.142070 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:13.141974    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:13.265921 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:13.265884    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b85486b88-hjlrq"]
Jul 08 03:01:13.268529 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:01:13.268502    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94ca397e_aff8_416b_aac3_a2fbd47eedf2.slice/crio-04c04ea7fd51a6bac75999535e99be1c4d8e9944565b6e8b906c8fc8b66c608c WatchSource:0}: Error finding container 04c04ea7fd51a6bac75999535e99be1c4d8e9944565b6e8b906c8fc8b66c608c: Status 404 returned error can't find the container with id 04c04ea7fd51a6bac75999535e99be1c4d8e9944565b6e8b906c8fc8b66c608c
Jul 08 03:01:13.821663 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:13.821627    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b85486b88-hjlrq" event={"ID":"94ca397e-aff8-416b-aac3-a2fbd47eedf2","Type":"ContainerStarted","Data":"b31355c2b941cb29d96af04fa40f2bc5dba38ba42ffcf9c2e033638f67274dee"}
Jul 08 03:01:13.821862 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:13.821703    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b85486b88-hjlrq" event={"ID":"94ca397e-aff8-416b-aac3-a2fbd47eedf2","Type":"ContainerStarted","Data":"04c04ea7fd51a6bac75999535e99be1c4d8e9944565b6e8b906c8fc8b66c608c"}
Jul 08 03:01:13.839965 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:13.839925    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b85486b88-hjlrq" podStartSLOduration=1.8399097530000001 podStartE2EDuration="1.839909753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:01:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:01:13.839066671 +0000 UTC m=+158.151345206" watchObservedRunningTime="2026-07-08 03:01:13.839909753 +0000 UTC m=+158.152188287"
Jul 08 03:01:23.142492 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:23.142444    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:23.142905 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:23.142521    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:23.147640 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:23.147617    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:23.858415 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:23.858389    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:01:23.904191 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:23.904162    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7964977668-dn9tw"]
Jul 08 03:01:48.925383 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:48.925334    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7964977668-dn9tw" podUID="d845517e-0eab-46da-a178-6195ea06e8d3" containerName="console" containerID="cri-o://8014ed328eda726e1d1b1df958bce2c273ba149f4938e14a617fde3db3d27a88" gracePeriod=15
Jul 08 03:01:49.166647 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.166620    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7964977668-dn9tw"
Jul 08 03:01:49.183181 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.183119    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-console-config\") pod \"d845517e-0eab-46da-a178-6195ea06e8d3\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") "
Jul 08 03:01:49.183181 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.183155    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d845517e-0eab-46da-a178-6195ea06e8d3-console-serving-cert\") pod \"d845517e-0eab-46da-a178-6195ea06e8d3\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") "
Jul 08 03:01:49.183352 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.183192    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-oauth-serving-cert\") pod \"d845517e-0eab-46da-a178-6195ea06e8d3\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") "
Jul 08 03:01:49.183352 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.183307    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-trusted-ca-bundle\") pod \"d845517e-0eab-46da-a178-6195ea06e8d3\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") "
Jul 08 03:01:49.183352 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.183337    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t288d\" (UniqueName: \"kubernetes.io/projected/d845517e-0eab-46da-a178-6195ea06e8d3-kube-api-access-t288d\") pod \"d845517e-0eab-46da-a178-6195ea06e8d3\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") "
Jul 08 03:01:49.183509 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.183360    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d845517e-0eab-46da-a178-6195ea06e8d3-console-oauth-config\") pod \"d845517e-0eab-46da-a178-6195ea06e8d3\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") "
Jul 08 03:01:49.183509 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.183391    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-service-ca\") pod \"d845517e-0eab-46da-a178-6195ea06e8d3\" (UID: \"d845517e-0eab-46da-a178-6195ea06e8d3\") "
Jul 08 03:01:49.183659 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.183604    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-console-config" (OuterVolumeSpecName: "console-config") pod "d845517e-0eab-46da-a178-6195ea06e8d3" (UID: "d845517e-0eab-46da-a178-6195ea06e8d3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:01:49.183659 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.183615    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d845517e-0eab-46da-a178-6195ea06e8d3" (UID: "d845517e-0eab-46da-a178-6195ea06e8d3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:01:49.183871 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.183664    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-console-config\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:01:49.183871 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.183682    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-oauth-serving-cert\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:01:49.183871 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.183690    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d845517e-0eab-46da-a178-6195ea06e8d3" (UID: "d845517e-0eab-46da-a178-6195ea06e8d3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:01:49.184024 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.183966    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-service-ca" (OuterVolumeSpecName: "service-ca") pod "d845517e-0eab-46da-a178-6195ea06e8d3" (UID: "d845517e-0eab-46da-a178-6195ea06e8d3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:01:49.186406 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.186381    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d845517e-0eab-46da-a178-6195ea06e8d3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d845517e-0eab-46da-a178-6195ea06e8d3" (UID: "d845517e-0eab-46da-a178-6195ea06e8d3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:01:49.186872 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.186849    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d845517e-0eab-46da-a178-6195ea06e8d3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d845517e-0eab-46da-a178-6195ea06e8d3" (UID: "d845517e-0eab-46da-a178-6195ea06e8d3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:01:49.187034 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.187008    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d845517e-0eab-46da-a178-6195ea06e8d3-kube-api-access-t288d" (OuterVolumeSpecName: "kube-api-access-t288d") pod "d845517e-0eab-46da-a178-6195ea06e8d3" (UID: "d845517e-0eab-46da-a178-6195ea06e8d3"). InnerVolumeSpecName "kube-api-access-t288d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:01:49.284603 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.284566    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-service-ca\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:01:49.284603 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.284595    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d845517e-0eab-46da-a178-6195ea06e8d3-console-serving-cert\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:01:49.284603 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.284604    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d845517e-0eab-46da-a178-6195ea06e8d3-trusted-ca-bundle\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:01:49.284603 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.284614    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t288d\" (UniqueName: \"kubernetes.io/projected/d845517e-0eab-46da-a178-6195ea06e8d3-kube-api-access-t288d\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:01:49.284895 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.284623    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d845517e-0eab-46da-a178-6195ea06e8d3-console-oauth-config\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:01:49.949247 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.949212    2578 generic.go:356] "Generic (PLEG): container finished" podID="d845517e-0eab-46da-a178-6195ea06e8d3" containerID="8014ed328eda726e1d1b1df958bce2c273ba149f4938e14a617fde3db3d27a88" exitCode=0
Jul 08 03:01:49.949637 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.949267    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7964977668-dn9tw"
Jul 08 03:01:49.949637 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.949275    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7964977668-dn9tw" event={"ID":"d845517e-0eab-46da-a178-6195ea06e8d3","Type":"ContainerDied","Data":"8014ed328eda726e1d1b1df958bce2c273ba149f4938e14a617fde3db3d27a88"}
Jul 08 03:01:49.949637 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.949317    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7964977668-dn9tw" event={"ID":"d845517e-0eab-46da-a178-6195ea06e8d3","Type":"ContainerDied","Data":"badafabfc641bef342d5f368425b09b9cd4038b9a778915c49589cdcade51a63"}
Jul 08 03:01:49.949637 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.949337    2578 scope.go:117] "RemoveContainer" containerID="8014ed328eda726e1d1b1df958bce2c273ba149f4938e14a617fde3db3d27a88"
Jul 08 03:01:49.958184 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.958168    2578 scope.go:117] "RemoveContainer" containerID="8014ed328eda726e1d1b1df958bce2c273ba149f4938e14a617fde3db3d27a88"
Jul 08 03:01:49.958431 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:01:49.958414    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8014ed328eda726e1d1b1df958bce2c273ba149f4938e14a617fde3db3d27a88\": container with ID starting with 8014ed328eda726e1d1b1df958bce2c273ba149f4938e14a617fde3db3d27a88 not found: ID does not exist" containerID="8014ed328eda726e1d1b1df958bce2c273ba149f4938e14a617fde3db3d27a88"
Jul 08 03:01:49.958476 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.958440    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8014ed328eda726e1d1b1df958bce2c273ba149f4938e14a617fde3db3d27a88"} err="failed to get container status \"8014ed328eda726e1d1b1df958bce2c273ba149f4938e14a617fde3db3d27a88\": rpc error: code = NotFound desc = could not find container \"8014ed328eda726e1d1b1df958bce2c273ba149f4938e14a617fde3db3d27a88\": container with ID starting with 8014ed328eda726e1d1b1df958bce2c273ba149f4938e14a617fde3db3d27a88 not found: ID does not exist"
Jul 08 03:01:49.970061 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.970029    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7964977668-dn9tw"]
Jul 08 03:01:49.973612 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:49.973593    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7964977668-dn9tw"]
Jul 08 03:01:50.161630 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:01:50.161598    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d845517e-0eab-46da-a178-6195ea06e8d3" path="/var/lib/kubelet/pods/d845517e-0eab-46da-a178-6195ea06e8d3/volumes"
Jul 08 03:02:27.756519 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.756484    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5844785c9f-8tjsq"]
Jul 08 03:02:27.756983 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.756736    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d845517e-0eab-46da-a178-6195ea06e8d3" containerName="console"
Jul 08 03:02:27.756983 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.756763    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d845517e-0eab-46da-a178-6195ea06e8d3" containerName="console"
Jul 08 03:02:27.756983 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.756815    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d845517e-0eab-46da-a178-6195ea06e8d3" containerName="console"
Jul 08 03:02:27.759528 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.759511    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.773586 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.773558    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5844785c9f-8tjsq"]
Jul 08 03:02:27.862674 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.862640    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-trusted-ca-bundle\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.862878 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.862675    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdn8s\" (UniqueName: \"kubernetes.io/projected/265c49c0-2263-4e05-86b3-215f716a599e-kube-api-access-xdn8s\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.862878 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.862708    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/265c49c0-2263-4e05-86b3-215f716a599e-console-serving-cert\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.862878 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.862798    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/265c49c0-2263-4e05-86b3-215f716a599e-console-oauth-config\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.862878 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.862834    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-service-ca\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.863029 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.862886    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-oauth-serving-cert\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.863029 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.862922    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-console-config\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.964055 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.964001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-trusted-ca-bundle\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.964055 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.964057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdn8s\" (UniqueName: \"kubernetes.io/projected/265c49c0-2263-4e05-86b3-215f716a599e-kube-api-access-xdn8s\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.964277 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.964091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/265c49c0-2263-4e05-86b3-215f716a599e-console-serving-cert\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.964277 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.964117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/265c49c0-2263-4e05-86b3-215f716a599e-console-oauth-config\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.964599 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.964167    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-service-ca\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.964875 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.964848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-oauth-serving-cert\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.965474 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.965397    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-service-ca\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.965599 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.965479    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-trusted-ca-bundle\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.965599 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.965560    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-oauth-serving-cert\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.965599 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.965563    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-console-config\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.966210 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.966184    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-console-config\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.970927 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.970899    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/265c49c0-2263-4e05-86b3-215f716a599e-console-oauth-config\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.971042 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.970973    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/265c49c0-2263-4e05-86b3-215f716a599e-console-serving-cert\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:27.972917 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:27.972899    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdn8s\" (UniqueName: \"kubernetes.io/projected/265c49c0-2263-4e05-86b3-215f716a599e-kube-api-access-xdn8s\") pod \"console-5844785c9f-8tjsq\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") " pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:28.067809 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:28.067773    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:28.199308 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:28.199135    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5844785c9f-8tjsq"]
Jul 08 03:02:28.201821 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:02:28.201795    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod265c49c0_2263_4e05_86b3_215f716a599e.slice/crio-bcc8f0d3497a7b20be530df5766c147b8db5c8c2190dd63141612e6c7e6413a8 WatchSource:0}: Error finding container bcc8f0d3497a7b20be530df5766c147b8db5c8c2190dd63141612e6c7e6413a8: Status 404 returned error can't find the container with id bcc8f0d3497a7b20be530df5766c147b8db5c8c2190dd63141612e6c7e6413a8
Jul 08 03:02:29.089889 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:29.089858    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5844785c9f-8tjsq" event={"ID":"265c49c0-2263-4e05-86b3-215f716a599e","Type":"ContainerStarted","Data":"7658f068c16f71e35f2fa3574a22db6f6f24ace8d5329c5d1dba2118fb5e2d45"}
Jul 08 03:02:29.090275 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:29.089904    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5844785c9f-8tjsq" event={"ID":"265c49c0-2263-4e05-86b3-215f716a599e","Type":"ContainerStarted","Data":"bcc8f0d3497a7b20be530df5766c147b8db5c8c2190dd63141612e6c7e6413a8"}
Jul 08 03:02:29.108921 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:29.108868    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5844785c9f-8tjsq" podStartSLOduration=2.108852448 podStartE2EDuration="2.108852448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:02:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:02:29.108369226 +0000 UTC m=+233.420647760" watchObservedRunningTime="2026-07-08 03:02:29.108852448 +0000 UTC m=+233.421130982"
Jul 08 03:02:38.068732 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:38.068694    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:38.069141 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:38.068809    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:38.073435 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:38.073414    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:38.123700 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:38.123677    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:02:38.170877 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:02:38.170848    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b85486b88-hjlrq"]
Jul 08 03:03:03.195479 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.195369    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b85486b88-hjlrq" podUID="94ca397e-aff8-416b-aac3-a2fbd47eedf2" containerName="console" containerID="cri-o://b31355c2b941cb29d96af04fa40f2bc5dba38ba42ffcf9c2e033638f67274dee" gracePeriod=15
Jul 08 03:03:03.436813 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.436786    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:03:03.446131 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.446084    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-trusted-ca-bundle\") pod \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") "
Jul 08 03:03:03.446131 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.446119    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94ca397e-aff8-416b-aac3-a2fbd47eedf2-console-serving-cert\") pod \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") "
Jul 08 03:03:03.446273 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.446134    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-service-ca\") pod \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") "
Jul 08 03:03:03.446273 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.446154    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b66gl\" (UniqueName: \"kubernetes.io/projected/94ca397e-aff8-416b-aac3-a2fbd47eedf2-kube-api-access-b66gl\") pod \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") "
Jul 08 03:03:03.446273 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.446192    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94ca397e-aff8-416b-aac3-a2fbd47eedf2-console-oauth-config\") pod \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") "
Jul 08 03:03:03.446273 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.446237    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-console-config\") pod \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") "
Jul 08 03:03:03.446273 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.446262    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-oauth-serving-cert\") pod \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\" (UID: \"94ca397e-aff8-416b-aac3-a2fbd47eedf2\") "
Jul 08 03:03:03.446533 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.446492    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "94ca397e-aff8-416b-aac3-a2fbd47eedf2" (UID: "94ca397e-aff8-416b-aac3-a2fbd47eedf2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:03:03.446638 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.446609    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-service-ca" (OuterVolumeSpecName: "service-ca") pod "94ca397e-aff8-416b-aac3-a2fbd47eedf2" (UID: "94ca397e-aff8-416b-aac3-a2fbd47eedf2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:03:03.446737 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.446717    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "94ca397e-aff8-416b-aac3-a2fbd47eedf2" (UID: "94ca397e-aff8-416b-aac3-a2fbd47eedf2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:03:03.446807 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.446714    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-console-config" (OuterVolumeSpecName: "console-config") pod "94ca397e-aff8-416b-aac3-a2fbd47eedf2" (UID: "94ca397e-aff8-416b-aac3-a2fbd47eedf2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:03:03.448458 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.448439    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94ca397e-aff8-416b-aac3-a2fbd47eedf2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "94ca397e-aff8-416b-aac3-a2fbd47eedf2" (UID: "94ca397e-aff8-416b-aac3-a2fbd47eedf2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:03:03.448822 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.448804    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94ca397e-aff8-416b-aac3-a2fbd47eedf2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "94ca397e-aff8-416b-aac3-a2fbd47eedf2" (UID: "94ca397e-aff8-416b-aac3-a2fbd47eedf2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:03:03.448889 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.448822    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94ca397e-aff8-416b-aac3-a2fbd47eedf2-kube-api-access-b66gl" (OuterVolumeSpecName: "kube-api-access-b66gl") pod "94ca397e-aff8-416b-aac3-a2fbd47eedf2" (UID: "94ca397e-aff8-416b-aac3-a2fbd47eedf2"). InnerVolumeSpecName "kube-api-access-b66gl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:03:03.547123 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.547085    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-console-config\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:03:03.547123 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.547120    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-oauth-serving-cert\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:03:03.547123 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.547133    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-trusted-ca-bundle\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:03:03.547381 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.547146    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94ca397e-aff8-416b-aac3-a2fbd47eedf2-console-serving-cert\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:03:03.547381 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.547157    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94ca397e-aff8-416b-aac3-a2fbd47eedf2-service-ca\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:03:03.547381 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.547169    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b66gl\" (UniqueName: \"kubernetes.io/projected/94ca397e-aff8-416b-aac3-a2fbd47eedf2-kube-api-access-b66gl\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:03:03.547381 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:03.547181    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94ca397e-aff8-416b-aac3-a2fbd47eedf2-console-oauth-config\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:03:04.202320 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:04.202282    2578 generic.go:356] "Generic (PLEG): container finished" podID="94ca397e-aff8-416b-aac3-a2fbd47eedf2" containerID="b31355c2b941cb29d96af04fa40f2bc5dba38ba42ffcf9c2e033638f67274dee" exitCode=0
Jul 08 03:03:04.202320 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:04.202325    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b85486b88-hjlrq"
Jul 08 03:03:04.202845 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:04.202322    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b85486b88-hjlrq" event={"ID":"94ca397e-aff8-416b-aac3-a2fbd47eedf2","Type":"ContainerDied","Data":"b31355c2b941cb29d96af04fa40f2bc5dba38ba42ffcf9c2e033638f67274dee"}
Jul 08 03:03:04.202845 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:04.202387    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b85486b88-hjlrq" event={"ID":"94ca397e-aff8-416b-aac3-a2fbd47eedf2","Type":"ContainerDied","Data":"04c04ea7fd51a6bac75999535e99be1c4d8e9944565b6e8b906c8fc8b66c608c"}
Jul 08 03:03:04.202845 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:04.202416    2578 scope.go:117] "RemoveContainer" containerID="b31355c2b941cb29d96af04fa40f2bc5dba38ba42ffcf9c2e033638f67274dee"
Jul 08 03:03:04.210310 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:04.210292    2578 scope.go:117] "RemoveContainer" containerID="b31355c2b941cb29d96af04fa40f2bc5dba38ba42ffcf9c2e033638f67274dee"
Jul 08 03:03:04.210572 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:03:04.210554    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b31355c2b941cb29d96af04fa40f2bc5dba38ba42ffcf9c2e033638f67274dee\": container with ID starting with b31355c2b941cb29d96af04fa40f2bc5dba38ba42ffcf9c2e033638f67274dee not found: ID does not exist" containerID="b31355c2b941cb29d96af04fa40f2bc5dba38ba42ffcf9c2e033638f67274dee"
Jul 08 03:03:04.210616 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:04.210580    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b31355c2b941cb29d96af04fa40f2bc5dba38ba42ffcf9c2e033638f67274dee"} err="failed to get container status \"b31355c2b941cb29d96af04fa40f2bc5dba38ba42ffcf9c2e033638f67274dee\": rpc error: code = NotFound desc = could not find container \"b31355c2b941cb29d96af04fa40f2bc5dba38ba42ffcf9c2e033638f67274dee\": container with ID starting with b31355c2b941cb29d96af04fa40f2bc5dba38ba42ffcf9c2e033638f67274dee not found: ID does not exist"
Jul 08 03:03:04.218526 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:04.218502    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b85486b88-hjlrq"]
Jul 08 03:03:04.220587 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:04.220564    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b85486b88-hjlrq"]
Jul 08 03:03:06.161729 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:06.161685    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94ca397e-aff8-416b-aac3-a2fbd47eedf2" path="/var/lib/kubelet/pods/94ca397e-aff8-416b-aac3-a2fbd47eedf2/volumes"
Jul 08 03:03:36.016642 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:03:36.016612    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 03:04:31.222194 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.222117    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57"]
Jul 08 03:04:31.224569 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.222391    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94ca397e-aff8-416b-aac3-a2fbd47eedf2" containerName="console"
Jul 08 03:04:31.224569 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.222402    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ca397e-aff8-416b-aac3-a2fbd47eedf2" containerName="console"
Jul 08 03:04:31.224569 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.222465    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="94ca397e-aff8-416b-aac3-a2fbd47eedf2" containerName="console"
Jul 08 03:04:31.225445 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.225431    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57"
Jul 08 03:04:31.229446 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.229426    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 03:04:31.229784 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.229769    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 03:04:31.229867 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.229769    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5sc7h\""
Jul 08 03:04:31.237306 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.237287    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57"]
Jul 08 03:04:31.277816 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.277787    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfjwh\" (UniqueName: \"kubernetes.io/projected/0f5e245d-ea8f-4b80-bab2-4687f322265a-kube-api-access-mfjwh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57\" (UID: \"0f5e245d-ea8f-4b80-bab2-4687f322265a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57"
Jul 08 03:04:31.277933 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.277837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f5e245d-ea8f-4b80-bab2-4687f322265a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57\" (UID: \"0f5e245d-ea8f-4b80-bab2-4687f322265a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57"
Jul 08 03:04:31.277933 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.277873    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f5e245d-ea8f-4b80-bab2-4687f322265a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57\" (UID: \"0f5e245d-ea8f-4b80-bab2-4687f322265a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57"
Jul 08 03:04:31.378834 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.378805    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfjwh\" (UniqueName: \"kubernetes.io/projected/0f5e245d-ea8f-4b80-bab2-4687f322265a-kube-api-access-mfjwh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57\" (UID: \"0f5e245d-ea8f-4b80-bab2-4687f322265a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57"
Jul 08 03:04:31.378982 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.378846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f5e245d-ea8f-4b80-bab2-4687f322265a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57\" (UID: \"0f5e245d-ea8f-4b80-bab2-4687f322265a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57"
Jul 08 03:04:31.378982 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.378871    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f5e245d-ea8f-4b80-bab2-4687f322265a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57\" (UID: \"0f5e245d-ea8f-4b80-bab2-4687f322265a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57"
Jul 08 03:04:31.379266 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.379245    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f5e245d-ea8f-4b80-bab2-4687f322265a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57\" (UID: \"0f5e245d-ea8f-4b80-bab2-4687f322265a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57"
Jul 08 03:04:31.379316 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.379265    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f5e245d-ea8f-4b80-bab2-4687f322265a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57\" (UID: \"0f5e245d-ea8f-4b80-bab2-4687f322265a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57"
Jul 08 03:04:31.388029 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.388008    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfjwh\" (UniqueName: \"kubernetes.io/projected/0f5e245d-ea8f-4b80-bab2-4687f322265a-kube-api-access-mfjwh\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57\" (UID: \"0f5e245d-ea8f-4b80-bab2-4687f322265a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57"
Jul 08 03:04:31.534101 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.534016    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57"
Jul 08 03:04:31.658208 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.658178    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57"]
Jul 08 03:04:31.661068 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:04:31.661042    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f5e245d_ea8f_4b80_bab2_4687f322265a.slice/crio-1d9e4e366b428e25a4f70f7d386f3d089832c8d4c98c59c746cfc58520e861cf WatchSource:0}: Error finding container 1d9e4e366b428e25a4f70f7d386f3d089832c8d4c98c59c746cfc58520e861cf: Status 404 returned error can't find the container with id 1d9e4e366b428e25a4f70f7d386f3d089832c8d4c98c59c746cfc58520e861cf
Jul 08 03:04:31.662867 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:31.662852    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 03:04:32.495597 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:32.495560    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57" event={"ID":"0f5e245d-ea8f-4b80-bab2-4687f322265a","Type":"ContainerStarted","Data":"1d9e4e366b428e25a4f70f7d386f3d089832c8d4c98c59c746cfc58520e861cf"}
Jul 08 03:04:38.519616 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:38.519589    2578 generic.go:356] "Generic (PLEG): container finished" podID="0f5e245d-ea8f-4b80-bab2-4687f322265a" containerID="a0f99340d2e7c85d5729a318581d2294e0482ed99362a0d701f6566cf2ea5940" exitCode=0
Jul 08 03:04:38.519968 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:38.519643    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57" event={"ID":"0f5e245d-ea8f-4b80-bab2-4687f322265a","Type":"ContainerDied","Data":"a0f99340d2e7c85d5729a318581d2294e0482ed99362a0d701f6566cf2ea5940"}
Jul 08 03:04:41.531842 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:41.531808    2578 generic.go:356] "Generic (PLEG): container finished" podID="0f5e245d-ea8f-4b80-bab2-4687f322265a" containerID="9be017660c00a7bc17611319fa1223cbbe7c1357a83ca93d7208cec4a68de8e5" exitCode=0
Jul 08 03:04:41.532226 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:41.531891    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57" event={"ID":"0f5e245d-ea8f-4b80-bab2-4687f322265a","Type":"ContainerDied","Data":"9be017660c00a7bc17611319fa1223cbbe7c1357a83ca93d7208cec4a68de8e5"}
Jul 08 03:04:49.564042 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:49.564010    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57" event={"ID":"0f5e245d-ea8f-4b80-bab2-4687f322265a","Type":"ContainerStarted","Data":"05fae3ed84cc8e1d7ecb022c38837a4a3e3b52a4203cc009887d73c4c8da8517"}
Jul 08 03:04:49.581859 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:49.581818    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57" podStartSLOduration=1.901353114 podStartE2EDuration="18.581801699s" totalImagesPullingTime="16.680448585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:04:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:04:49.580579228 +0000 UTC m=+373.892857773" watchObservedRunningTime="2026-07-08 03:04:49.581801699 +0000 UTC m=+373.894080233"
Jul 08 03:04:50.569603 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:50.569569    2578 generic.go:356] "Generic (PLEG): container finished" podID="0f5e245d-ea8f-4b80-bab2-4687f322265a" containerID="05fae3ed84cc8e1d7ecb022c38837a4a3e3b52a4203cc009887d73c4c8da8517" exitCode=0
Jul 08 03:04:50.569997 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:50.569651    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57" event={"ID":"0f5e245d-ea8f-4b80-bab2-4687f322265a","Type":"ContainerDied","Data":"05fae3ed84cc8e1d7ecb022c38837a4a3e3b52a4203cc009887d73c4c8da8517"}
Jul 08 03:04:51.699472 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:51.699449    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57"
Jul 08 03:04:51.849770 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:51.849671    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfjwh\" (UniqueName: \"kubernetes.io/projected/0f5e245d-ea8f-4b80-bab2-4687f322265a-kube-api-access-mfjwh\") pod \"0f5e245d-ea8f-4b80-bab2-4687f322265a\" (UID: \"0f5e245d-ea8f-4b80-bab2-4687f322265a\") "
Jul 08 03:04:51.849770 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:51.849768    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f5e245d-ea8f-4b80-bab2-4687f322265a-bundle\") pod \"0f5e245d-ea8f-4b80-bab2-4687f322265a\" (UID: \"0f5e245d-ea8f-4b80-bab2-4687f322265a\") "
Jul 08 03:04:51.849946 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:51.849811    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f5e245d-ea8f-4b80-bab2-4687f322265a-util\") pod \"0f5e245d-ea8f-4b80-bab2-4687f322265a\" (UID: \"0f5e245d-ea8f-4b80-bab2-4687f322265a\") "
Jul 08 03:04:51.850466 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:51.850435    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f5e245d-ea8f-4b80-bab2-4687f322265a-bundle" (OuterVolumeSpecName: "bundle") pod "0f5e245d-ea8f-4b80-bab2-4687f322265a" (UID: "0f5e245d-ea8f-4b80-bab2-4687f322265a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:04:51.851980 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:51.851950    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f5e245d-ea8f-4b80-bab2-4687f322265a-kube-api-access-mfjwh" (OuterVolumeSpecName: "kube-api-access-mfjwh") pod "0f5e245d-ea8f-4b80-bab2-4687f322265a" (UID: "0f5e245d-ea8f-4b80-bab2-4687f322265a"). InnerVolumeSpecName "kube-api-access-mfjwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:04:51.854849 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:51.854825    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f5e245d-ea8f-4b80-bab2-4687f322265a-util" (OuterVolumeSpecName: "util") pod "0f5e245d-ea8f-4b80-bab2-4687f322265a" (UID: "0f5e245d-ea8f-4b80-bab2-4687f322265a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:04:51.951056 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:51.951023    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f5e245d-ea8f-4b80-bab2-4687f322265a-util\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:04:51.951056 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:51.951050    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfjwh\" (UniqueName: \"kubernetes.io/projected/0f5e245d-ea8f-4b80-bab2-4687f322265a-kube-api-access-mfjwh\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:04:51.951056 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:51.951061    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f5e245d-ea8f-4b80-bab2-4687f322265a-bundle\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:04:52.579364 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:52.579328    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57" event={"ID":"0f5e245d-ea8f-4b80-bab2-4687f322265a","Type":"ContainerDied","Data":"1d9e4e366b428e25a4f70f7d386f3d089832c8d4c98c59c746cfc58520e861cf"}
Jul 08 03:04:52.579527 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:52.579375    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d9e4e366b428e25a4f70f7d386f3d089832c8d4c98c59c746cfc58520e861cf"
Jul 08 03:04:52.579527 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:52.579337    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t9f57"
Jul 08 03:04:59.363094 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.363061    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z44dm"]
Jul 08 03:04:59.363467 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.363296    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f5e245d-ea8f-4b80-bab2-4687f322265a" containerName="util"
Jul 08 03:04:59.363467 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.363306    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f5e245d-ea8f-4b80-bab2-4687f322265a" containerName="util"
Jul 08 03:04:59.363467 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.363318    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f5e245d-ea8f-4b80-bab2-4687f322265a" containerName="pull"
Jul 08 03:04:59.363467 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.363323    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f5e245d-ea8f-4b80-bab2-4687f322265a" containerName="pull"
Jul 08 03:04:59.363467 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.363330    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f5e245d-ea8f-4b80-bab2-4687f322265a" containerName="extract"
Jul 08 03:04:59.363467 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.363335    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f5e245d-ea8f-4b80-bab2-4687f322265a" containerName="extract"
Jul 08 03:04:59.363467 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.363385    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f5e245d-ea8f-4b80-bab2-4687f322265a" containerName="extract"
Jul 08 03:04:59.366231 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.366216    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z44dm"
Jul 08 03:04:59.368521 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.368500    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 08 03:04:59.368669 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.368651    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 08 03:04:59.368769 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.368682    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-llr29\""
Jul 08 03:04:59.378379 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.378359    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z44dm"]
Jul 08 03:04:59.504679 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.504625    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czcwl\" (UniqueName: \"kubernetes.io/projected/93ce3bf3-8b8b-4135-8710-94a03852ce10-kube-api-access-czcwl\") pod \"cert-manager-operator-controller-manager-55c444bf86-z44dm\" (UID: \"93ce3bf3-8b8b-4135-8710-94a03852ce10\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z44dm"
Jul 08 03:04:59.504888 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.504715    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93ce3bf3-8b8b-4135-8710-94a03852ce10-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-z44dm\" (UID: \"93ce3bf3-8b8b-4135-8710-94a03852ce10\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z44dm"
Jul 08 03:04:59.605614 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.605586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93ce3bf3-8b8b-4135-8710-94a03852ce10-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-z44dm\" (UID: \"93ce3bf3-8b8b-4135-8710-94a03852ce10\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z44dm"
Jul 08 03:04:59.605817 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.605643    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czcwl\" (UniqueName: \"kubernetes.io/projected/93ce3bf3-8b8b-4135-8710-94a03852ce10-kube-api-access-czcwl\") pod \"cert-manager-operator-controller-manager-55c444bf86-z44dm\" (UID: \"93ce3bf3-8b8b-4135-8710-94a03852ce10\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z44dm"
Jul 08 03:04:59.606019 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.605996    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93ce3bf3-8b8b-4135-8710-94a03852ce10-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-z44dm\" (UID: \"93ce3bf3-8b8b-4135-8710-94a03852ce10\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z44dm"
Jul 08 03:04:59.614176 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.614113    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czcwl\" (UniqueName: \"kubernetes.io/projected/93ce3bf3-8b8b-4135-8710-94a03852ce10-kube-api-access-czcwl\") pod \"cert-manager-operator-controller-manager-55c444bf86-z44dm\" (UID: \"93ce3bf3-8b8b-4135-8710-94a03852ce10\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z44dm"
Jul 08 03:04:59.674943 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.674917    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z44dm"
Jul 08 03:04:59.802331 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:04:59.802307    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z44dm"]
Jul 08 03:04:59.805137 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:04:59.805113    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93ce3bf3_8b8b_4135_8710_94a03852ce10.slice/crio-530089d7342c1364cc0ebb44a64d1f02a6f33d3556e628493d68ce1f73fb8563 WatchSource:0}: Error finding container 530089d7342c1364cc0ebb44a64d1f02a6f33d3556e628493d68ce1f73fb8563: Status 404 returned error can't find the container with id 530089d7342c1364cc0ebb44a64d1f02a6f33d3556e628493d68ce1f73fb8563
Jul 08 03:05:00.607722 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:00.607690    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z44dm" event={"ID":"93ce3bf3-8b8b-4135-8710-94a03852ce10","Type":"ContainerStarted","Data":"530089d7342c1364cc0ebb44a64d1f02a6f33d3556e628493d68ce1f73fb8563"}
Jul 08 03:05:02.616960 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:02.616926    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z44dm" event={"ID":"93ce3bf3-8b8b-4135-8710-94a03852ce10","Type":"ContainerStarted","Data":"2ab0ee508d64e33e2d57299b09995dab61b59b94369644f6a556fe2735eed556"}
Jul 08 03:05:02.640228 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:02.640184    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z44dm" podStartSLOduration=1.6037336469999999 podStartE2EDuration="3.640167186s" totalImagesPullingTime="2.036433539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:05:02.637884961 +0000 UTC m=+386.950163508" watchObservedRunningTime="2026-07-08 03:05:02.640167186 +0000 UTC m=+386.952445719"
Jul 08 03:05:02.777945 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:02.777907    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gznm2"]
Jul 08 03:05:02.781103 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:02.781081    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gznm2"
Jul 08 03:05:02.783291 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:02.783270    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vpf9p\""
Jul 08 03:05:02.783409 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:02.783274    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 08 03:05:02.783557 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:02.783541    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 08 03:05:02.793169 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:02.793146    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gznm2"]
Jul 08 03:05:02.931110 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:02.931025    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47f67440-1411-4717-a53b-c7ac90daf169-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gznm2\" (UID: \"47f67440-1411-4717-a53b-c7ac90daf169\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gznm2"
Jul 08 03:05:02.931110 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:02.931072    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nc7w\" (UniqueName: \"kubernetes.io/projected/47f67440-1411-4717-a53b-c7ac90daf169-kube-api-access-2nc7w\") pod \"cert-manager-webhook-6486ffd997-gznm2\" (UID: \"47f67440-1411-4717-a53b-c7ac90daf169\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gznm2"
Jul 08 03:05:03.031851 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:03.031807    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47f67440-1411-4717-a53b-c7ac90daf169-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gznm2\" (UID: \"47f67440-1411-4717-a53b-c7ac90daf169\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gznm2"
Jul 08 03:05:03.032006 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:03.031861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nc7w\" (UniqueName: \"kubernetes.io/projected/47f67440-1411-4717-a53b-c7ac90daf169-kube-api-access-2nc7w\") pod \"cert-manager-webhook-6486ffd997-gznm2\" (UID: \"47f67440-1411-4717-a53b-c7ac90daf169\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gznm2"
Jul 08 03:05:03.054251 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:03.054221    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47f67440-1411-4717-a53b-c7ac90daf169-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gznm2\" (UID: \"47f67440-1411-4717-a53b-c7ac90daf169\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gznm2"
Jul 08 03:05:03.054400 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:03.054275    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nc7w\" (UniqueName: \"kubernetes.io/projected/47f67440-1411-4717-a53b-c7ac90daf169-kube-api-access-2nc7w\") pod \"cert-manager-webhook-6486ffd997-gznm2\" (UID: \"47f67440-1411-4717-a53b-c7ac90daf169\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gznm2"
Jul 08 03:05:03.106881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:03.106844    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gznm2"
Jul 08 03:05:03.259550 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:03.259520    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gznm2"]
Jul 08 03:05:03.262605 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:05:03.262574    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47f67440_1411_4717_a53b_c7ac90daf169.slice/crio-15c468269bf2932e8dfcc7cdf45fad81a2a60c5c8b3682860810a518e69bf5f6 WatchSource:0}: Error finding container 15c468269bf2932e8dfcc7cdf45fad81a2a60c5c8b3682860810a518e69bf5f6: Status 404 returned error can't find the container with id 15c468269bf2932e8dfcc7cdf45fad81a2a60c5c8b3682860810a518e69bf5f6
Jul 08 03:05:03.621340 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:03.621302    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gznm2" event={"ID":"47f67440-1411-4717-a53b-c7ac90daf169","Type":"ContainerStarted","Data":"15c468269bf2932e8dfcc7cdf45fad81a2a60c5c8b3682860810a518e69bf5f6"}
Jul 08 03:05:03.866981 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:03.866939    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj"]
Jul 08 03:05:03.871319 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:03.871294    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj"
Jul 08 03:05:03.873642 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:03.873588    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 03:05:03.873642 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:03.873591    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5sc7h\""
Jul 08 03:05:03.874059 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:03.874034    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 03:05:03.877971 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:03.877948    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj"]
Jul 08 03:05:03.942533 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:03.942496    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/572cb36c-6438-40ef-9092-94da39448fde-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj\" (UID: \"572cb36c-6438-40ef-9092-94da39448fde\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj"
Jul 08 03:05:03.942716 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:03.942543    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/572cb36c-6438-40ef-9092-94da39448fde-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj\" (UID: \"572cb36c-6438-40ef-9092-94da39448fde\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj"
Jul 08 03:05:03.942716 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:03.942631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z856\" (UniqueName: \"kubernetes.io/projected/572cb36c-6438-40ef-9092-94da39448fde-kube-api-access-6z856\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj\" (UID: \"572cb36c-6438-40ef-9092-94da39448fde\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj"
Jul 08 03:05:04.044049 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:04.043995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/572cb36c-6438-40ef-9092-94da39448fde-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj\" (UID: \"572cb36c-6438-40ef-9092-94da39448fde\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj"
Jul 08 03:05:04.044049 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:04.044059    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/572cb36c-6438-40ef-9092-94da39448fde-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj\" (UID: \"572cb36c-6438-40ef-9092-94da39448fde\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj"
Jul 08 03:05:04.044298 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:04.044111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z856\" (UniqueName: \"kubernetes.io/projected/572cb36c-6438-40ef-9092-94da39448fde-kube-api-access-6z856\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj\" (UID: \"572cb36c-6438-40ef-9092-94da39448fde\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj"
Jul 08 03:05:04.044452 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:04.044430    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/572cb36c-6438-40ef-9092-94da39448fde-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj\" (UID: \"572cb36c-6438-40ef-9092-94da39448fde\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj"
Jul 08 03:05:04.044506 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:04.044474    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/572cb36c-6438-40ef-9092-94da39448fde-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj\" (UID: \"572cb36c-6438-40ef-9092-94da39448fde\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj"
Jul 08 03:05:04.053235 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:04.053212    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z856\" (UniqueName: \"kubernetes.io/projected/572cb36c-6438-40ef-9092-94da39448fde-kube-api-access-6z856\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj\" (UID: \"572cb36c-6438-40ef-9092-94da39448fde\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj"
Jul 08 03:05:04.181697 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:04.181621    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj"
Jul 08 03:05:04.313352 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:04.313316    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj"]
Jul 08 03:05:04.316665 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:05:04.316636    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572cb36c_6438_40ef_9092_94da39448fde.slice/crio-4c5792be97526a621634413e9d7383aef5bb95a0d60f7d4ff3db17d9f9e66cd8 WatchSource:0}: Error finding container 4c5792be97526a621634413e9d7383aef5bb95a0d60f7d4ff3db17d9f9e66cd8: Status 404 returned error can't find the container with id 4c5792be97526a621634413e9d7383aef5bb95a0d60f7d4ff3db17d9f9e66cd8
Jul 08 03:05:04.627175 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:04.627139    2578 generic.go:356] "Generic (PLEG): container finished" podID="572cb36c-6438-40ef-9092-94da39448fde" containerID="4b6030aec6d24011d3fce82a5fc19ce77d0e98c13911e97bafacf0469fa2ba16" exitCode=0
Jul 08 03:05:04.627625 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:04.627229    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj" event={"ID":"572cb36c-6438-40ef-9092-94da39448fde","Type":"ContainerDied","Data":"4b6030aec6d24011d3fce82a5fc19ce77d0e98c13911e97bafacf0469fa2ba16"}
Jul 08 03:05:04.627625 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:04.627278    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj" event={"ID":"572cb36c-6438-40ef-9092-94da39448fde","Type":"ContainerStarted","Data":"4c5792be97526a621634413e9d7383aef5bb95a0d60f7d4ff3db17d9f9e66cd8"}
Jul 08 03:05:08.645719 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:08.645684    2578 generic.go:356] "Generic (PLEG): container finished" podID="572cb36c-6438-40ef-9092-94da39448fde" containerID="59b54ac7964705078dc73eec6f687d904d7fa180be36e3f02de585971c6a58f1" exitCode=0
Jul 08 03:05:08.646175 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:08.645773    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj" event={"ID":"572cb36c-6438-40ef-9092-94da39448fde","Type":"ContainerDied","Data":"59b54ac7964705078dc73eec6f687d904d7fa180be36e3f02de585971c6a58f1"}
Jul 08 03:05:08.647373 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:08.647350    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gznm2" event={"ID":"47f67440-1411-4717-a53b-c7ac90daf169","Type":"ContainerStarted","Data":"a490ae967e0aa9714efb3b10b01511673d9606204cd5a49a8acb046713e8f12b"}
Jul 08 03:05:08.647493 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:08.647475    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gznm2"
Jul 08 03:05:08.676019 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:08.675979    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-gznm2" podStartSLOduration=1.863789411 podStartE2EDuration="6.675965839s" totalImagesPullingTime="4.812176428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:05:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:05:08.675373419 +0000 UTC m=+392.987651954" watchObservedRunningTime="2026-07-08 03:05:08.675965839 +0000 UTC m=+392.988244373"
Jul 08 03:05:09.576409 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:09.576376    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2mhgg"]
Jul 08 03:05:09.579085 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:09.579069    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2mhgg"
Jul 08 03:05:09.581360 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:09.581337    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-q22tw\""
Jul 08 03:05:09.586931 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:09.586909    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2mhgg"]
Jul 08 03:05:09.653462 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:09.653432    2578 generic.go:356] "Generic (PLEG): container finished" podID="572cb36c-6438-40ef-9092-94da39448fde" containerID="1c6640e921c5cf8ffd250dd08d5845c56d2584740188a2128eb1be5b2ca5bbd3" exitCode=0
Jul 08 03:05:09.653826 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:09.653521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj" event={"ID":"572cb36c-6438-40ef-9092-94da39448fde","Type":"ContainerDied","Data":"1c6640e921c5cf8ffd250dd08d5845c56d2584740188a2128eb1be5b2ca5bbd3"}
Jul 08 03:05:09.692233 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:09.692202    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz9pd\" (UniqueName: \"kubernetes.io/projected/7fc884f8-f9f0-42c9-a285-761cc7621267-kube-api-access-kz9pd\") pod \"cert-manager-cainjector-559cdd8c87-2mhgg\" (UID: \"7fc884f8-f9f0-42c9-a285-761cc7621267\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2mhgg"
Jul 08 03:05:09.692363 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:09.692255    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fc884f8-f9f0-42c9-a285-761cc7621267-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2mhgg\" (UID: \"7fc884f8-f9f0-42c9-a285-761cc7621267\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2mhgg"
Jul 08 03:05:09.793222 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:09.793179    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz9pd\" (UniqueName: \"kubernetes.io/projected/7fc884f8-f9f0-42c9-a285-761cc7621267-kube-api-access-kz9pd\") pod \"cert-manager-cainjector-559cdd8c87-2mhgg\" (UID: \"7fc884f8-f9f0-42c9-a285-761cc7621267\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2mhgg"
Jul 08 03:05:09.793384 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:09.793249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fc884f8-f9f0-42c9-a285-761cc7621267-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2mhgg\" (UID: \"7fc884f8-f9f0-42c9-a285-761cc7621267\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2mhgg"
Jul 08 03:05:09.801540 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:09.801516    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz9pd\" (UniqueName: \"kubernetes.io/projected/7fc884f8-f9f0-42c9-a285-761cc7621267-kube-api-access-kz9pd\") pod \"cert-manager-cainjector-559cdd8c87-2mhgg\" (UID: \"7fc884f8-f9f0-42c9-a285-761cc7621267\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2mhgg"
Jul 08 03:05:09.801664 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:09.801555    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fc884f8-f9f0-42c9-a285-761cc7621267-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2mhgg\" (UID: \"7fc884f8-f9f0-42c9-a285-761cc7621267\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2mhgg"
Jul 08 03:05:09.889133 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:09.889021    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2mhgg"
Jul 08 03:05:10.016653 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:10.016621    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2mhgg"]
Jul 08 03:05:10.019220 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:05:10.019192    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7fc884f8_f9f0_42c9_a285_761cc7621267.slice/crio-e9aa73b1e5561a79e8caf91cc4f264d454aecf15f5e185c83a32cb948a782195 WatchSource:0}: Error finding container e9aa73b1e5561a79e8caf91cc4f264d454aecf15f5e185c83a32cb948a782195: Status 404 returned error can't find the container with id e9aa73b1e5561a79e8caf91cc4f264d454aecf15f5e185c83a32cb948a782195
Jul 08 03:05:10.658991 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:10.658960    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2mhgg" event={"ID":"7fc884f8-f9f0-42c9-a285-761cc7621267","Type":"ContainerStarted","Data":"97ebc91e6b5df0162e0f456f549f84ba88c2fc3ebde1c26a30b5e224a8ed8b7a"}
Jul 08 03:05:10.659379 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:10.659006    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2mhgg" event={"ID":"7fc884f8-f9f0-42c9-a285-761cc7621267","Type":"ContainerStarted","Data":"e9aa73b1e5561a79e8caf91cc4f264d454aecf15f5e185c83a32cb948a782195"}
Jul 08 03:05:10.676840 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:10.676793    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2mhgg" podStartSLOduration=1.6767777719999999 podStartE2EDuration="1.676777772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:05:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:05:10.676540579 +0000 UTC m=+394.988819113" watchObservedRunningTime="2026-07-08 03:05:10.676777772 +0000 UTC m=+394.989056297"
Jul 08 03:05:10.776040 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:10.776014    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj"
Jul 08 03:05:10.901491 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:10.901460    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/572cb36c-6438-40ef-9092-94da39448fde-util\") pod \"572cb36c-6438-40ef-9092-94da39448fde\" (UID: \"572cb36c-6438-40ef-9092-94da39448fde\") "
Jul 08 03:05:10.901648 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:10.901532    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/572cb36c-6438-40ef-9092-94da39448fde-bundle\") pod \"572cb36c-6438-40ef-9092-94da39448fde\" (UID: \"572cb36c-6438-40ef-9092-94da39448fde\") "
Jul 08 03:05:10.901648 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:10.901560    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z856\" (UniqueName: \"kubernetes.io/projected/572cb36c-6438-40ef-9092-94da39448fde-kube-api-access-6z856\") pod \"572cb36c-6438-40ef-9092-94da39448fde\" (UID: \"572cb36c-6438-40ef-9092-94da39448fde\") "
Jul 08 03:05:10.901948 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:10.901926    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/572cb36c-6438-40ef-9092-94da39448fde-bundle" (OuterVolumeSpecName: "bundle") pod "572cb36c-6438-40ef-9092-94da39448fde" (UID: "572cb36c-6438-40ef-9092-94da39448fde"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:05:10.903797 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:10.903774    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/572cb36c-6438-40ef-9092-94da39448fde-kube-api-access-6z856" (OuterVolumeSpecName: "kube-api-access-6z856") pod "572cb36c-6438-40ef-9092-94da39448fde" (UID: "572cb36c-6438-40ef-9092-94da39448fde"). InnerVolumeSpecName "kube-api-access-6z856". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:05:10.905801 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:10.905769    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/572cb36c-6438-40ef-9092-94da39448fde-util" (OuterVolumeSpecName: "util") pod "572cb36c-6438-40ef-9092-94da39448fde" (UID: "572cb36c-6438-40ef-9092-94da39448fde"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:05:11.002090 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:11.002016    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/572cb36c-6438-40ef-9092-94da39448fde-bundle\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:05:11.002090 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:11.002043    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z856\" (UniqueName: \"kubernetes.io/projected/572cb36c-6438-40ef-9092-94da39448fde-kube-api-access-6z856\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:05:11.002090 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:11.002051    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/572cb36c-6438-40ef-9092-94da39448fde-util\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:05:11.664945 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:11.664919    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj"
Jul 08 03:05:11.665315 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:11.664949    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9j9kj" event={"ID":"572cb36c-6438-40ef-9092-94da39448fde","Type":"ContainerDied","Data":"4c5792be97526a621634413e9d7383aef5bb95a0d60f7d4ff3db17d9f9e66cd8"}
Jul 08 03:05:11.665315 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:11.664996    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c5792be97526a621634413e9d7383aef5bb95a0d60f7d4ff3db17d9f9e66cd8"
Jul 08 03:05:14.655685 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:14.655653    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gznm2"
Jul 08 03:05:15.444101 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.444068    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dn4wl"]
Jul 08 03:05:15.444366 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.444355    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="572cb36c-6438-40ef-9092-94da39448fde" containerName="util"
Jul 08 03:05:15.444404 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.444368    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="572cb36c-6438-40ef-9092-94da39448fde" containerName="util"
Jul 08 03:05:15.444404 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.444376    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="572cb36c-6438-40ef-9092-94da39448fde" containerName="pull"
Jul 08 03:05:15.444404 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.444381    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="572cb36c-6438-40ef-9092-94da39448fde" containerName="pull"
Jul 08 03:05:15.444404 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.444387    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="572cb36c-6438-40ef-9092-94da39448fde" containerName="extract"
Jul 08 03:05:15.444404 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.444391    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="572cb36c-6438-40ef-9092-94da39448fde" containerName="extract"
Jul 08 03:05:15.444541 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.444436    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="572cb36c-6438-40ef-9092-94da39448fde" containerName="extract"
Jul 08 03:05:15.448058 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.448043    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dn4wl"
Jul 08 03:05:15.450221 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.450201    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-sphsp\""
Jul 08 03:05:15.458035 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.458017    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dn4wl"]
Jul 08 03:05:15.540508 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.540474    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lqwz\" (UniqueName: \"kubernetes.io/projected/bd6c3927-ae9c-44e7-89ea-2e84496293d2-kube-api-access-8lqwz\") pod \"cert-manager-55b4d954d5-dn4wl\" (UID: \"bd6c3927-ae9c-44e7-89ea-2e84496293d2\") " pod="cert-manager/cert-manager-55b4d954d5-dn4wl"
Jul 08 03:05:15.540508 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.540511    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd6c3927-ae9c-44e7-89ea-2e84496293d2-bound-sa-token\") pod \"cert-manager-55b4d954d5-dn4wl\" (UID: \"bd6c3927-ae9c-44e7-89ea-2e84496293d2\") " pod="cert-manager/cert-manager-55b4d954d5-dn4wl"
Jul 08 03:05:15.641461 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.641420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lqwz\" (UniqueName: \"kubernetes.io/projected/bd6c3927-ae9c-44e7-89ea-2e84496293d2-kube-api-access-8lqwz\") pod \"cert-manager-55b4d954d5-dn4wl\" (UID: \"bd6c3927-ae9c-44e7-89ea-2e84496293d2\") " pod="cert-manager/cert-manager-55b4d954d5-dn4wl"
Jul 08 03:05:15.641461 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.641464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd6c3927-ae9c-44e7-89ea-2e84496293d2-bound-sa-token\") pod \"cert-manager-55b4d954d5-dn4wl\" (UID: \"bd6c3927-ae9c-44e7-89ea-2e84496293d2\") " pod="cert-manager/cert-manager-55b4d954d5-dn4wl"
Jul 08 03:05:15.649467 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.649433    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bd6c3927-ae9c-44e7-89ea-2e84496293d2-bound-sa-token\") pod \"cert-manager-55b4d954d5-dn4wl\" (UID: \"bd6c3927-ae9c-44e7-89ea-2e84496293d2\") " pod="cert-manager/cert-manager-55b4d954d5-dn4wl"
Jul 08 03:05:15.649573 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.649443    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lqwz\" (UniqueName: \"kubernetes.io/projected/bd6c3927-ae9c-44e7-89ea-2e84496293d2-kube-api-access-8lqwz\") pod \"cert-manager-55b4d954d5-dn4wl\" (UID: \"bd6c3927-ae9c-44e7-89ea-2e84496293d2\") " pod="cert-manager/cert-manager-55b4d954d5-dn4wl"
Jul 08 03:05:15.757037 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.756969    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dn4wl"
Jul 08 03:05:15.881851 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:15.881819    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dn4wl"]
Jul 08 03:05:15.884718 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:05:15.884696    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd6c3927_ae9c_44e7_89ea_2e84496293d2.slice/crio-301d72fccfe9056d24ca9d0a76fbe96354d3869899b446392a1db379405bdfc0 WatchSource:0}: Error finding container 301d72fccfe9056d24ca9d0a76fbe96354d3869899b446392a1db379405bdfc0: Status 404 returned error can't find the container with id 301d72fccfe9056d24ca9d0a76fbe96354d3869899b446392a1db379405bdfc0
Jul 08 03:05:16.685892 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:16.685856    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dn4wl" event={"ID":"bd6c3927-ae9c-44e7-89ea-2e84496293d2","Type":"ContainerStarted","Data":"17fea149ab506aa04e3c4212cbc42c6779e0bcc5d1fc6ec08d79ee0707ea95ed"}
Jul 08 03:05:16.685892 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:16.685895    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dn4wl" event={"ID":"bd6c3927-ae9c-44e7-89ea-2e84496293d2","Type":"ContainerStarted","Data":"301d72fccfe9056d24ca9d0a76fbe96354d3869899b446392a1db379405bdfc0"}
Jul 08 03:05:16.704250 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:16.704205    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-dn4wl" podStartSLOduration=1.7041901 podStartE2EDuration="1.7041901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:05:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:05:16.702390147 +0000 UTC m=+401.014668659" watchObservedRunningTime="2026-07-08 03:05:16.7041901 +0000 UTC m=+401.016468634"
Jul 08 03:05:23.944805 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:23.944769    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9"]
Jul 08 03:05:23.950040 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:23.950015    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9"
Jul 08 03:05:23.952195 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:23.952165    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 03:05:23.952691 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:23.952674    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 03:05:23.952757 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:23.952696    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5sc7h\""
Jul 08 03:05:23.955601 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:23.955582    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9"]
Jul 08 03:05:24.110198 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:24.110167    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bdd775a-8df5-4cbc-be48-133af9d56577-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9\" (UID: \"9bdd775a-8df5-4cbc-be48-133af9d56577\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9"
Jul 08 03:05:24.110383 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:24.110229    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kzwc\" (UniqueName: \"kubernetes.io/projected/9bdd775a-8df5-4cbc-be48-133af9d56577-kube-api-access-6kzwc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9\" (UID: \"9bdd775a-8df5-4cbc-be48-133af9d56577\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9"
Jul 08 03:05:24.110383 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:24.110275    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bdd775a-8df5-4cbc-be48-133af9d56577-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9\" (UID: \"9bdd775a-8df5-4cbc-be48-133af9d56577\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9"
Jul 08 03:05:24.210870 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:24.210792    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bdd775a-8df5-4cbc-be48-133af9d56577-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9\" (UID: \"9bdd775a-8df5-4cbc-be48-133af9d56577\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9"
Jul 08 03:05:24.210870 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:24.210841    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kzwc\" (UniqueName: \"kubernetes.io/projected/9bdd775a-8df5-4cbc-be48-133af9d56577-kube-api-access-6kzwc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9\" (UID: \"9bdd775a-8df5-4cbc-be48-133af9d56577\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9"
Jul 08 03:05:24.210870 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:24.210861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bdd775a-8df5-4cbc-be48-133af9d56577-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9\" (UID: \"9bdd775a-8df5-4cbc-be48-133af9d56577\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9"
Jul 08 03:05:24.211249 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:24.211227    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bdd775a-8df5-4cbc-be48-133af9d56577-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9\" (UID: \"9bdd775a-8df5-4cbc-be48-133af9d56577\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9"
Jul 08 03:05:24.211289 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:24.211248    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bdd775a-8df5-4cbc-be48-133af9d56577-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9\" (UID: \"9bdd775a-8df5-4cbc-be48-133af9d56577\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9"
Jul 08 03:05:24.220632 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:24.220602    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kzwc\" (UniqueName: \"kubernetes.io/projected/9bdd775a-8df5-4cbc-be48-133af9d56577-kube-api-access-6kzwc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9\" (UID: \"9bdd775a-8df5-4cbc-be48-133af9d56577\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9"
Jul 08 03:05:24.261264 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:24.261230    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9"
Jul 08 03:05:24.390770 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:24.390720    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9"]
Jul 08 03:05:24.394040 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:05:24.394009    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bdd775a_8df5_4cbc_be48_133af9d56577.slice/crio-74b228a0836cca2917aa091aa8409b1818bec9fd2aca8713209a4b723011df2f WatchSource:0}: Error finding container 74b228a0836cca2917aa091aa8409b1818bec9fd2aca8713209a4b723011df2f: Status 404 returned error can't find the container with id 74b228a0836cca2917aa091aa8409b1818bec9fd2aca8713209a4b723011df2f
Jul 08 03:05:24.722273 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:24.722243    2578 generic.go:356] "Generic (PLEG): container finished" podID="9bdd775a-8df5-4cbc-be48-133af9d56577" containerID="cc730a6c7e719df1dfacab829a9ced05506d1cd470e4149622099923da73410b" exitCode=0
Jul 08 03:05:24.722431 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:24.722308    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9" event={"ID":"9bdd775a-8df5-4cbc-be48-133af9d56577","Type":"ContainerDied","Data":"cc730a6c7e719df1dfacab829a9ced05506d1cd470e4149622099923da73410b"}
Jul 08 03:05:24.722431 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:24.722380    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9" event={"ID":"9bdd775a-8df5-4cbc-be48-133af9d56577","Type":"ContainerStarted","Data":"74b228a0836cca2917aa091aa8409b1818bec9fd2aca8713209a4b723011df2f"}
Jul 08 03:05:25.728830 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:25.728798    2578 generic.go:356] "Generic (PLEG): container finished" podID="9bdd775a-8df5-4cbc-be48-133af9d56577" containerID="d1a39da4bc4f5dd76a98a922d9dc6390553a8993398c4129e70fc35052ead2d5" exitCode=0
Jul 08 03:05:25.729315 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:25.728845    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9" event={"ID":"9bdd775a-8df5-4cbc-be48-133af9d56577","Type":"ContainerDied","Data":"d1a39da4bc4f5dd76a98a922d9dc6390553a8993398c4129e70fc35052ead2d5"}
Jul 08 03:05:26.735383 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:26.735346    2578 generic.go:356] "Generic (PLEG): container finished" podID="9bdd775a-8df5-4cbc-be48-133af9d56577" containerID="8c2548a769bd7d4bf2ab63c3a74debc1b8373af8f25612149f4fc44c65d3361b" exitCode=0
Jul 08 03:05:26.735797 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:26.735392    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9" event={"ID":"9bdd775a-8df5-4cbc-be48-133af9d56577","Type":"ContainerDied","Data":"8c2548a769bd7d4bf2ab63c3a74debc1b8373af8f25612149f4fc44c65d3361b"}
Jul 08 03:05:27.872326 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:27.872299    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9"
Jul 08 03:05:27.935468 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:27.935435    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kzwc\" (UniqueName: \"kubernetes.io/projected/9bdd775a-8df5-4cbc-be48-133af9d56577-kube-api-access-6kzwc\") pod \"9bdd775a-8df5-4cbc-be48-133af9d56577\" (UID: \"9bdd775a-8df5-4cbc-be48-133af9d56577\") "
Jul 08 03:05:27.935626 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:27.935505    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bdd775a-8df5-4cbc-be48-133af9d56577-bundle\") pod \"9bdd775a-8df5-4cbc-be48-133af9d56577\" (UID: \"9bdd775a-8df5-4cbc-be48-133af9d56577\") "
Jul 08 03:05:27.935626 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:27.935534    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bdd775a-8df5-4cbc-be48-133af9d56577-util\") pod \"9bdd775a-8df5-4cbc-be48-133af9d56577\" (UID: \"9bdd775a-8df5-4cbc-be48-133af9d56577\") "
Jul 08 03:05:27.936221 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:27.936139    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bdd775a-8df5-4cbc-be48-133af9d56577-bundle" (OuterVolumeSpecName: "bundle") pod "9bdd775a-8df5-4cbc-be48-133af9d56577" (UID: "9bdd775a-8df5-4cbc-be48-133af9d56577"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:05:27.937619 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:27.937596    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bdd775a-8df5-4cbc-be48-133af9d56577-kube-api-access-6kzwc" (OuterVolumeSpecName: "kube-api-access-6kzwc") pod "9bdd775a-8df5-4cbc-be48-133af9d56577" (UID: "9bdd775a-8df5-4cbc-be48-133af9d56577"). InnerVolumeSpecName "kube-api-access-6kzwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:05:27.943619 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:27.943598    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bdd775a-8df5-4cbc-be48-133af9d56577-util" (OuterVolumeSpecName: "util") pod "9bdd775a-8df5-4cbc-be48-133af9d56577" (UID: "9bdd775a-8df5-4cbc-be48-133af9d56577"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:05:28.036350 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:28.036269    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bdd775a-8df5-4cbc-be48-133af9d56577-bundle\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:05:28.036350 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:28.036299    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bdd775a-8df5-4cbc-be48-133af9d56577-util\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:05:28.036350 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:28.036307    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kzwc\" (UniqueName: \"kubernetes.io/projected/9bdd775a-8df5-4cbc-be48-133af9d56577-kube-api-access-6kzwc\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:05:28.745115 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:28.745083    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9"
Jul 08 03:05:28.745115 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:28.745094    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkh5x9" event={"ID":"9bdd775a-8df5-4cbc-be48-133af9d56577","Type":"ContainerDied","Data":"74b228a0836cca2917aa091aa8409b1818bec9fd2aca8713209a4b723011df2f"}
Jul 08 03:05:28.745325 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:28.745135    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74b228a0836cca2917aa091aa8409b1818bec9fd2aca8713209a4b723011df2f"
Jul 08 03:05:38.799948 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.799914    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"]
Jul 08 03:05:38.800428 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.800298    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bdd775a-8df5-4cbc-be48-133af9d56577" containerName="extract"
Jul 08 03:05:38.800428 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.800314    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bdd775a-8df5-4cbc-be48-133af9d56577" containerName="extract"
Jul 08 03:05:38.800428 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.800331    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bdd775a-8df5-4cbc-be48-133af9d56577" containerName="pull"
Jul 08 03:05:38.800428 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.800338    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bdd775a-8df5-4cbc-be48-133af9d56577" containerName="pull"
Jul 08 03:05:38.800428 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.800359    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bdd775a-8df5-4cbc-be48-133af9d56577" containerName="util"
Jul 08 03:05:38.800428 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.800366    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bdd775a-8df5-4cbc-be48-133af9d56577" containerName="util"
Jul 08 03:05:38.800428 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.800426    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bdd775a-8df5-4cbc-be48-133af9d56577" containerName="extract"
Jul 08 03:05:38.804598 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.804578    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:38.806904 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.806881    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 03:05:38.807020 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.806933    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-47wqr\""
Jul 08 03:05:38.807020 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.806942    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 03:05:38.807020 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.806954    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 03:05:38.807687 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.807673    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 03:05:38.820325 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.820302    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3723836-e219-403a-8e47-8eef454876c2-webhook-cert\") pod \"opendatahub-operator-controller-manager-64b8ffddd6-2gj42\" (UID: \"b3723836-e219-403a-8e47-8eef454876c2\") " pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:38.820457 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.820413    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3723836-e219-403a-8e47-8eef454876c2-tmp\") pod \"opendatahub-operator-controller-manager-64b8ffddd6-2gj42\" (UID: \"b3723836-e219-403a-8e47-8eef454876c2\") " pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:38.820849 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.820815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b3723836-e219-403a-8e47-8eef454876c2-manifests\") pod \"opendatahub-operator-controller-manager-64b8ffddd6-2gj42\" (UID: \"b3723836-e219-403a-8e47-8eef454876c2\") " pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:38.820960 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.820851    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b3723836-e219-403a-8e47-8eef454876c2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64b8ffddd6-2gj42\" (UID: \"b3723836-e219-403a-8e47-8eef454876c2\") " pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:38.820960 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.820878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbvx6\" (UniqueName: \"kubernetes.io/projected/b3723836-e219-403a-8e47-8eef454876c2-kube-api-access-xbvx6\") pod \"opendatahub-operator-controller-manager-64b8ffddd6-2gj42\" (UID: \"b3723836-e219-403a-8e47-8eef454876c2\") " pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:38.822461 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.822441    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"]
Jul 08 03:05:38.921683 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.921647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3723836-e219-403a-8e47-8eef454876c2-webhook-cert\") pod \"opendatahub-operator-controller-manager-64b8ffddd6-2gj42\" (UID: \"b3723836-e219-403a-8e47-8eef454876c2\") " pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:38.921909 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.921696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3723836-e219-403a-8e47-8eef454876c2-tmp\") pod \"opendatahub-operator-controller-manager-64b8ffddd6-2gj42\" (UID: \"b3723836-e219-403a-8e47-8eef454876c2\") " pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:38.921909 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.921793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b3723836-e219-403a-8e47-8eef454876c2-manifests\") pod \"opendatahub-operator-controller-manager-64b8ffddd6-2gj42\" (UID: \"b3723836-e219-403a-8e47-8eef454876c2\") " pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:38.921909 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.921817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b3723836-e219-403a-8e47-8eef454876c2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64b8ffddd6-2gj42\" (UID: \"b3723836-e219-403a-8e47-8eef454876c2\") " pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:38.921909 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.921840    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbvx6\" (UniqueName: \"kubernetes.io/projected/b3723836-e219-403a-8e47-8eef454876c2-kube-api-access-xbvx6\") pod \"opendatahub-operator-controller-manager-64b8ffddd6-2gj42\" (UID: \"b3723836-e219-403a-8e47-8eef454876c2\") " pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:38.922234 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.922207    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b3723836-e219-403a-8e47-8eef454876c2-manifests\") pod \"opendatahub-operator-controller-manager-64b8ffddd6-2gj42\" (UID: \"b3723836-e219-403a-8e47-8eef454876c2\") " pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:38.924231 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.924208    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3723836-e219-403a-8e47-8eef454876c2-tmp\") pod \"opendatahub-operator-controller-manager-64b8ffddd6-2gj42\" (UID: \"b3723836-e219-403a-8e47-8eef454876c2\") " pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:38.924344 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.924328    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b3723836-e219-403a-8e47-8eef454876c2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64b8ffddd6-2gj42\" (UID: \"b3723836-e219-403a-8e47-8eef454876c2\") " pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:38.924520 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.924499    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3723836-e219-403a-8e47-8eef454876c2-webhook-cert\") pod \"opendatahub-operator-controller-manager-64b8ffddd6-2gj42\" (UID: \"b3723836-e219-403a-8e47-8eef454876c2\") " pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:38.935344 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:38.935312    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbvx6\" (UniqueName: \"kubernetes.io/projected/b3723836-e219-403a-8e47-8eef454876c2-kube-api-access-xbvx6\") pod \"opendatahub-operator-controller-manager-64b8ffddd6-2gj42\" (UID: \"b3723836-e219-403a-8e47-8eef454876c2\") " pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:39.114986 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:39.114898    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:39.268988 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:39.268962    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"]
Jul 08 03:05:39.271561 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:05:39.271539    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3723836_e219_403a_8e47_8eef454876c2.slice/crio-8385815e042e1cbbb6d07ea0e5255e45c19904ab58abbf87ffd36bb116ea5c76 WatchSource:0}: Error finding container 8385815e042e1cbbb6d07ea0e5255e45c19904ab58abbf87ffd36bb116ea5c76: Status 404 returned error can't find the container with id 8385815e042e1cbbb6d07ea0e5255e45c19904ab58abbf87ffd36bb116ea5c76
Jul 08 03:05:39.792907 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:39.792868    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42" event={"ID":"b3723836-e219-403a-8e47-8eef454876c2","Type":"ContainerStarted","Data":"8385815e042e1cbbb6d07ea0e5255e45c19904ab58abbf87ffd36bb116ea5c76"}
Jul 08 03:05:42.811725 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:42.811686    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42" event={"ID":"b3723836-e219-403a-8e47-8eef454876c2","Type":"ContainerStarted","Data":"a7dc8126bde2f88948b7fd05ffffbbf565dc702e203b048ee0de4e0d82ca59ef"}
Jul 08 03:05:43.817084 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:43.817052    2578 generic.go:356] "Generic (PLEG): container finished" podID="b3723836-e219-403a-8e47-8eef454876c2" containerID="a7dc8126bde2f88948b7fd05ffffbbf565dc702e203b048ee0de4e0d82ca59ef" exitCode=0
Jul 08 03:05:43.817473 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:43.817108    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42" event={"ID":"b3723836-e219-403a-8e47-8eef454876c2","Type":"ContainerDied","Data":"a7dc8126bde2f88948b7fd05ffffbbf565dc702e203b048ee0de4e0d82ca59ef"}
Jul 08 03:05:44.823117 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:44.823082    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42" event={"ID":"b3723836-e219-403a-8e47-8eef454876c2","Type":"ContainerStarted","Data":"5cf902b332f9e496c2bc03e44dd285026a85e07ac493ad21ed9e5d39d0bfa617"}
Jul 08 03:05:44.823581 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:44.823219    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:44.844173 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:44.844127    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42" podStartSLOduration=2.399593974 podStartE2EDuration="6.844110559s" totalImagesPullingTime="3.43869802s" totalInitContainerRuntime="1.005818565s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:05:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:05:44.842731972 +0000 UTC m=+429.155010533" watchObservedRunningTime="2026-07-08 03:05:44.844110559 +0000 UTC m=+429.156389092"
Jul 08 03:05:55.830364 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:55.830327    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64b8ffddd6-2gj42"
Jul 08 03:05:56.824514 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:56.824423    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"]
Jul 08 03:05:56.839666 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:56.839630    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"
Jul 08 03:05:56.845059 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:56.845031    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-d46gp\""
Jul 08 03:05:56.845249 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:56.845087    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 08 03:05:56.845249 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:56.845030    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 08 03:05:56.845249 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:56.845194    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 08 03:05:56.845417 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:56.845399    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 08 03:05:56.846342 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:56.845895    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 08 03:05:56.852012 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:56.851990    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"]
Jul 08 03:05:56.974410 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:56.974374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e82f9af7-dcc1-406e-a4f0-aceb36995ab7-manager-config\") pod \"lws-controller-manager-65cfbc7dbc-sb72k\" (UID: \"e82f9af7-dcc1-406e-a4f0-aceb36995ab7\") " pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"
Jul 08 03:05:56.974600 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:56.974432    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tv9p\" (UniqueName: \"kubernetes.io/projected/e82f9af7-dcc1-406e-a4f0-aceb36995ab7-kube-api-access-9tv9p\") pod \"lws-controller-manager-65cfbc7dbc-sb72k\" (UID: \"e82f9af7-dcc1-406e-a4f0-aceb36995ab7\") " pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"
Jul 08 03:05:56.974600 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:56.974508    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e82f9af7-dcc1-406e-a4f0-aceb36995ab7-metrics-cert\") pod \"lws-controller-manager-65cfbc7dbc-sb72k\" (UID: \"e82f9af7-dcc1-406e-a4f0-aceb36995ab7\") " pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"
Jul 08 03:05:56.974600 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:56.974582    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e82f9af7-dcc1-406e-a4f0-aceb36995ab7-cert\") pod \"lws-controller-manager-65cfbc7dbc-sb72k\" (UID: \"e82f9af7-dcc1-406e-a4f0-aceb36995ab7\") " pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"
Jul 08 03:05:57.075834 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:57.075729    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tv9p\" (UniqueName: \"kubernetes.io/projected/e82f9af7-dcc1-406e-a4f0-aceb36995ab7-kube-api-access-9tv9p\") pod \"lws-controller-manager-65cfbc7dbc-sb72k\" (UID: \"e82f9af7-dcc1-406e-a4f0-aceb36995ab7\") " pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"
Jul 08 03:05:57.075834 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:57.075781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e82f9af7-dcc1-406e-a4f0-aceb36995ab7-metrics-cert\") pod \"lws-controller-manager-65cfbc7dbc-sb72k\" (UID: \"e82f9af7-dcc1-406e-a4f0-aceb36995ab7\") " pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"
Jul 08 03:05:57.075834 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:57.075823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e82f9af7-dcc1-406e-a4f0-aceb36995ab7-cert\") pod \"lws-controller-manager-65cfbc7dbc-sb72k\" (UID: \"e82f9af7-dcc1-406e-a4f0-aceb36995ab7\") " pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"
Jul 08 03:05:57.076121 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:57.075855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e82f9af7-dcc1-406e-a4f0-aceb36995ab7-manager-config\") pod \"lws-controller-manager-65cfbc7dbc-sb72k\" (UID: \"e82f9af7-dcc1-406e-a4f0-aceb36995ab7\") " pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"
Jul 08 03:05:57.076571 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:57.076545    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e82f9af7-dcc1-406e-a4f0-aceb36995ab7-manager-config\") pod \"lws-controller-manager-65cfbc7dbc-sb72k\" (UID: \"e82f9af7-dcc1-406e-a4f0-aceb36995ab7\") " pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"
Jul 08 03:05:57.078327 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:57.078308    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e82f9af7-dcc1-406e-a4f0-aceb36995ab7-cert\") pod \"lws-controller-manager-65cfbc7dbc-sb72k\" (UID: \"e82f9af7-dcc1-406e-a4f0-aceb36995ab7\") " pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"
Jul 08 03:05:57.078398 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:57.078322    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e82f9af7-dcc1-406e-a4f0-aceb36995ab7-metrics-cert\") pod \"lws-controller-manager-65cfbc7dbc-sb72k\" (UID: \"e82f9af7-dcc1-406e-a4f0-aceb36995ab7\") " pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"
Jul 08 03:05:57.088071 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:57.088050    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tv9p\" (UniqueName: \"kubernetes.io/projected/e82f9af7-dcc1-406e-a4f0-aceb36995ab7-kube-api-access-9tv9p\") pod \"lws-controller-manager-65cfbc7dbc-sb72k\" (UID: \"e82f9af7-dcc1-406e-a4f0-aceb36995ab7\") " pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"
Jul 08 03:05:57.149203 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:57.149176    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"
Jul 08 03:05:57.286911 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:57.286890    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"]
Jul 08 03:05:57.288885 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:05:57.288860    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode82f9af7_dcc1_406e_a4f0_aceb36995ab7.slice/crio-92e6f6e57d2f435e010463465af4788580b27df293cdecb13c7080e5e5f68033 WatchSource:0}: Error finding container 92e6f6e57d2f435e010463465af4788580b27df293cdecb13c7080e5e5f68033: Status 404 returned error can't find the container with id 92e6f6e57d2f435e010463465af4788580b27df293cdecb13c7080e5e5f68033
Jul 08 03:05:57.881902 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:05:57.881868    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k" event={"ID":"e82f9af7-dcc1-406e-a4f0-aceb36995ab7","Type":"ContainerStarted","Data":"92e6f6e57d2f435e010463465af4788580b27df293cdecb13c7080e5e5f68033"}
Jul 08 03:06:01.899345 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:01.899311    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k" event={"ID":"e82f9af7-dcc1-406e-a4f0-aceb36995ab7","Type":"ContainerStarted","Data":"abaf4178502b069bbd7dc04d556515aea3a2bdfa50203cfa16f6df9fd61ec0cb"}
Jul 08 03:06:01.899732 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:01.899388    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"
Jul 08 03:06:01.919966 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:01.919919    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k" podStartSLOduration=2.294852393 podStartE2EDuration="5.919904992s" totalImagesPullingTime="3.625052599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:05:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:06:01.918761217 +0000 UTC m=+446.231039742" watchObservedRunningTime="2026-07-08 03:06:01.919904992 +0000 UTC m=+446.232183525"
Jul 08 03:06:07.884043 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:07.884011    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"]
Jul 08 03:06:07.887353 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:07.887337    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:07.889456 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:07.889432    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 03:06:07.889577 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:07.889469    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 03:06:07.889577 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:07.889470    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 03:06:07.889696 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:07.889629    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 03:06:07.889911 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:07.889898    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 03:06:07.889976 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:07.889935    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 03:06:07.890101 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:07.890085    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tst6f\""
Jul 08 03:06:07.898492 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:07.898473    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"]
Jul 08 03:06:07.970078 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:07.970045    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b7a4454d-3688-4766-925f-882cf38819a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:07.970078 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:07.970081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7a4454d-3688-4766-925f-882cf38819a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:07.970304 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:07.970111    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7a4454d-3688-4766-925f-882cf38819a7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:07.970304 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:07.970168    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2lg4\" (UniqueName: \"kubernetes.io/projected/b7a4454d-3688-4766-925f-882cf38819a7-kube-api-access-b2lg4\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:07.970304 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:07.970193    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b7a4454d-3688-4766-925f-882cf38819a7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:07.970304 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:07.970263    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b7a4454d-3688-4766-925f-882cf38819a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:07.970451 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:07.970316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7a4454d-3688-4766-925f-882cf38819a7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:08.071552 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:08.071513    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7a4454d-3688-4766-925f-882cf38819a7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:08.071738 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:08.071564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b7a4454d-3688-4766-925f-882cf38819a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:08.071738 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:08.071597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7a4454d-3688-4766-925f-882cf38819a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:08.071738 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:08.071638    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7a4454d-3688-4766-925f-882cf38819a7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:08.071738 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:08.071682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2lg4\" (UniqueName: \"kubernetes.io/projected/b7a4454d-3688-4766-925f-882cf38819a7-kube-api-access-b2lg4\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:08.071738 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:08.071716    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b7a4454d-3688-4766-925f-882cf38819a7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:08.072030 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:08.071762    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b7a4454d-3688-4766-925f-882cf38819a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:08.072437 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:08.072414    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b7a4454d-3688-4766-925f-882cf38819a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:08.074077 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:08.074054    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7a4454d-3688-4766-925f-882cf38819a7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:08.074627 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:08.074601    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7a4454d-3688-4766-925f-882cf38819a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:08.074857 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:08.074836    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b7a4454d-3688-4766-925f-882cf38819a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:08.075154 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:08.075136    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b7a4454d-3688-4766-925f-882cf38819a7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:08.085489 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:08.085462    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7a4454d-3688-4766-925f-882cf38819a7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:08.096921 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:08.096897    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2lg4\" (UniqueName: \"kubernetes.io/projected/b7a4454d-3688-4766-925f-882cf38819a7-kube-api-access-b2lg4\") pod \"istiod-openshift-gateway-94bb8fbfd-78m6p\" (UID: \"b7a4454d-3688-4766-925f-882cf38819a7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:08.196845 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:08.196766    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:08.335556 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:08.335530    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"]
Jul 08 03:06:08.336386 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:06:08.336359    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a4454d_3688_4766_925f_882cf38819a7.slice/crio-06d45e456c13324750b05e1c05d0ef678564d67635e282a6dcca3565d5eeb1b3 WatchSource:0}: Error finding container 06d45e456c13324750b05e1c05d0ef678564d67635e282a6dcca3565d5eeb1b3: Status 404 returned error can't find the container with id 06d45e456c13324750b05e1c05d0ef678564d67635e282a6dcca3565d5eeb1b3
Jul 08 03:06:08.932264 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:08.932230    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p" event={"ID":"b7a4454d-3688-4766-925f-882cf38819a7","Type":"ContainerStarted","Data":"06d45e456c13324750b05e1c05d0ef678564d67635e282a6dcca3565d5eeb1b3"}
Jul 08 03:06:10.728716 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:10.728667    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 03:06:10.729020 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:10.728791    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 03:06:10.942248 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:10.942214    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p" event={"ID":"b7a4454d-3688-4766-925f-882cf38819a7","Type":"ContainerStarted","Data":"454660828e1dc3993e7dda346b4ad45cf87a203553ea564334e7460598f140c3"}
Jul 08 03:06:10.942412 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:10.942339    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:11.036701 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:11.036589    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p" podStartSLOduration=1.646513034 podStartE2EDuration="4.036571949s" totalImagesPullingTime="2.390058915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:06:11.02819381 +0000 UTC m=+455.340472344" watchObservedRunningTime="2026-07-08 03:06:11.036571949 +0000 UTC m=+455.348850483"
Jul 08 03:06:11.948054 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:11.948027    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-78m6p"
Jul 08 03:06:12.905994 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:12.905963    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65cfbc7dbc-sb72k"
Jul 08 03:06:23.970878 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:23.970849    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5844785c9f-8tjsq"]
Jul 08 03:06:48.990903 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:48.990860    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5844785c9f-8tjsq" podUID="265c49c0-2263-4e05-86b3-215f716a599e" containerName="console" containerID="cri-o://7658f068c16f71e35f2fa3574a22db6f6f24ace8d5329c5d1dba2118fb5e2d45" gracePeriod=15
Jul 08 03:06:49.236984 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.236959    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:06:49.301274 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.301249    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/265c49c0-2263-4e05-86b3-215f716a599e-console-serving-cert\") pod \"265c49c0-2263-4e05-86b3-215f716a599e\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") "
Jul 08 03:06:49.301418 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.301342    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/265c49c0-2263-4e05-86b3-215f716a599e-console-oauth-config\") pod \"265c49c0-2263-4e05-86b3-215f716a599e\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") "
Jul 08 03:06:49.301418 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.301392    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-service-ca\") pod \"265c49c0-2263-4e05-86b3-215f716a599e\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") "
Jul 08 03:06:49.301491 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.301418    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-console-config\") pod \"265c49c0-2263-4e05-86b3-215f716a599e\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") "
Jul 08 03:06:49.301491 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.301459    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdn8s\" (UniqueName: \"kubernetes.io/projected/265c49c0-2263-4e05-86b3-215f716a599e-kube-api-access-xdn8s\") pod \"265c49c0-2263-4e05-86b3-215f716a599e\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") "
Jul 08 03:06:49.301580 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.301499    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-trusted-ca-bundle\") pod \"265c49c0-2263-4e05-86b3-215f716a599e\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") "
Jul 08 03:06:49.301580 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.301538    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-oauth-serving-cert\") pod \"265c49c0-2263-4e05-86b3-215f716a599e\" (UID: \"265c49c0-2263-4e05-86b3-215f716a599e\") "
Jul 08 03:06:49.301828 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.301795    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-service-ca" (OuterVolumeSpecName: "service-ca") pod "265c49c0-2263-4e05-86b3-215f716a599e" (UID: "265c49c0-2263-4e05-86b3-215f716a599e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:06:49.301962 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.301893    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-console-config" (OuterVolumeSpecName: "console-config") pod "265c49c0-2263-4e05-86b3-215f716a599e" (UID: "265c49c0-2263-4e05-86b3-215f716a599e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:06:49.301962 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.301910    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-service-ca\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:06:49.302185 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.302157    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "265c49c0-2263-4e05-86b3-215f716a599e" (UID: "265c49c0-2263-4e05-86b3-215f716a599e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:06:49.302517 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.302493    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "265c49c0-2263-4e05-86b3-215f716a599e" (UID: "265c49c0-2263-4e05-86b3-215f716a599e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:06:49.303664 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.303646    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/265c49c0-2263-4e05-86b3-215f716a599e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "265c49c0-2263-4e05-86b3-215f716a599e" (UID: "265c49c0-2263-4e05-86b3-215f716a599e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:06:49.303960 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.303943    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/265c49c0-2263-4e05-86b3-215f716a599e-kube-api-access-xdn8s" (OuterVolumeSpecName: "kube-api-access-xdn8s") pod "265c49c0-2263-4e05-86b3-215f716a599e" (UID: "265c49c0-2263-4e05-86b3-215f716a599e"). InnerVolumeSpecName "kube-api-access-xdn8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:06:49.304010 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.303992    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/265c49c0-2263-4e05-86b3-215f716a599e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "265c49c0-2263-4e05-86b3-215f716a599e" (UID: "265c49c0-2263-4e05-86b3-215f716a599e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:06:49.402835 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.402795    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-console-config\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:06:49.402835 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.402829    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdn8s\" (UniqueName: \"kubernetes.io/projected/265c49c0-2263-4e05-86b3-215f716a599e-kube-api-access-xdn8s\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:06:49.402835 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.402838    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-trusted-ca-bundle\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:06:49.402835 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.402847    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/265c49c0-2263-4e05-86b3-215f716a599e-oauth-serving-cert\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:06:49.403124 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.402855    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/265c49c0-2263-4e05-86b3-215f716a599e-console-serving-cert\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:06:49.403124 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:49.402864    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/265c49c0-2263-4e05-86b3-215f716a599e-console-oauth-config\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:06:50.109119 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:50.109081    2578 generic.go:356] "Generic (PLEG): container finished" podID="265c49c0-2263-4e05-86b3-215f716a599e" containerID="7658f068c16f71e35f2fa3574a22db6f6f24ace8d5329c5d1dba2118fb5e2d45" exitCode=0
Jul 08 03:06:50.109527 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:50.109133    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5844785c9f-8tjsq"
Jul 08 03:06:50.109527 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:50.109166    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5844785c9f-8tjsq" event={"ID":"265c49c0-2263-4e05-86b3-215f716a599e","Type":"ContainerDied","Data":"7658f068c16f71e35f2fa3574a22db6f6f24ace8d5329c5d1dba2118fb5e2d45"}
Jul 08 03:06:50.109527 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:50.109223    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5844785c9f-8tjsq" event={"ID":"265c49c0-2263-4e05-86b3-215f716a599e","Type":"ContainerDied","Data":"bcc8f0d3497a7b20be530df5766c147b8db5c8c2190dd63141612e6c7e6413a8"}
Jul 08 03:06:50.109527 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:50.109243    2578 scope.go:117] "RemoveContainer" containerID="7658f068c16f71e35f2fa3574a22db6f6f24ace8d5329c5d1dba2118fb5e2d45"
Jul 08 03:06:50.117813 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:50.117796    2578 scope.go:117] "RemoveContainer" containerID="7658f068c16f71e35f2fa3574a22db6f6f24ace8d5329c5d1dba2118fb5e2d45"
Jul 08 03:06:50.118058 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:06:50.118041    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7658f068c16f71e35f2fa3574a22db6f6f24ace8d5329c5d1dba2118fb5e2d45\": container with ID starting with 7658f068c16f71e35f2fa3574a22db6f6f24ace8d5329c5d1dba2118fb5e2d45 not found: ID does not exist" containerID="7658f068c16f71e35f2fa3574a22db6f6f24ace8d5329c5d1dba2118fb5e2d45"
Jul 08 03:06:50.118101 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:50.118068    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7658f068c16f71e35f2fa3574a22db6f6f24ace8d5329c5d1dba2118fb5e2d45"} err="failed to get container status \"7658f068c16f71e35f2fa3574a22db6f6f24ace8d5329c5d1dba2118fb5e2d45\": rpc error: code = NotFound desc = could not find container \"7658f068c16f71e35f2fa3574a22db6f6f24ace8d5329c5d1dba2118fb5e2d45\": container with ID starting with 7658f068c16f71e35f2fa3574a22db6f6f24ace8d5329c5d1dba2118fb5e2d45 not found: ID does not exist"
Jul 08 03:06:50.129698 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:50.129669    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5844785c9f-8tjsq"]
Jul 08 03:06:50.133730 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:50.133709    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5844785c9f-8tjsq"]
Jul 08 03:06:50.162902 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:06:50.162873    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="265c49c0-2263-4e05-86b3-215f716a599e" path="/var/lib/kubelet/pods/265c49c0-2263-4e05-86b3-215f716a599e/volumes"
Jul 08 03:07:15.270382 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.270348    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz"]
Jul 08 03:07:15.270784 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.270617    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="265c49c0-2263-4e05-86b3-215f716a599e" containerName="console"
Jul 08 03:07:15.270784 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.270628    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="265c49c0-2263-4e05-86b3-215f716a599e" containerName="console"
Jul 08 03:07:15.270784 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.270681    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="265c49c0-2263-4e05-86b3-215f716a599e" containerName="console"
Jul 08 03:07:15.273852 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.273836    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz"
Jul 08 03:07:15.276452 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.276421    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 03:07:15.276707 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.276690    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 03:07:15.276823 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.276693    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hqzwg\""
Jul 08 03:07:15.281613 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.281591    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz"]
Jul 08 03:07:15.418340 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.418306    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1308bace-3157-4bf6-ab3d-5cf22cf72ed8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz\" (UID: \"1308bace-3157-4bf6-ab3d-5cf22cf72ed8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz"
Jul 08 03:07:15.418519 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.418361    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66l5v\" (UniqueName: \"kubernetes.io/projected/1308bace-3157-4bf6-ab3d-5cf22cf72ed8-kube-api-access-66l5v\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz\" (UID: \"1308bace-3157-4bf6-ab3d-5cf22cf72ed8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz"
Jul 08 03:07:15.418519 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.418396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1308bace-3157-4bf6-ab3d-5cf22cf72ed8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz\" (UID: \"1308bace-3157-4bf6-ab3d-5cf22cf72ed8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz"
Jul 08 03:07:15.519783 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.519731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1308bace-3157-4bf6-ab3d-5cf22cf72ed8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz\" (UID: \"1308bace-3157-4bf6-ab3d-5cf22cf72ed8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz"
Jul 08 03:07:15.519969 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.519818    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66l5v\" (UniqueName: \"kubernetes.io/projected/1308bace-3157-4bf6-ab3d-5cf22cf72ed8-kube-api-access-66l5v\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz\" (UID: \"1308bace-3157-4bf6-ab3d-5cf22cf72ed8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz"
Jul 08 03:07:15.519969 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.519856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1308bace-3157-4bf6-ab3d-5cf22cf72ed8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz\" (UID: \"1308bace-3157-4bf6-ab3d-5cf22cf72ed8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz"
Jul 08 03:07:15.520094 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.520048    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1308bace-3157-4bf6-ab3d-5cf22cf72ed8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz\" (UID: \"1308bace-3157-4bf6-ab3d-5cf22cf72ed8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz"
Jul 08 03:07:15.520178 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.520156    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1308bace-3157-4bf6-ab3d-5cf22cf72ed8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz\" (UID: \"1308bace-3157-4bf6-ab3d-5cf22cf72ed8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz"
Jul 08 03:07:15.527467 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.527414    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66l5v\" (UniqueName: \"kubernetes.io/projected/1308bace-3157-4bf6-ab3d-5cf22cf72ed8-kube-api-access-66l5v\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz\" (UID: \"1308bace-3157-4bf6-ab3d-5cf22cf72ed8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz"
Jul 08 03:07:15.583366 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.583343    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz"
Jul 08 03:07:15.713682 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.713658    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz"]
Jul 08 03:07:15.715673 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:07:15.715645    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1308bace_3157_4bf6_ab3d_5cf22cf72ed8.slice/crio-f43d0c780b2162e91331e114579d488fbafc82cf1972abc460ff86ed010afc48 WatchSource:0}: Error finding container f43d0c780b2162e91331e114579d488fbafc82cf1972abc460ff86ed010afc48: Status 404 returned error can't find the container with id f43d0c780b2162e91331e114579d488fbafc82cf1972abc460ff86ed010afc48
Jul 08 03:07:15.871234 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.871202    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs"]
Jul 08 03:07:15.874454 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.874438    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs"
Jul 08 03:07:15.882991 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:15.882971    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs"]
Jul 08 03:07:16.022908 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.022878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bzzx\" (UniqueName: \"kubernetes.io/projected/36346dad-a9eb-483c-b78f-3328116652a8-kube-api-access-5bzzx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs\" (UID: \"36346dad-a9eb-483c-b78f-3328116652a8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs"
Jul 08 03:07:16.023089 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.022914    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36346dad-a9eb-483c-b78f-3328116652a8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs\" (UID: \"36346dad-a9eb-483c-b78f-3328116652a8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs"
Jul 08 03:07:16.023089 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.022933    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36346dad-a9eb-483c-b78f-3328116652a8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs\" (UID: \"36346dad-a9eb-483c-b78f-3328116652a8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs"
Jul 08 03:07:16.123837 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.123731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36346dad-a9eb-483c-b78f-3328116652a8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs\" (UID: \"36346dad-a9eb-483c-b78f-3328116652a8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs"
Jul 08 03:07:16.123837 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.123806    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36346dad-a9eb-483c-b78f-3328116652a8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs\" (UID: \"36346dad-a9eb-483c-b78f-3328116652a8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs"
Jul 08 03:07:16.124030 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.123912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bzzx\" (UniqueName: \"kubernetes.io/projected/36346dad-a9eb-483c-b78f-3328116652a8-kube-api-access-5bzzx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs\" (UID: \"36346dad-a9eb-483c-b78f-3328116652a8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs"
Jul 08 03:07:16.124185 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.124164    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36346dad-a9eb-483c-b78f-3328116652a8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs\" (UID: \"36346dad-a9eb-483c-b78f-3328116652a8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs"
Jul 08 03:07:16.124245 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.124218    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36346dad-a9eb-483c-b78f-3328116652a8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs\" (UID: \"36346dad-a9eb-483c-b78f-3328116652a8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs"
Jul 08 03:07:16.132478 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.132455    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bzzx\" (UniqueName: \"kubernetes.io/projected/36346dad-a9eb-483c-b78f-3328116652a8-kube-api-access-5bzzx\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs\" (UID: \"36346dad-a9eb-483c-b78f-3328116652a8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs"
Jul 08 03:07:16.182939 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.182913    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs"
Jul 08 03:07:16.226828 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.226801    2578 generic.go:356] "Generic (PLEG): container finished" podID="1308bace-3157-4bf6-ab3d-5cf22cf72ed8" containerID="7a2b4dbbacd40d7188c42f6f46bee0e4e5826820e450813f9dd41beb8cd2737e" exitCode=0
Jul 08 03:07:16.226979 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.226859    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz" event={"ID":"1308bace-3157-4bf6-ab3d-5cf22cf72ed8","Type":"ContainerDied","Data":"7a2b4dbbacd40d7188c42f6f46bee0e4e5826820e450813f9dd41beb8cd2737e"}
Jul 08 03:07:16.226979 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.226893    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz" event={"ID":"1308bace-3157-4bf6-ab3d-5cf22cf72ed8","Type":"ContainerStarted","Data":"f43d0c780b2162e91331e114579d488fbafc82cf1972abc460ff86ed010afc48"}
Jul 08 03:07:16.286408 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.286352    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9"]
Jul 08 03:07:16.307907 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.307874    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9"]
Jul 08 03:07:16.308135 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.307978    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9"
Jul 08 03:07:16.338635 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.338610    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs"]
Jul 08 03:07:16.340266 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:07:16.340242    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36346dad_a9eb_483c_b78f_3328116652a8.slice/crio-c7e69517d7a2b12cf2c1d26db376f0049dfa4d63dbb08d49eb4c1345834559df WatchSource:0}: Error finding container c7e69517d7a2b12cf2c1d26db376f0049dfa4d63dbb08d49eb4c1345834559df: Status 404 returned error can't find the container with id c7e69517d7a2b12cf2c1d26db376f0049dfa4d63dbb08d49eb4c1345834559df
Jul 08 03:07:16.425548 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.425520    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0482e618-69f4-4bba-bfd1-c72ea5dde0bd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9\" (UID: \"0482e618-69f4-4bba-bfd1-c72ea5dde0bd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9"
Jul 08 03:07:16.425642 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.425565    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0482e618-69f4-4bba-bfd1-c72ea5dde0bd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9\" (UID: \"0482e618-69f4-4bba-bfd1-c72ea5dde0bd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9"
Jul 08 03:07:16.425691 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.425650    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9x5m\" (UniqueName: \"kubernetes.io/projected/0482e618-69f4-4bba-bfd1-c72ea5dde0bd-kube-api-access-b9x5m\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9\" (UID: \"0482e618-69f4-4bba-bfd1-c72ea5dde0bd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9"
Jul 08 03:07:16.526842 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.526814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9x5m\" (UniqueName: \"kubernetes.io/projected/0482e618-69f4-4bba-bfd1-c72ea5dde0bd-kube-api-access-b9x5m\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9\" (UID: \"0482e618-69f4-4bba-bfd1-c72ea5dde0bd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9"
Jul 08 03:07:16.526983 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.526877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0482e618-69f4-4bba-bfd1-c72ea5dde0bd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9\" (UID: \"0482e618-69f4-4bba-bfd1-c72ea5dde0bd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9"
Jul 08 03:07:16.526983 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.526899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0482e618-69f4-4bba-bfd1-c72ea5dde0bd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9\" (UID: \"0482e618-69f4-4bba-bfd1-c72ea5dde0bd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9"
Jul 08 03:07:16.527196 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.527182    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0482e618-69f4-4bba-bfd1-c72ea5dde0bd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9\" (UID: \"0482e618-69f4-4bba-bfd1-c72ea5dde0bd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9"
Jul 08 03:07:16.527600 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.527582    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0482e618-69f4-4bba-bfd1-c72ea5dde0bd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9\" (UID: \"0482e618-69f4-4bba-bfd1-c72ea5dde0bd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9"
Jul 08 03:07:16.535886 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.535856    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9x5m\" (UniqueName: \"kubernetes.io/projected/0482e618-69f4-4bba-bfd1-c72ea5dde0bd-kube-api-access-b9x5m\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9\" (UID: \"0482e618-69f4-4bba-bfd1-c72ea5dde0bd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9"
Jul 08 03:07:16.618308 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.618282    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9"
Jul 08 03:07:16.751134 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.751034    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9"]
Jul 08 03:07:16.780292 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:07:16.780258    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0482e618_69f4_4bba_bfd1_c72ea5dde0bd.slice/crio-7f0ea32a48367d353c3350c0ae32e0fa27af7799f01ef71140b0d9e14f3e9456 WatchSource:0}: Error finding container 7f0ea32a48367d353c3350c0ae32e0fa27af7799f01ef71140b0d9e14f3e9456: Status 404 returned error can't find the container with id 7f0ea32a48367d353c3350c0ae32e0fa27af7799f01ef71140b0d9e14f3e9456
Jul 08 03:07:16.876664 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.876634    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2"]
Jul 08 03:07:16.882430 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.882405    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2"
Jul 08 03:07:16.885605 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:16.885525    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2"]
Jul 08 03:07:17.030945 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.030917    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnbzv\" (UniqueName: \"kubernetes.io/projected/5e2b3c56-7e81-4019-83ec-f57ec67c9c66-kube-api-access-fnbzv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2\" (UID: \"5e2b3c56-7e81-4019-83ec-f57ec67c9c66\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2"
Jul 08 03:07:17.031110 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.030979    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e2b3c56-7e81-4019-83ec-f57ec67c9c66-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2\" (UID: \"5e2b3c56-7e81-4019-83ec-f57ec67c9c66\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2"
Jul 08 03:07:17.031110 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.031055    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e2b3c56-7e81-4019-83ec-f57ec67c9c66-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2\" (UID: \"5e2b3c56-7e81-4019-83ec-f57ec67c9c66\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2"
Jul 08 03:07:17.131798 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.131766    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnbzv\" (UniqueName: \"kubernetes.io/projected/5e2b3c56-7e81-4019-83ec-f57ec67c9c66-kube-api-access-fnbzv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2\" (UID: \"5e2b3c56-7e81-4019-83ec-f57ec67c9c66\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2"
Jul 08 03:07:17.131974 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.131825    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e2b3c56-7e81-4019-83ec-f57ec67c9c66-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2\" (UID: \"5e2b3c56-7e81-4019-83ec-f57ec67c9c66\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2"
Jul 08 03:07:17.132033 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.132005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e2b3c56-7e81-4019-83ec-f57ec67c9c66-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2\" (UID: \"5e2b3c56-7e81-4019-83ec-f57ec67c9c66\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2"
Jul 08 03:07:17.132138 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.132121    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e2b3c56-7e81-4019-83ec-f57ec67c9c66-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2\" (UID: \"5e2b3c56-7e81-4019-83ec-f57ec67c9c66\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2"
Jul 08 03:07:17.132265 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.132249    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e2b3c56-7e81-4019-83ec-f57ec67c9c66-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2\" (UID: \"5e2b3c56-7e81-4019-83ec-f57ec67c9c66\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2"
Jul 08 03:07:17.142852 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.142832    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnbzv\" (UniqueName: \"kubernetes.io/projected/5e2b3c56-7e81-4019-83ec-f57ec67c9c66-kube-api-access-fnbzv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2\" (UID: \"5e2b3c56-7e81-4019-83ec-f57ec67c9c66\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2"
Jul 08 03:07:17.232781 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.232671    2578 generic.go:356] "Generic (PLEG): container finished" podID="36346dad-a9eb-483c-b78f-3328116652a8" containerID="5ac9076cf5067b3b2bd0c9ec644aac3232948e617a7bbac174412f2ad176585e" exitCode=0
Jul 08 03:07:17.232781 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.232760    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs" event={"ID":"36346dad-a9eb-483c-b78f-3328116652a8","Type":"ContainerDied","Data":"5ac9076cf5067b3b2bd0c9ec644aac3232948e617a7bbac174412f2ad176585e"}
Jul 08 03:07:17.232977 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.232815    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs" event={"ID":"36346dad-a9eb-483c-b78f-3328116652a8","Type":"ContainerStarted","Data":"c7e69517d7a2b12cf2c1d26db376f0049dfa4d63dbb08d49eb4c1345834559df"}
Jul 08 03:07:17.234754 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.234724    2578 generic.go:356] "Generic (PLEG): container finished" podID="1308bace-3157-4bf6-ab3d-5cf22cf72ed8" containerID="cbb5b36238ff37a73971a7f92ddf53d7a77d85b13a2fd693afa506d0ae44310f" exitCode=0
Jul 08 03:07:17.234851 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.234806    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz" event={"ID":"1308bace-3157-4bf6-ab3d-5cf22cf72ed8","Type":"ContainerDied","Data":"cbb5b36238ff37a73971a7f92ddf53d7a77d85b13a2fd693afa506d0ae44310f"}
Jul 08 03:07:17.236597 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.236575    2578 generic.go:356] "Generic (PLEG): container finished" podID="0482e618-69f4-4bba-bfd1-c72ea5dde0bd" containerID="e787d8e18620391823f618728830d1f2d795631ecb61b48b391174a9565a1f16" exitCode=0
Jul 08 03:07:17.236697 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.236652    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9" event={"ID":"0482e618-69f4-4bba-bfd1-c72ea5dde0bd","Type":"ContainerDied","Data":"e787d8e18620391823f618728830d1f2d795631ecb61b48b391174a9565a1f16"}
Jul 08 03:07:17.236697 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.236690    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9" event={"ID":"0482e618-69f4-4bba-bfd1-c72ea5dde0bd","Type":"ContainerStarted","Data":"7f0ea32a48367d353c3350c0ae32e0fa27af7799f01ef71140b0d9e14f3e9456"}
Jul 08 03:07:17.275638 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.275605    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2"
Jul 08 03:07:17.415015 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:17.414983    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2"]
Jul 08 03:07:17.426627 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:07:17.426601    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e2b3c56_7e81_4019_83ec_f57ec67c9c66.slice/crio-47947984fcd2927cb217b3eef9afdd1607f5cb63381519d500dc1ca3b7b29dde WatchSource:0}: Error finding container 47947984fcd2927cb217b3eef9afdd1607f5cb63381519d500dc1ca3b7b29dde: Status 404 returned error can't find the container with id 47947984fcd2927cb217b3eef9afdd1607f5cb63381519d500dc1ca3b7b29dde
Jul 08 03:07:18.242810 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:18.242779    2578 generic.go:356] "Generic (PLEG): container finished" podID="5e2b3c56-7e81-4019-83ec-f57ec67c9c66" containerID="99739bee7b39c0bc40bd19299ce469bdc12c052917761a108571a455d0798fc7" exitCode=0
Jul 08 03:07:18.242957 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:18.242911    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2" event={"ID":"5e2b3c56-7e81-4019-83ec-f57ec67c9c66","Type":"ContainerDied","Data":"99739bee7b39c0bc40bd19299ce469bdc12c052917761a108571a455d0798fc7"}
Jul 08 03:07:18.243021 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:18.242959    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2" event={"ID":"5e2b3c56-7e81-4019-83ec-f57ec67c9c66","Type":"ContainerStarted","Data":"47947984fcd2927cb217b3eef9afdd1607f5cb63381519d500dc1ca3b7b29dde"}
Jul 08 03:07:18.245635 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:18.245611    2578 generic.go:356] "Generic (PLEG): container finished" podID="1308bace-3157-4bf6-ab3d-5cf22cf72ed8" containerID="6d6faf5dfc1ac14dcb6eedd6b2839d960a79291c4d1e847ece08f417377bc9ee" exitCode=0
Jul 08 03:07:18.245761 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:18.245672    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz" event={"ID":"1308bace-3157-4bf6-ab3d-5cf22cf72ed8","Type":"ContainerDied","Data":"6d6faf5dfc1ac14dcb6eedd6b2839d960a79291c4d1e847ece08f417377bc9ee"}
Jul 08 03:07:18.247507 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:18.247487    2578 generic.go:356] "Generic (PLEG): container finished" podID="0482e618-69f4-4bba-bfd1-c72ea5dde0bd" containerID="fbe3ca69aa8bc65d8728520fd7f3863fc73a00185516fb83d458a31cdd65b7d9" exitCode=0
Jul 08 03:07:18.247582 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:18.247562    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9" event={"ID":"0482e618-69f4-4bba-bfd1-c72ea5dde0bd","Type":"ContainerDied","Data":"fbe3ca69aa8bc65d8728520fd7f3863fc73a00185516fb83d458a31cdd65b7d9"}
Jul 08 03:07:19.259041 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:19.259006    2578 generic.go:356] "Generic (PLEG): container finished" podID="36346dad-a9eb-483c-b78f-3328116652a8" containerID="3fba2f119992364ed8574ea394c1a52db9e88dc942cc11f0f62d2d9f8faa949c" exitCode=0
Jul 08 03:07:19.259418 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:19.259043    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs" event={"ID":"36346dad-a9eb-483c-b78f-3328116652a8","Type":"ContainerDied","Data":"3fba2f119992364ed8574ea394c1a52db9e88dc942cc11f0f62d2d9f8faa949c"}
Jul 08 03:07:19.261012 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:19.260993    2578 generic.go:356] "Generic (PLEG): container finished" podID="5e2b3c56-7e81-4019-83ec-f57ec67c9c66" containerID="553f1e2820096645d525e2f6c35b17824f655f6f05a2af7cc311ebd2a0124d68" exitCode=0
Jul 08 03:07:19.261105 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:19.261083    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2" event={"ID":"5e2b3c56-7e81-4019-83ec-f57ec67c9c66","Type":"ContainerDied","Data":"553f1e2820096645d525e2f6c35b17824f655f6f05a2af7cc311ebd2a0124d68"}
Jul 08 03:07:19.263403 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:19.263381    2578 generic.go:356] "Generic (PLEG): container finished" podID="0482e618-69f4-4bba-bfd1-c72ea5dde0bd" containerID="07058429556bd3d1f632e35114a45e1ef00940bc68d98b6cb7ab1b196c4108ee" exitCode=0
Jul 08 03:07:19.263480 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:19.263460    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9" event={"ID":"0482e618-69f4-4bba-bfd1-c72ea5dde0bd","Type":"ContainerDied","Data":"07058429556bd3d1f632e35114a45e1ef00940bc68d98b6cb7ab1b196c4108ee"}
Jul 08 03:07:19.393573 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:19.393540    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz"
Jul 08 03:07:19.553623 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:19.553598    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1308bace-3157-4bf6-ab3d-5cf22cf72ed8-bundle\") pod \"1308bace-3157-4bf6-ab3d-5cf22cf72ed8\" (UID: \"1308bace-3157-4bf6-ab3d-5cf22cf72ed8\") "
Jul 08 03:07:19.553726 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:19.553638    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1308bace-3157-4bf6-ab3d-5cf22cf72ed8-util\") pod \"1308bace-3157-4bf6-ab3d-5cf22cf72ed8\" (UID: \"1308bace-3157-4bf6-ab3d-5cf22cf72ed8\") "
Jul 08 03:07:19.553726 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:19.553675    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66l5v\" (UniqueName: \"kubernetes.io/projected/1308bace-3157-4bf6-ab3d-5cf22cf72ed8-kube-api-access-66l5v\") pod \"1308bace-3157-4bf6-ab3d-5cf22cf72ed8\" (UID: \"1308bace-3157-4bf6-ab3d-5cf22cf72ed8\") "
Jul 08 03:07:19.554132 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:19.554113    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1308bace-3157-4bf6-ab3d-5cf22cf72ed8-bundle" (OuterVolumeSpecName: "bundle") pod "1308bace-3157-4bf6-ab3d-5cf22cf72ed8" (UID: "1308bace-3157-4bf6-ab3d-5cf22cf72ed8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:07:19.556075 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:19.556049    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1308bace-3157-4bf6-ab3d-5cf22cf72ed8-kube-api-access-66l5v" (OuterVolumeSpecName: "kube-api-access-66l5v") pod "1308bace-3157-4bf6-ab3d-5cf22cf72ed8" (UID: "1308bace-3157-4bf6-ab3d-5cf22cf72ed8"). InnerVolumeSpecName "kube-api-access-66l5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:07:19.559475 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:19.559457    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1308bace-3157-4bf6-ab3d-5cf22cf72ed8-util" (OuterVolumeSpecName: "util") pod "1308bace-3157-4bf6-ab3d-5cf22cf72ed8" (UID: "1308bace-3157-4bf6-ab3d-5cf22cf72ed8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:07:19.654637 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:19.654573    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1308bace-3157-4bf6-ab3d-5cf22cf72ed8-bundle\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:07:19.654637 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:19.654596    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1308bace-3157-4bf6-ab3d-5cf22cf72ed8-util\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:07:19.654637 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:19.654607    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66l5v\" (UniqueName: \"kubernetes.io/projected/1308bace-3157-4bf6-ab3d-5cf22cf72ed8-kube-api-access-66l5v\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:07:20.270145 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:20.270111    2578 generic.go:356] "Generic (PLEG): container finished" podID="36346dad-a9eb-483c-b78f-3328116652a8" containerID="089b7e1f5c4ced8e013d06b4d0cc90ecc4a13c52119945a436ca725a4e9c7c9d" exitCode=0
Jul 08 03:07:20.270575 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:20.270194    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs" event={"ID":"36346dad-a9eb-483c-b78f-3328116652a8","Type":"ContainerDied","Data":"089b7e1f5c4ced8e013d06b4d0cc90ecc4a13c52119945a436ca725a4e9c7c9d"}
Jul 08 03:07:20.272041 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:20.272019    2578 generic.go:356] "Generic (PLEG): container finished" podID="5e2b3c56-7e81-4019-83ec-f57ec67c9c66" containerID="32d87e71e06f5f2fd4a106ce300da7d715d2e15ed957a442c2fc4b775aa9438a" exitCode=0
Jul 08 03:07:20.272157 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:20.272097    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2" event={"ID":"5e2b3c56-7e81-4019-83ec-f57ec67c9c66","Type":"ContainerDied","Data":"32d87e71e06f5f2fd4a106ce300da7d715d2e15ed957a442c2fc4b775aa9438a"}
Jul 08 03:07:20.273913 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:20.273895    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz"
Jul 08 03:07:20.274005 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:20.273915    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz" event={"ID":"1308bace-3157-4bf6-ab3d-5cf22cf72ed8","Type":"ContainerDied","Data":"f43d0c780b2162e91331e114579d488fbafc82cf1972abc460ff86ed010afc48"}
Jul 08 03:07:20.274005 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:20.273950    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f43d0c780b2162e91331e114579d488fbafc82cf1972abc460ff86ed010afc48"
Jul 08 03:07:20.401568 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:20.401541    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9"
Jul 08 03:07:20.562031 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:20.562007    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0482e618-69f4-4bba-bfd1-c72ea5dde0bd-util\") pod \"0482e618-69f4-4bba-bfd1-c72ea5dde0bd\" (UID: \"0482e618-69f4-4bba-bfd1-c72ea5dde0bd\") "
Jul 08 03:07:20.562181 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:20.562040    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0482e618-69f4-4bba-bfd1-c72ea5dde0bd-bundle\") pod \"0482e618-69f4-4bba-bfd1-c72ea5dde0bd\" (UID: \"0482e618-69f4-4bba-bfd1-c72ea5dde0bd\") "
Jul 08 03:07:20.562181 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:20.562092    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9x5m\" (UniqueName: \"kubernetes.io/projected/0482e618-69f4-4bba-bfd1-c72ea5dde0bd-kube-api-access-b9x5m\") pod \"0482e618-69f4-4bba-bfd1-c72ea5dde0bd\" (UID: \"0482e618-69f4-4bba-bfd1-c72ea5dde0bd\") "
Jul 08 03:07:20.562509 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:20.562481    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0482e618-69f4-4bba-bfd1-c72ea5dde0bd-bundle" (OuterVolumeSpecName: "bundle") pod "0482e618-69f4-4bba-bfd1-c72ea5dde0bd" (UID: "0482e618-69f4-4bba-bfd1-c72ea5dde0bd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:07:20.564340 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:20.564316    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0482e618-69f4-4bba-bfd1-c72ea5dde0bd-kube-api-access-b9x5m" (OuterVolumeSpecName: "kube-api-access-b9x5m") pod "0482e618-69f4-4bba-bfd1-c72ea5dde0bd" (UID: "0482e618-69f4-4bba-bfd1-c72ea5dde0bd"). InnerVolumeSpecName "kube-api-access-b9x5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:07:20.567101 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:20.567079    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0482e618-69f4-4bba-bfd1-c72ea5dde0bd-util" (OuterVolumeSpecName: "util") pod "0482e618-69f4-4bba-bfd1-c72ea5dde0bd" (UID: "0482e618-69f4-4bba-bfd1-c72ea5dde0bd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:07:20.663520 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:20.663487    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0482e618-69f4-4bba-bfd1-c72ea5dde0bd-util\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:07:20.663520 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:20.663510    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0482e618-69f4-4bba-bfd1-c72ea5dde0bd-bundle\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:07:20.663520 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:20.663519    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9x5m\" (UniqueName: \"kubernetes.io/projected/0482e618-69f4-4bba-bfd1-c72ea5dde0bd-kube-api-access-b9x5m\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:07:21.280026 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.279987    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9" event={"ID":"0482e618-69f4-4bba-bfd1-c72ea5dde0bd","Type":"ContainerDied","Data":"7f0ea32a48367d353c3350c0ae32e0fa27af7799f01ef71140b0d9e14f3e9456"}
Jul 08 03:07:21.280026 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.280027    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9"
Jul 08 03:07:21.280496 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.280053    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f0ea32a48367d353c3350c0ae32e0fa27af7799f01ef71140b0d9e14f3e9456"
Jul 08 03:07:21.436339 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.436318    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2"
Jul 08 03:07:21.438362 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.438347    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs"
Jul 08 03:07:21.570194 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.570166    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36346dad-a9eb-483c-b78f-3328116652a8-bundle\") pod \"36346dad-a9eb-483c-b78f-3328116652a8\" (UID: \"36346dad-a9eb-483c-b78f-3328116652a8\") "
Jul 08 03:07:21.570348 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.570220    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e2b3c56-7e81-4019-83ec-f57ec67c9c66-bundle\") pod \"5e2b3c56-7e81-4019-83ec-f57ec67c9c66\" (UID: \"5e2b3c56-7e81-4019-83ec-f57ec67c9c66\") "
Jul 08 03:07:21.570348 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.570258    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnbzv\" (UniqueName: \"kubernetes.io/projected/5e2b3c56-7e81-4019-83ec-f57ec67c9c66-kube-api-access-fnbzv\") pod \"5e2b3c56-7e81-4019-83ec-f57ec67c9c66\" (UID: \"5e2b3c56-7e81-4019-83ec-f57ec67c9c66\") "
Jul 08 03:07:21.570348 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.570279    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bzzx\" (UniqueName: \"kubernetes.io/projected/36346dad-a9eb-483c-b78f-3328116652a8-kube-api-access-5bzzx\") pod \"36346dad-a9eb-483c-b78f-3328116652a8\" (UID: \"36346dad-a9eb-483c-b78f-3328116652a8\") "
Jul 08 03:07:21.570348 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.570308    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36346dad-a9eb-483c-b78f-3328116652a8-util\") pod \"36346dad-a9eb-483c-b78f-3328116652a8\" (UID: \"36346dad-a9eb-483c-b78f-3328116652a8\") "
Jul 08 03:07:21.570348 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.570326    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e2b3c56-7e81-4019-83ec-f57ec67c9c66-util\") pod \"5e2b3c56-7e81-4019-83ec-f57ec67c9c66\" (UID: \"5e2b3c56-7e81-4019-83ec-f57ec67c9c66\") "
Jul 08 03:07:21.570934 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.570892    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e2b3c56-7e81-4019-83ec-f57ec67c9c66-bundle" (OuterVolumeSpecName: "bundle") pod "5e2b3c56-7e81-4019-83ec-f57ec67c9c66" (UID: "5e2b3c56-7e81-4019-83ec-f57ec67c9c66"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:07:21.570934 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.570911    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36346dad-a9eb-483c-b78f-3328116652a8-bundle" (OuterVolumeSpecName: "bundle") pod "36346dad-a9eb-483c-b78f-3328116652a8" (UID: "36346dad-a9eb-483c-b78f-3328116652a8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:07:21.572981 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.572950    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36346dad-a9eb-483c-b78f-3328116652a8-kube-api-access-5bzzx" (OuterVolumeSpecName: "kube-api-access-5bzzx") pod "36346dad-a9eb-483c-b78f-3328116652a8" (UID: "36346dad-a9eb-483c-b78f-3328116652a8"). InnerVolumeSpecName "kube-api-access-5bzzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:07:21.573082 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.573000    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e2b3c56-7e81-4019-83ec-f57ec67c9c66-kube-api-access-fnbzv" (OuterVolumeSpecName: "kube-api-access-fnbzv") pod "5e2b3c56-7e81-4019-83ec-f57ec67c9c66" (UID: "5e2b3c56-7e81-4019-83ec-f57ec67c9c66"). InnerVolumeSpecName "kube-api-access-fnbzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:07:21.576437 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.576417    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e2b3c56-7e81-4019-83ec-f57ec67c9c66-util" (OuterVolumeSpecName: "util") pod "5e2b3c56-7e81-4019-83ec-f57ec67c9c66" (UID: "5e2b3c56-7e81-4019-83ec-f57ec67c9c66"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:07:21.576979 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.576958    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36346dad-a9eb-483c-b78f-3328116652a8-util" (OuterVolumeSpecName: "util") pod "36346dad-a9eb-483c-b78f-3328116652a8" (UID: "36346dad-a9eb-483c-b78f-3328116652a8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:07:21.671087 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.671058    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnbzv\" (UniqueName: \"kubernetes.io/projected/5e2b3c56-7e81-4019-83ec-f57ec67c9c66-kube-api-access-fnbzv\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:07:21.671087 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.671086    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bzzx\" (UniqueName: \"kubernetes.io/projected/36346dad-a9eb-483c-b78f-3328116652a8-kube-api-access-5bzzx\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:07:21.671259 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.671098    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36346dad-a9eb-483c-b78f-3328116652a8-util\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:07:21.671259 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.671110    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e2b3c56-7e81-4019-83ec-f57ec67c9c66-util\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:07:21.671259 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.671122    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36346dad-a9eb-483c-b78f-3328116652a8-bundle\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:07:21.671259 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:21.671133    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e2b3c56-7e81-4019-83ec-f57ec67c9c66-bundle\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:07:22.286438 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:22.286399    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs" event={"ID":"36346dad-a9eb-483c-b78f-3328116652a8","Type":"ContainerDied","Data":"c7e69517d7a2b12cf2c1d26db376f0049dfa4d63dbb08d49eb4c1345834559df"}
Jul 08 03:07:22.286887 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:22.286475    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7e69517d7a2b12cf2c1d26db376f0049dfa4d63dbb08d49eb4c1345834559df"
Jul 08 03:07:22.286887 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:22.286410    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs"
Jul 08 03:07:22.288450 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:22.288381    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2"
Jul 08 03:07:22.288576 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:22.288380    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2" event={"ID":"5e2b3c56-7e81-4019-83ec-f57ec67c9c66","Type":"ContainerDied","Data":"47947984fcd2927cb217b3eef9afdd1607f5cb63381519d500dc1ca3b7b29dde"}
Jul 08 03:07:22.288576 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:22.288511    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47947984fcd2927cb217b3eef9afdd1607f5cb63381519d500dc1ca3b7b29dde"
Jul 08 03:07:55.815388 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815352    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk"]
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815627    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0482e618-69f4-4bba-bfd1-c72ea5dde0bd" containerName="pull"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815637    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0482e618-69f4-4bba-bfd1-c72ea5dde0bd" containerName="pull"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815651    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1308bace-3157-4bf6-ab3d-5cf22cf72ed8" containerName="extract"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815656    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1308bace-3157-4bf6-ab3d-5cf22cf72ed8" containerName="extract"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815662    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e2b3c56-7e81-4019-83ec-f57ec67c9c66" containerName="util"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815668    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e2b3c56-7e81-4019-83ec-f57ec67c9c66" containerName="util"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815675    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36346dad-a9eb-483c-b78f-3328116652a8" containerName="util"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815680    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="36346dad-a9eb-483c-b78f-3328116652a8" containerName="util"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815687    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36346dad-a9eb-483c-b78f-3328116652a8" containerName="pull"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815692    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="36346dad-a9eb-483c-b78f-3328116652a8" containerName="pull"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815700    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0482e618-69f4-4bba-bfd1-c72ea5dde0bd" containerName="util"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815706    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0482e618-69f4-4bba-bfd1-c72ea5dde0bd" containerName="util"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815711    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0482e618-69f4-4bba-bfd1-c72ea5dde0bd" containerName="extract"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815717    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0482e618-69f4-4bba-bfd1-c72ea5dde0bd" containerName="extract"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815722    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36346dad-a9eb-483c-b78f-3328116652a8" containerName="extract"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815727    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="36346dad-a9eb-483c-b78f-3328116652a8" containerName="extract"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815732    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1308bace-3157-4bf6-ab3d-5cf22cf72ed8" containerName="util"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815737    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1308bace-3157-4bf6-ab3d-5cf22cf72ed8" containerName="util"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815758    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1308bace-3157-4bf6-ab3d-5cf22cf72ed8" containerName="pull"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815763    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1308bace-3157-4bf6-ab3d-5cf22cf72ed8" containerName="pull"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815771    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e2b3c56-7e81-4019-83ec-f57ec67c9c66" containerName="pull"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815779    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e2b3c56-7e81-4019-83ec-f57ec67c9c66" containerName="pull"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815788    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e2b3c56-7e81-4019-83ec-f57ec67c9c66" containerName="extract"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815793    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e2b3c56-7e81-4019-83ec-f57ec67c9c66" containerName="extract"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815849    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e2b3c56-7e81-4019-83ec-f57ec67c9c66" containerName="extract"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815857    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0482e618-69f4-4bba-bfd1-c72ea5dde0bd" containerName="extract"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815865    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1308bace-3157-4bf6-ab3d-5cf22cf72ed8" containerName="extract"
Jul 08 03:07:55.815881 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.815871    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="36346dad-a9eb-483c-b78f-3328116652a8" containerName="extract"
Jul 08 03:07:55.820211 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.820193    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk"
Jul 08 03:07:55.822415 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.822399    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8bn97\""
Jul 08 03:07:55.822769 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.822732    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 03:07:55.822869 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.822783    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 03:07:55.831442 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.831420    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk"]
Jul 08 03:07:55.951013 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.950978    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9125c30-6075-4c19-8097-49c1802b60b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-766wk\" (UID: \"d9125c30-6075-4c19-8097-49c1802b60b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk"
Jul 08 03:07:55.951187 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.951035    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qm7f\" (UniqueName: \"kubernetes.io/projected/d9125c30-6075-4c19-8097-49c1802b60b6-kube-api-access-4qm7f\") pod \"kuadrant-operator-controller-manager-55467d9f7-766wk\" (UID: \"d9125c30-6075-4c19-8097-49c1802b60b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk"
Jul 08 03:07:55.978219 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.978189    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk"]
Jul 08 03:07:55.978439 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:07:55.978418    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-4qm7f], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk" podUID="d9125c30-6075-4c19-8097-49c1802b60b6"
Jul 08 03:07:55.987882 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:55.987857    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk"]
Jul 08 03:07:56.008893 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.008871    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-w2ff7"]
Jul 08 03:07:56.012234 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.012219    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-w2ff7"
Jul 08 03:07:56.030878 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.030852    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-w2ff7"]
Jul 08 03:07:56.052191 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.052153    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qm7f\" (UniqueName: \"kubernetes.io/projected/d9125c30-6075-4c19-8097-49c1802b60b6-kube-api-access-4qm7f\") pod \"kuadrant-operator-controller-manager-55467d9f7-766wk\" (UID: \"d9125c30-6075-4c19-8097-49c1802b60b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk"
Jul 08 03:07:56.052323 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.052258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9125c30-6075-4c19-8097-49c1802b60b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-766wk\" (UID: \"d9125c30-6075-4c19-8097-49c1802b60b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk"
Jul 08 03:07:56.052669 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.052650    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9125c30-6075-4c19-8097-49c1802b60b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-766wk\" (UID: \"d9125c30-6075-4c19-8097-49c1802b60b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk"
Jul 08 03:07:56.057163 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:07:56.057140    2578 projected.go:196] Error preparing data for projected volume kube-api-access-4qm7f for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk: failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-766wk" not found
Jul 08 03:07:56.057279 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:07:56.057212    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9125c30-6075-4c19-8097-49c1802b60b6-kube-api-access-4qm7f podName:d9125c30-6075-4c19-8097-49c1802b60b6 nodeName:}" failed. No retries permitted until 2026-07-08 03:07:56.557185605 +0000 UTC m=+560.869464119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4qm7f" (UniqueName: "kubernetes.io/projected/d9125c30-6075-4c19-8097-49c1802b60b6-kube-api-access-4qm7f") pod "kuadrant-operator-controller-manager-55467d9f7-766wk" (UID: "d9125c30-6075-4c19-8097-49c1802b60b6") : failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-766wk" not found
Jul 08 03:07:56.069422 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.069358    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-w2ff7"]
Jul 08 03:07:56.069650 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:07:56.069629    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-qp59p], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-qp59p]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-w2ff7" podUID="257ffad7-4df8-4e0f-950a-46227cfb255c"
Jul 08 03:07:56.152869 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.152835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp59p\" (UniqueName: \"kubernetes.io/projected/257ffad7-4df8-4e0f-950a-46227cfb255c-kube-api-access-qp59p\") pod \"kuadrant-operator-controller-manager-55467d9f7-w2ff7\" (UID: \"257ffad7-4df8-4e0f-950a-46227cfb255c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-w2ff7"
Jul 08 03:07:56.152869 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.152873    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/257ffad7-4df8-4e0f-950a-46227cfb255c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-w2ff7\" (UID: \"257ffad7-4df8-4e0f-950a-46227cfb255c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-w2ff7"
Jul 08 03:07:56.253923 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.253888    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp59p\" (UniqueName: \"kubernetes.io/projected/257ffad7-4df8-4e0f-950a-46227cfb255c-kube-api-access-qp59p\") pod \"kuadrant-operator-controller-manager-55467d9f7-w2ff7\" (UID: \"257ffad7-4df8-4e0f-950a-46227cfb255c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-w2ff7"
Jul 08 03:07:56.254095 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.253929    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/257ffad7-4df8-4e0f-950a-46227cfb255c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-w2ff7\" (UID: \"257ffad7-4df8-4e0f-950a-46227cfb255c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-w2ff7"
Jul 08 03:07:56.254313 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.254297    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/257ffad7-4df8-4e0f-950a-46227cfb255c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-w2ff7\" (UID: \"257ffad7-4df8-4e0f-950a-46227cfb255c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-w2ff7"
Jul 08 03:07:56.263581 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.263550    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp59p\" (UniqueName: \"kubernetes.io/projected/257ffad7-4df8-4e0f-950a-46227cfb255c-kube-api-access-qp59p\") pod \"kuadrant-operator-controller-manager-55467d9f7-w2ff7\" (UID: \"257ffad7-4df8-4e0f-950a-46227cfb255c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-w2ff7"
Jul 08 03:07:56.442527 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.442439    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-w2ff7"
Jul 08 03:07:56.442669 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.442439    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk"
Jul 08 03:07:56.449482 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.449456    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-w2ff7"
Jul 08 03:07:56.452191 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.452175    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk"
Jul 08 03:07:56.468606 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:07:56.468578    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-766wk\" is forbidden: User \"system:node:ip-10-0-129-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-199.ec2.internal' and this object" podUID="d9125c30-6075-4c19-8097-49c1802b60b6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk"
Jul 08 03:07:56.556192 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.556159    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/257ffad7-4df8-4e0f-950a-46227cfb255c-extensions-socket-volume\") pod \"257ffad7-4df8-4e0f-950a-46227cfb255c\" (UID: \"257ffad7-4df8-4e0f-950a-46227cfb255c\") "
Jul 08 03:07:56.556333 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.556217    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qp59p\" (UniqueName: \"kubernetes.io/projected/257ffad7-4df8-4e0f-950a-46227cfb255c-kube-api-access-qp59p\") pod \"257ffad7-4df8-4e0f-950a-46227cfb255c\" (UID: \"257ffad7-4df8-4e0f-950a-46227cfb255c\") "
Jul 08 03:07:56.556333 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.556267    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9125c30-6075-4c19-8097-49c1802b60b6-extensions-socket-volume\") pod \"d9125c30-6075-4c19-8097-49c1802b60b6\" (UID: \"d9125c30-6075-4c19-8097-49c1802b60b6\") "
Jul 08 03:07:56.556401 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.556390    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qm7f\" (UniqueName: \"kubernetes.io/projected/d9125c30-6075-4c19-8097-49c1802b60b6-kube-api-access-4qm7f\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:07:56.556479 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.556451    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/257ffad7-4df8-4e0f-950a-46227cfb255c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "257ffad7-4df8-4e0f-950a-46227cfb255c" (UID: "257ffad7-4df8-4e0f-950a-46227cfb255c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:07:56.556568 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.556554    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9125c30-6075-4c19-8097-49c1802b60b6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d9125c30-6075-4c19-8097-49c1802b60b6" (UID: "d9125c30-6075-4c19-8097-49c1802b60b6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:07:56.558482 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.558457    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/257ffad7-4df8-4e0f-950a-46227cfb255c-kube-api-access-qp59p" (OuterVolumeSpecName: "kube-api-access-qp59p") pod "257ffad7-4df8-4e0f-950a-46227cfb255c" (UID: "257ffad7-4df8-4e0f-950a-46227cfb255c"). InnerVolumeSpecName "kube-api-access-qp59p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:07:56.657099 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.657069    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp59p\" (UniqueName: \"kubernetes.io/projected/257ffad7-4df8-4e0f-950a-46227cfb255c-kube-api-access-qp59p\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:07:56.657099 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.657098    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9125c30-6075-4c19-8097-49c1802b60b6-extensions-socket-volume\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:07:56.657281 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:56.657111    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/257ffad7-4df8-4e0f-950a-46227cfb255c-extensions-socket-volume\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:07:57.446457 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:57.446428    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-w2ff7"
Jul 08 03:07:57.446914 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:57.446430    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk"
Jul 08 03:07:57.452983 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:07:57.452956    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-766wk\" is forbidden: User \"system:node:ip-10-0-129-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-199.ec2.internal' and this object" podUID="d9125c30-6075-4c19-8097-49c1802b60b6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk"
Jul 08 03:07:57.458290 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:07:57.458265    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-766wk\" is forbidden: User \"system:node:ip-10-0-129-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-199.ec2.internal' and this object" podUID="d9125c30-6075-4c19-8097-49c1802b60b6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk"
Jul 08 03:07:57.459876 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:07:57.459854    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-766wk\" is forbidden: User \"system:node:ip-10-0-129-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-199.ec2.internal' and this object" podUID="d9125c30-6075-4c19-8097-49c1802b60b6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-766wk"
Jul 08 03:07:57.493341 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:57.493317    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-w2ff7"]
Jul 08 03:07:57.500524 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:57.500505    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-w2ff7"]
Jul 08 03:07:58.162467 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:58.162433    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="257ffad7-4df8-4e0f-950a-46227cfb255c" path="/var/lib/kubelet/pods/257ffad7-4df8-4e0f-950a-46227cfb255c/volumes"
Jul 08 03:07:58.162681 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:07:58.162669    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9125c30-6075-4c19-8097-49c1802b60b6" path="/var/lib/kubelet/pods/d9125c30-6075-4c19-8097-49c1802b60b6/volumes"
Jul 08 03:08:27.433617 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:27.433584    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lc57f"]
Jul 08 03:08:27.437391 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:27.437348    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lc57f"
Jul 08 03:08:27.444231 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:27.444209    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 03:08:27.444364 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:27.444264    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hqzwg\""
Jul 08 03:08:27.444428 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:27.444396    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 03:08:27.444710 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:27.444687    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 03:08:27.458835 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:27.458807    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lc57f"]
Jul 08 03:08:27.498070 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:27.498040    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lc57f"]
Jul 08 03:08:27.511359 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:27.511333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/12752c31-e2a4-4e85-b274-6bfd0a5103b3-config-file\") pod \"limitador-limitador-64c94fd64f-lc57f\" (UID: \"12752c31-e2a4-4e85-b274-6bfd0a5103b3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lc57f"
Jul 08 03:08:27.511515 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:27.511414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzpzz\" (UniqueName: \"kubernetes.io/projected/12752c31-e2a4-4e85-b274-6bfd0a5103b3-kube-api-access-tzpzz\") pod \"limitador-limitador-64c94fd64f-lc57f\" (UID: \"12752c31-e2a4-4e85-b274-6bfd0a5103b3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lc57f"
Jul 08 03:08:27.612098 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:27.612067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzpzz\" (UniqueName: \"kubernetes.io/projected/12752c31-e2a4-4e85-b274-6bfd0a5103b3-kube-api-access-tzpzz\") pod \"limitador-limitador-64c94fd64f-lc57f\" (UID: \"12752c31-e2a4-4e85-b274-6bfd0a5103b3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lc57f"
Jul 08 03:08:27.612280 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:27.612117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/12752c31-e2a4-4e85-b274-6bfd0a5103b3-config-file\") pod \"limitador-limitador-64c94fd64f-lc57f\" (UID: \"12752c31-e2a4-4e85-b274-6bfd0a5103b3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lc57f"
Jul 08 03:08:27.612757 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:27.612716    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/12752c31-e2a4-4e85-b274-6bfd0a5103b3-config-file\") pod \"limitador-limitador-64c94fd64f-lc57f\" (UID: \"12752c31-e2a4-4e85-b274-6bfd0a5103b3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lc57f"
Jul 08 03:08:27.620030 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:27.619999    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzpzz\" (UniqueName: \"kubernetes.io/projected/12752c31-e2a4-4e85-b274-6bfd0a5103b3-kube-api-access-tzpzz\") pod \"limitador-limitador-64c94fd64f-lc57f\" (UID: \"12752c31-e2a4-4e85-b274-6bfd0a5103b3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lc57f"
Jul 08 03:08:27.755699 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:27.755614    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lc57f"
Jul 08 03:08:27.884470 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:27.884445    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lc57f"]
Jul 08 03:08:27.886973 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:08:27.886946    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12752c31_e2a4_4e85_b274_6bfd0a5103b3.slice/crio-726757003cb0f5b067e7e6f58ec892c1d90504ff04b6ae086ff45e4f465a0839 WatchSource:0}: Error finding container 726757003cb0f5b067e7e6f58ec892c1d90504ff04b6ae086ff45e4f465a0839: Status 404 returned error can't find the container with id 726757003cb0f5b067e7e6f58ec892c1d90504ff04b6ae086ff45e4f465a0839
Jul 08 03:08:28.458921 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:28.458886    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-n7bb6"]
Jul 08 03:08:28.461822 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:28.461805    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n7bb6"
Jul 08 03:08:28.465135 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:28.465111    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pptkn\""
Jul 08 03:08:28.469012 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:28.468979    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n7bb6"]
Jul 08 03:08:28.520858 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:28.520831    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts2zn\" (UniqueName: \"kubernetes.io/projected/707bfa8b-a969-466d-b57b-746cb05ac920-kube-api-access-ts2zn\") pod \"authorino-75d556bd77-n7bb6\" (UID: \"707bfa8b-a969-466d-b57b-746cb05ac920\") " pod="kuadrant-system/authorino-75d556bd77-n7bb6"
Jul 08 03:08:28.593119 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:28.593086    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lc57f" event={"ID":"12752c31-e2a4-4e85-b274-6bfd0a5103b3","Type":"ContainerStarted","Data":"726757003cb0f5b067e7e6f58ec892c1d90504ff04b6ae086ff45e4f465a0839"}
Jul 08 03:08:28.622270 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:28.622237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts2zn\" (UniqueName: \"kubernetes.io/projected/707bfa8b-a969-466d-b57b-746cb05ac920-kube-api-access-ts2zn\") pod \"authorino-75d556bd77-n7bb6\" (UID: \"707bfa8b-a969-466d-b57b-746cb05ac920\") " pod="kuadrant-system/authorino-75d556bd77-n7bb6"
Jul 08 03:08:28.632001 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:28.631967    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts2zn\" (UniqueName: \"kubernetes.io/projected/707bfa8b-a969-466d-b57b-746cb05ac920-kube-api-access-ts2zn\") pod \"authorino-75d556bd77-n7bb6\" (UID: \"707bfa8b-a969-466d-b57b-746cb05ac920\") " pod="kuadrant-system/authorino-75d556bd77-n7bb6"
Jul 08 03:08:28.771780 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:28.771684    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n7bb6"
Jul 08 03:08:28.950905 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:28.950876    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n7bb6"]
Jul 08 03:08:28.953608 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:08:28.953573    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod707bfa8b_a969_466d_b57b_746cb05ac920.slice/crio-21e5d3986c77d5fd4a4e5c9a205b1231b6c2c98e86e1e28208b3662ba95e3843 WatchSource:0}: Error finding container 21e5d3986c77d5fd4a4e5c9a205b1231b6c2c98e86e1e28208b3662ba95e3843: Status 404 returned error can't find the container with id 21e5d3986c77d5fd4a4e5c9a205b1231b6c2c98e86e1e28208b3662ba95e3843
Jul 08 03:08:29.599867 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:29.599826    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n7bb6" event={"ID":"707bfa8b-a969-466d-b57b-746cb05ac920","Type":"ContainerStarted","Data":"21e5d3986c77d5fd4a4e5c9a205b1231b6c2c98e86e1e28208b3662ba95e3843"}
Jul 08 03:08:31.615727 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:31.615677    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lc57f" event={"ID":"12752c31-e2a4-4e85-b274-6bfd0a5103b3","Type":"ContainerStarted","Data":"3afb36d5565656b91d6011d149446a7ba46a0bbc903b61255bf3d5d23fbf55f4"}
Jul 08 03:08:31.616192 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:31.615827    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lc57f"
Jul 08 03:08:31.636340 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:31.636278    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-lc57f" podStartSLOduration=1.745228859 podStartE2EDuration="4.636258561s" totalImagesPullingTime="2.891029702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:08:31.634450733 +0000 UTC m=+595.946729268" watchObservedRunningTime="2026-07-08 03:08:31.636258561 +0000 UTC m=+595.948537128"
Jul 08 03:08:33.626303 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:33.626268    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n7bb6" event={"ID":"707bfa8b-a969-466d-b57b-746cb05ac920","Type":"ContainerStarted","Data":"56f50daa6ac7cea8b27c2a66e9fe15b5f190e982b47c9e4b9b52d9c1be4587b1"}
Jul 08 03:08:33.641238 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:33.641189    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-n7bb6" podStartSLOduration=1.952399136 podStartE2EDuration="5.641165744s" totalImagesPullingTime="3.688766608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:08:33.639609479 +0000 UTC m=+597.951888016" watchObservedRunningTime="2026-07-08 03:08:33.641165744 +0000 UTC m=+597.953444277"
Jul 08 03:08:42.606425 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:42.606385    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lc57f"]
Jul 08 03:08:42.606957 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:42.606622    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-lc57f" podUID="12752c31-e2a4-4e85-b274-6bfd0a5103b3" containerName="limitador" containerID="cri-o://3afb36d5565656b91d6011d149446a7ba46a0bbc903b61255bf3d5d23fbf55f4" gracePeriod=30
Jul 08 03:08:42.607374 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:42.607356    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lc57f"
Jul 08 03:08:43.145321 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:43.145296    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lc57f"
Jul 08 03:08:43.250248 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:43.250176    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzpzz\" (UniqueName: \"kubernetes.io/projected/12752c31-e2a4-4e85-b274-6bfd0a5103b3-kube-api-access-tzpzz\") pod \"12752c31-e2a4-4e85-b274-6bfd0a5103b3\" (UID: \"12752c31-e2a4-4e85-b274-6bfd0a5103b3\") "
Jul 08 03:08:43.250248 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:43.250214    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/12752c31-e2a4-4e85-b274-6bfd0a5103b3-config-file\") pod \"12752c31-e2a4-4e85-b274-6bfd0a5103b3\" (UID: \"12752c31-e2a4-4e85-b274-6bfd0a5103b3\") "
Jul 08 03:08:43.250563 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:43.250541    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12752c31-e2a4-4e85-b274-6bfd0a5103b3-config-file" (OuterVolumeSpecName: "config-file") pod "12752c31-e2a4-4e85-b274-6bfd0a5103b3" (UID: "12752c31-e2a4-4e85-b274-6bfd0a5103b3"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:08:43.252353 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:43.252326    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12752c31-e2a4-4e85-b274-6bfd0a5103b3-kube-api-access-tzpzz" (OuterVolumeSpecName: "kube-api-access-tzpzz") pod "12752c31-e2a4-4e85-b274-6bfd0a5103b3" (UID: "12752c31-e2a4-4e85-b274-6bfd0a5103b3"). InnerVolumeSpecName "kube-api-access-tzpzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:08:43.351037 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:43.351006    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzpzz\" (UniqueName: \"kubernetes.io/projected/12752c31-e2a4-4e85-b274-6bfd0a5103b3-kube-api-access-tzpzz\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:08:43.351037 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:43.351033    2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/12752c31-e2a4-4e85-b274-6bfd0a5103b3-config-file\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:08:43.670578 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:43.670545    2578 generic.go:356] "Generic (PLEG): container finished" podID="12752c31-e2a4-4e85-b274-6bfd0a5103b3" containerID="3afb36d5565656b91d6011d149446a7ba46a0bbc903b61255bf3d5d23fbf55f4" exitCode=0
Jul 08 03:08:43.670994 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:43.670591    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lc57f"
Jul 08 03:08:43.670994 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:43.670636    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lc57f" event={"ID":"12752c31-e2a4-4e85-b274-6bfd0a5103b3","Type":"ContainerDied","Data":"3afb36d5565656b91d6011d149446a7ba46a0bbc903b61255bf3d5d23fbf55f4"}
Jul 08 03:08:43.670994 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:43.670686    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lc57f" event={"ID":"12752c31-e2a4-4e85-b274-6bfd0a5103b3","Type":"ContainerDied","Data":"726757003cb0f5b067e7e6f58ec892c1d90504ff04b6ae086ff45e4f465a0839"}
Jul 08 03:08:43.670994 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:43.670708    2578 scope.go:117] "RemoveContainer" containerID="3afb36d5565656b91d6011d149446a7ba46a0bbc903b61255bf3d5d23fbf55f4"
Jul 08 03:08:43.679635 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:43.679621    2578 scope.go:117] "RemoveContainer" containerID="3afb36d5565656b91d6011d149446a7ba46a0bbc903b61255bf3d5d23fbf55f4"
Jul 08 03:08:43.679904 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:08:43.679889    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3afb36d5565656b91d6011d149446a7ba46a0bbc903b61255bf3d5d23fbf55f4\": container with ID starting with 3afb36d5565656b91d6011d149446a7ba46a0bbc903b61255bf3d5d23fbf55f4 not found: ID does not exist" containerID="3afb36d5565656b91d6011d149446a7ba46a0bbc903b61255bf3d5d23fbf55f4"
Jul 08 03:08:43.679956 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:43.679910    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3afb36d5565656b91d6011d149446a7ba46a0bbc903b61255bf3d5d23fbf55f4"} err="failed to get container status \"3afb36d5565656b91d6011d149446a7ba46a0bbc903b61255bf3d5d23fbf55f4\": rpc error: code = NotFound desc = could not find container \"3afb36d5565656b91d6011d149446a7ba46a0bbc903b61255bf3d5d23fbf55f4\": container with ID starting with 3afb36d5565656b91d6011d149446a7ba46a0bbc903b61255bf3d5d23fbf55f4 not found: ID does not exist"
Jul 08 03:08:43.690668 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:43.690643    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lc57f"]
Jul 08 03:08:43.694003 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:43.693981    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lc57f"]
Jul 08 03:08:44.162481 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:44.162450    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12752c31-e2a4-4e85-b274-6bfd0a5103b3" path="/var/lib/kubelet/pods/12752c31-e2a4-4e85-b274-6bfd0a5103b3/volumes"
Jul 08 03:08:48.969416 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:48.969381    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tz85v"]
Jul 08 03:08:48.969830 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:48.969814    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12752c31-e2a4-4e85-b274-6bfd0a5103b3" containerName="limitador"
Jul 08 03:08:48.969879 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:48.969834    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="12752c31-e2a4-4e85-b274-6bfd0a5103b3" containerName="limitador"
Jul 08 03:08:48.969936 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:48.969924    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="12752c31-e2a4-4e85-b274-6bfd0a5103b3" containerName="limitador"
Jul 08 03:08:48.976395 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:48.976370    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tz85v"
Jul 08 03:08:48.978408 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:48.978384    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tz85v"]
Jul 08 03:08:48.978786 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:48.978768    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 03:08:48.978916 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:48.978891    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 08 03:08:48.979039 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:48.978940    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 03:08:48.979433 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:48.979417    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-2qkx9\""
Jul 08 03:08:49.098852 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:49.098816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsvkd\" (UniqueName: \"kubernetes.io/projected/37c77c11-dd26-4fda-8d24-446e2b49d694-kube-api-access-nsvkd\") pod \"postgres-69fb4594cf-tz85v\" (UID: \"37c77c11-dd26-4fda-8d24-446e2b49d694\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tz85v"
Jul 08 03:08:49.098852 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:49.098854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/37c77c11-dd26-4fda-8d24-446e2b49d694-data\") pod \"postgres-69fb4594cf-tz85v\" (UID: \"37c77c11-dd26-4fda-8d24-446e2b49d694\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tz85v"
Jul 08 03:08:49.200021 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:49.199985    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsvkd\" (UniqueName: \"kubernetes.io/projected/37c77c11-dd26-4fda-8d24-446e2b49d694-kube-api-access-nsvkd\") pod \"postgres-69fb4594cf-tz85v\" (UID: \"37c77c11-dd26-4fda-8d24-446e2b49d694\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tz85v"
Jul 08 03:08:49.200021 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:49.200023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/37c77c11-dd26-4fda-8d24-446e2b49d694-data\") pod \"postgres-69fb4594cf-tz85v\" (UID: \"37c77c11-dd26-4fda-8d24-446e2b49d694\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tz85v"
Jul 08 03:08:49.200330 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:49.200314    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/37c77c11-dd26-4fda-8d24-446e2b49d694-data\") pod \"postgres-69fb4594cf-tz85v\" (UID: \"37c77c11-dd26-4fda-8d24-446e2b49d694\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tz85v"
Jul 08 03:08:49.208683 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:49.208651    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsvkd\" (UniqueName: \"kubernetes.io/projected/37c77c11-dd26-4fda-8d24-446e2b49d694-kube-api-access-nsvkd\") pod \"postgres-69fb4594cf-tz85v\" (UID: \"37c77c11-dd26-4fda-8d24-446e2b49d694\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tz85v"
Jul 08 03:08:49.287235 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:49.287159    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tz85v"
Jul 08 03:08:49.415757 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:49.415721    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tz85v"]
Jul 08 03:08:49.417615 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:08:49.417582    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c77c11_dd26_4fda_8d24_446e2b49d694.slice/crio-774fa8a1292a70dfc4c8f60e6cb85027fd07dc7de6ed19abbe0c2b45a9dc71d1 WatchSource:0}: Error finding container 774fa8a1292a70dfc4c8f60e6cb85027fd07dc7de6ed19abbe0c2b45a9dc71d1: Status 404 returned error can't find the container with id 774fa8a1292a70dfc4c8f60e6cb85027fd07dc7de6ed19abbe0c2b45a9dc71d1
Jul 08 03:08:49.701468 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:49.701433    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tz85v" event={"ID":"37c77c11-dd26-4fda-8d24-446e2b49d694","Type":"ContainerStarted","Data":"774fa8a1292a70dfc4c8f60e6cb85027fd07dc7de6ed19abbe0c2b45a9dc71d1"}
Jul 08 03:08:55.741186 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:55.741139    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tz85v" event={"ID":"37c77c11-dd26-4fda-8d24-446e2b49d694","Type":"ContainerStarted","Data":"d58706231268bd9885212b574f4cda9344fdfc8d9b45a797fa233ec03b09216a"}
Jul 08 03:08:55.741649 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:55.741255    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tz85v"
Jul 08 03:08:55.758500 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:08:55.758458    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tz85v" podStartSLOduration=2.046351041 podStartE2EDuration="7.758443945s" totalImagesPullingTime="5.712092904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:08:55.756058863 +0000 UTC m=+620.068337398" watchObservedRunningTime="2026-07-08 03:08:55.758443945 +0000 UTC m=+620.070722478"
Jul 08 03:09:01.777438 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:01.777361    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tz85v"
Jul 08 03:09:02.601458 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:02.601426    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c79dbb558-54f7l"]
Jul 08 03:09:02.604776 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:02.604735    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c79dbb558-54f7l"
Jul 08 03:09:02.609503 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:02.609477    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl6mf\" (UniqueName: \"kubernetes.io/projected/a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242-kube-api-access-pl6mf\") pod \"authorino-c79dbb558-54f7l\" (UID: \"a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242\") " pod="kuadrant-system/authorino-c79dbb558-54f7l"
Jul 08 03:09:02.612421 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:02.612399    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c79dbb558-54f7l"]
Jul 08 03:09:02.710413 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:02.710373    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl6mf\" (UniqueName: \"kubernetes.io/projected/a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242-kube-api-access-pl6mf\") pod \"authorino-c79dbb558-54f7l\" (UID: \"a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242\") " pod="kuadrant-system/authorino-c79dbb558-54f7l"
Jul 08 03:09:02.719912 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:02.719882    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl6mf\" (UniqueName: \"kubernetes.io/projected/a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242-kube-api-access-pl6mf\") pod \"authorino-c79dbb558-54f7l\" (UID: \"a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242\") " pod="kuadrant-system/authorino-c79dbb558-54f7l"
Jul 08 03:09:02.786784 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:02.786735    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c79dbb558-54f7l"]
Jul 08 03:09:02.787187 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:02.786993    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c79dbb558-54f7l"
Jul 08 03:09:02.924628 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:02.924601    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c79dbb558-54f7l"]
Jul 08 03:09:02.926786 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:09:02.926718    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3b6a3c2_766d_4cbc_b28c_7bf2c0c65242.slice/crio-1a3b067e089f46eaff850622f240ce11ed0fa91cd64560c1c9a4c4588a5fafed WatchSource:0}: Error finding container 1a3b067e089f46eaff850622f240ce11ed0fa91cd64560c1c9a4c4588a5fafed: Status 404 returned error can't find the container with id 1a3b067e089f46eaff850622f240ce11ed0fa91cd64560c1c9a4c4588a5fafed
Jul 08 03:09:03.781693 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:03.781660    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c79dbb558-54f7l" event={"ID":"a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242","Type":"ContainerStarted","Data":"d0f68c2b85f7fb5dce849d538ca15f9812531e68a16e74a5e7dbec3670af28d6"}
Jul 08 03:09:03.781920 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:03.781702    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c79dbb558-54f7l" event={"ID":"a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242","Type":"ContainerStarted","Data":"1a3b067e089f46eaff850622f240ce11ed0fa91cd64560c1c9a4c4588a5fafed"}
Jul 08 03:09:03.781920 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:03.781732    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-c79dbb558-54f7l" podUID="a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242" containerName="authorino" containerID="cri-o://d0f68c2b85f7fb5dce849d538ca15f9812531e68a16e74a5e7dbec3670af28d6" gracePeriod=30
Jul 08 03:09:03.798422 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:03.798370    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c79dbb558-54f7l" podStartSLOduration=1.446912615 podStartE2EDuration="1.798352377s" totalImagesPullingTime="351.439762ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:09:03.797027294 +0000 UTC m=+628.109305831" watchObservedRunningTime="2026-07-08 03:09:03.798352377 +0000 UTC m=+628.110630907"
Jul 08 03:09:04.036866 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.036800    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c79dbb558-54f7l"
Jul 08 03:09:04.119347 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.119300    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl6mf\" (UniqueName: \"kubernetes.io/projected/a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242-kube-api-access-pl6mf\") pod \"a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242\" (UID: \"a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242\") "
Jul 08 03:09:04.121513 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.121475    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242-kube-api-access-pl6mf" (OuterVolumeSpecName: "kube-api-access-pl6mf") pod "a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242" (UID: "a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242"). InnerVolumeSpecName "kube-api-access-pl6mf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:09:04.219896 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.219862    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl6mf\" (UniqueName: \"kubernetes.io/projected/a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242-kube-api-access-pl6mf\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:09:04.538649 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.538612    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n7bb6"]
Jul 08 03:09:04.538840 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.538818    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-n7bb6" podUID="707bfa8b-a969-466d-b57b-746cb05ac920" containerName="authorino" containerID="cri-o://56f50daa6ac7cea8b27c2a66e9fe15b5f190e982b47c9e4b9b52d9c1be4587b1" gracePeriod=30
Jul 08 03:09:04.777533 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.777508    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n7bb6"
Jul 08 03:09:04.787304 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.787277    2578 generic.go:356] "Generic (PLEG): container finished" podID="707bfa8b-a969-466d-b57b-746cb05ac920" containerID="56f50daa6ac7cea8b27c2a66e9fe15b5f190e982b47c9e4b9b52d9c1be4587b1" exitCode=0
Jul 08 03:09:04.787461 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.787320    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n7bb6"
Jul 08 03:09:04.787461 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.787357    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n7bb6" event={"ID":"707bfa8b-a969-466d-b57b-746cb05ac920","Type":"ContainerDied","Data":"56f50daa6ac7cea8b27c2a66e9fe15b5f190e982b47c9e4b9b52d9c1be4587b1"}
Jul 08 03:09:04.787461 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.787391    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n7bb6" event={"ID":"707bfa8b-a969-466d-b57b-746cb05ac920","Type":"ContainerDied","Data":"21e5d3986c77d5fd4a4e5c9a205b1231b6c2c98e86e1e28208b3662ba95e3843"}
Jul 08 03:09:04.787461 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.787413    2578 scope.go:117] "RemoveContainer" containerID="56f50daa6ac7cea8b27c2a66e9fe15b5f190e982b47c9e4b9b52d9c1be4587b1"
Jul 08 03:09:04.788519 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.788498    2578 generic.go:356] "Generic (PLEG): container finished" podID="a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242" containerID="d0f68c2b85f7fb5dce849d538ca15f9812531e68a16e74a5e7dbec3670af28d6" exitCode=0
Jul 08 03:09:04.788586 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.788531    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c79dbb558-54f7l"
Jul 08 03:09:04.788586 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.788553    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c79dbb558-54f7l" event={"ID":"a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242","Type":"ContainerDied","Data":"d0f68c2b85f7fb5dce849d538ca15f9812531e68a16e74a5e7dbec3670af28d6"}
Jul 08 03:09:04.788679 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.788582    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c79dbb558-54f7l" event={"ID":"a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242","Type":"ContainerDied","Data":"1a3b067e089f46eaff850622f240ce11ed0fa91cd64560c1c9a4c4588a5fafed"}
Jul 08 03:09:04.804333 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.804316    2578 scope.go:117] "RemoveContainer" containerID="56f50daa6ac7cea8b27c2a66e9fe15b5f190e982b47c9e4b9b52d9c1be4587b1"
Jul 08 03:09:04.804695 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:09:04.804676    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56f50daa6ac7cea8b27c2a66e9fe15b5f190e982b47c9e4b9b52d9c1be4587b1\": container with ID starting with 56f50daa6ac7cea8b27c2a66e9fe15b5f190e982b47c9e4b9b52d9c1be4587b1 not found: ID does not exist" containerID="56f50daa6ac7cea8b27c2a66e9fe15b5f190e982b47c9e4b9b52d9c1be4587b1"
Jul 08 03:09:04.804770 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.804706    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56f50daa6ac7cea8b27c2a66e9fe15b5f190e982b47c9e4b9b52d9c1be4587b1"} err="failed to get container status \"56f50daa6ac7cea8b27c2a66e9fe15b5f190e982b47c9e4b9b52d9c1be4587b1\": rpc error: code = NotFound desc = could not find container \"56f50daa6ac7cea8b27c2a66e9fe15b5f190e982b47c9e4b9b52d9c1be4587b1\": container with ID starting with 56f50daa6ac7cea8b27c2a66e9fe15b5f190e982b47c9e4b9b52d9c1be4587b1 not found: ID does not exist"
Jul 08 03:09:04.804770 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.804725    2578 scope.go:117] "RemoveContainer" containerID="d0f68c2b85f7fb5dce849d538ca15f9812531e68a16e74a5e7dbec3670af28d6"
Jul 08 03:09:04.812280 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.812253    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c79dbb558-54f7l"]
Jul 08 03:09:04.817265 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.817244    2578 scope.go:117] "RemoveContainer" containerID="d0f68c2b85f7fb5dce849d538ca15f9812531e68a16e74a5e7dbec3670af28d6"
Jul 08 03:09:04.817557 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:09:04.817533    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0f68c2b85f7fb5dce849d538ca15f9812531e68a16e74a5e7dbec3670af28d6\": container with ID starting with d0f68c2b85f7fb5dce849d538ca15f9812531e68a16e74a5e7dbec3670af28d6 not found: ID does not exist" containerID="d0f68c2b85f7fb5dce849d538ca15f9812531e68a16e74a5e7dbec3670af28d6"
Jul 08 03:09:04.817640 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.817564    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0f68c2b85f7fb5dce849d538ca15f9812531e68a16e74a5e7dbec3670af28d6"} err="failed to get container status \"d0f68c2b85f7fb5dce849d538ca15f9812531e68a16e74a5e7dbec3670af28d6\": rpc error: code = NotFound desc = could not find container \"d0f68c2b85f7fb5dce849d538ca15f9812531e68a16e74a5e7dbec3670af28d6\": container with ID starting with d0f68c2b85f7fb5dce849d538ca15f9812531e68a16e74a5e7dbec3670af28d6 not found: ID does not exist"
Jul 08 03:09:04.818970 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.818951    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c79dbb558-54f7l"]
Jul 08 03:09:04.822895 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.822878    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts2zn\" (UniqueName: \"kubernetes.io/projected/707bfa8b-a969-466d-b57b-746cb05ac920-kube-api-access-ts2zn\") pod \"707bfa8b-a969-466d-b57b-746cb05ac920\" (UID: \"707bfa8b-a969-466d-b57b-746cb05ac920\") "
Jul 08 03:09:04.825045 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.825025    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/707bfa8b-a969-466d-b57b-746cb05ac920-kube-api-access-ts2zn" (OuterVolumeSpecName: "kube-api-access-ts2zn") pod "707bfa8b-a969-466d-b57b-746cb05ac920" (UID: "707bfa8b-a969-466d-b57b-746cb05ac920"). InnerVolumeSpecName "kube-api-access-ts2zn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:09:04.923484 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:04.923451    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts2zn\" (UniqueName: \"kubernetes.io/projected/707bfa8b-a969-466d-b57b-746cb05ac920-kube-api-access-ts2zn\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:09:05.106863 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:05.106832    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n7bb6"]
Jul 08 03:09:05.111459 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:05.111435    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n7bb6"]
Jul 08 03:09:06.162676 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:06.162645    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="707bfa8b-a969-466d-b57b-746cb05ac920" path="/var/lib/kubelet/pods/707bfa8b-a969-466d-b57b-746cb05ac920/volumes"
Jul 08 03:09:06.163053 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:06.162997    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242" path="/var/lib/kubelet/pods/a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242/volumes"
Jul 08 03:09:08.734600 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.734561    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f7768d9d9-54lvq"]
Jul 08 03:09:08.735099 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.735009    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242" containerName="authorino"
Jul 08 03:09:08.735099 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.735027    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242" containerName="authorino"
Jul 08 03:09:08.735099 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.735044    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707bfa8b-a969-466d-b57b-746cb05ac920" containerName="authorino"
Jul 08 03:09:08.735099 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.735053    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="707bfa8b-a969-466d-b57b-746cb05ac920" containerName="authorino"
Jul 08 03:09:08.735296 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.735132    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="707bfa8b-a969-466d-b57b-746cb05ac920" containerName="authorino"
Jul 08 03:09:08.735296 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.735144    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3b6a3c2-766d-4cbc-b28c-7bf2c0c65242" containerName="authorino"
Jul 08 03:09:08.739511 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.739490    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f7768d9d9-54lvq"
Jul 08 03:09:08.742028 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.742004    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 03:09:08.742028 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.742024    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 03:09:08.742188 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.742007    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lm9mt\""
Jul 08 03:09:08.752129 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.752104    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f7768d9d9-54lvq"]
Jul 08 03:09:08.757693 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.757663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4v5h\" (UniqueName: \"kubernetes.io/projected/94c4c985-a2eb-4351-bdbf-56bcab52ca03-kube-api-access-k4v5h\") pod \"maas-controller-6f7768d9d9-54lvq\" (UID: \"94c4c985-a2eb-4351-bdbf-56bcab52ca03\") " pod="opendatahub/maas-controller-6f7768d9d9-54lvq"
Jul 08 03:09:08.757808 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.757736    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94c4c985-a2eb-4351-bdbf-56bcab52ca03-service-ca\") pod \"maas-controller-6f7768d9d9-54lvq\" (UID: \"94c4c985-a2eb-4351-bdbf-56bcab52ca03\") " pod="opendatahub/maas-controller-6f7768d9d9-54lvq"
Jul 08 03:09:08.757808 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.757796    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94c4c985-a2eb-4351-bdbf-56bcab52ca03-webhook-cert\") pod \"maas-controller-6f7768d9d9-54lvq\" (UID: \"94c4c985-a2eb-4351-bdbf-56bcab52ca03\") " pod="opendatahub/maas-controller-6f7768d9d9-54lvq"
Jul 08 03:09:08.858296 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.858263    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94c4c985-a2eb-4351-bdbf-56bcab52ca03-service-ca\") pod \"maas-controller-6f7768d9d9-54lvq\" (UID: \"94c4c985-a2eb-4351-bdbf-56bcab52ca03\") " pod="opendatahub/maas-controller-6f7768d9d9-54lvq"
Jul 08 03:09:08.858508 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.858306    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94c4c985-a2eb-4351-bdbf-56bcab52ca03-webhook-cert\") pod \"maas-controller-6f7768d9d9-54lvq\" (UID: \"94c4c985-a2eb-4351-bdbf-56bcab52ca03\") " pod="opendatahub/maas-controller-6f7768d9d9-54lvq"
Jul 08 03:09:08.858508 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.858329    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4v5h\" (UniqueName: \"kubernetes.io/projected/94c4c985-a2eb-4351-bdbf-56bcab52ca03-kube-api-access-k4v5h\") pod \"maas-controller-6f7768d9d9-54lvq\" (UID: \"94c4c985-a2eb-4351-bdbf-56bcab52ca03\") " pod="opendatahub/maas-controller-6f7768d9d9-54lvq"
Jul 08 03:09:08.858508 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:09:08.858458    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 08 03:09:08.858676 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:09:08.858523    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94c4c985-a2eb-4351-bdbf-56bcab52ca03-webhook-cert podName:94c4c985-a2eb-4351-bdbf-56bcab52ca03 nodeName:}" failed. No retries permitted until 2026-07-08 03:09:09.358502979 +0000 UTC m=+633.670781495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/94c4c985-a2eb-4351-bdbf-56bcab52ca03-webhook-cert") pod "maas-controller-6f7768d9d9-54lvq" (UID: "94c4c985-a2eb-4351-bdbf-56bcab52ca03") : secret "maas-controller-webhook-cert" not found
Jul 08 03:09:08.859105 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.859085    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94c4c985-a2eb-4351-bdbf-56bcab52ca03-service-ca\") pod \"maas-controller-6f7768d9d9-54lvq\" (UID: \"94c4c985-a2eb-4351-bdbf-56bcab52ca03\") " pod="opendatahub/maas-controller-6f7768d9d9-54lvq"
Jul 08 03:09:08.867317 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.867295    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4v5h\" (UniqueName: \"kubernetes.io/projected/94c4c985-a2eb-4351-bdbf-56bcab52ca03-kube-api-access-k4v5h\") pod \"maas-controller-6f7768d9d9-54lvq\" (UID: \"94c4c985-a2eb-4351-bdbf-56bcab52ca03\") " pod="opendatahub/maas-controller-6f7768d9d9-54lvq"
Jul 08 03:09:08.926982 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.926951    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d7d866b75-pdkfn"]
Jul 08 03:09:08.930345 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.930329    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d7d866b75-pdkfn"
Jul 08 03:09:08.940010 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.939985    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d7d866b75-pdkfn"]
Jul 08 03:09:08.958927 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.958905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-webhook-cert\") pod \"maas-controller-6d7d866b75-pdkfn\" (UID: \"a609b53e-e7d0-420b-8a9a-ad19f737d3fc\") " pod="opendatahub/maas-controller-6d7d866b75-pdkfn"
Jul 08 03:09:08.959048 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.958932    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjtzv\" (UniqueName: \"kubernetes.io/projected/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-kube-api-access-sjtzv\") pod \"maas-controller-6d7d866b75-pdkfn\" (UID: \"a609b53e-e7d0-420b-8a9a-ad19f737d3fc\") " pod="opendatahub/maas-controller-6d7d866b75-pdkfn"
Jul 08 03:09:08.959048 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:08.958981    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-service-ca\") pod \"maas-controller-6d7d866b75-pdkfn\" (UID: \"a609b53e-e7d0-420b-8a9a-ad19f737d3fc\") " pod="opendatahub/maas-controller-6d7d866b75-pdkfn"
Jul 08 03:09:09.060112 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:09.060077    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-webhook-cert\") pod \"maas-controller-6d7d866b75-pdkfn\" (UID: \"a609b53e-e7d0-420b-8a9a-ad19f737d3fc\") " pod="opendatahub/maas-controller-6d7d866b75-pdkfn"
Jul 08 03:09:09.060112 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:09.060110    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjtzv\" (UniqueName: \"kubernetes.io/projected/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-kube-api-access-sjtzv\") pod \"maas-controller-6d7d866b75-pdkfn\" (UID: \"a609b53e-e7d0-420b-8a9a-ad19f737d3fc\") " pod="opendatahub/maas-controller-6d7d866b75-pdkfn"
Jul 08 03:09:09.060322 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:09.060162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-service-ca\") pod \"maas-controller-6d7d866b75-pdkfn\" (UID: \"a609b53e-e7d0-420b-8a9a-ad19f737d3fc\") " pod="opendatahub/maas-controller-6d7d866b75-pdkfn"
Jul 08 03:09:09.060322 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:09:09.060230    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 08 03:09:09.060322 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:09:09.060301    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-webhook-cert podName:a609b53e-e7d0-420b-8a9a-ad19f737d3fc nodeName:}" failed. No retries permitted until 2026-07-08 03:09:09.560282905 +0000 UTC m=+633.872561419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-webhook-cert") pod "maas-controller-6d7d866b75-pdkfn" (UID: "a609b53e-e7d0-420b-8a9a-ad19f737d3fc") : secret "maas-controller-webhook-cert" not found
Jul 08 03:09:09.060805 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:09.060788    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-service-ca\") pod \"maas-controller-6d7d866b75-pdkfn\" (UID: \"a609b53e-e7d0-420b-8a9a-ad19f737d3fc\") " pod="opendatahub/maas-controller-6d7d866b75-pdkfn"
Jul 08 03:09:09.068417 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:09.068392    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjtzv\" (UniqueName: \"kubernetes.io/projected/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-kube-api-access-sjtzv\") pod \"maas-controller-6d7d866b75-pdkfn\" (UID: \"a609b53e-e7d0-420b-8a9a-ad19f737d3fc\") " pod="opendatahub/maas-controller-6d7d866b75-pdkfn"
Jul 08 03:09:09.363121 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:09.363028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94c4c985-a2eb-4351-bdbf-56bcab52ca03-webhook-cert\") pod \"maas-controller-6f7768d9d9-54lvq\" (UID: \"94c4c985-a2eb-4351-bdbf-56bcab52ca03\") " pod="opendatahub/maas-controller-6f7768d9d9-54lvq"
Jul 08 03:09:09.365625 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:09.365602    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94c4c985-a2eb-4351-bdbf-56bcab52ca03-webhook-cert\") pod \"maas-controller-6f7768d9d9-54lvq\" (UID: \"94c4c985-a2eb-4351-bdbf-56bcab52ca03\") " pod="opendatahub/maas-controller-6f7768d9d9-54lvq"
Jul 08 03:09:09.565387 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:09.565354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-webhook-cert\") pod \"maas-controller-6d7d866b75-pdkfn\" (UID: \"a609b53e-e7d0-420b-8a9a-ad19f737d3fc\") " pod="opendatahub/maas-controller-6d7d866b75-pdkfn"
Jul 08 03:09:09.567841 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:09.567813    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-webhook-cert\") pod \"maas-controller-6d7d866b75-pdkfn\" (UID: \"a609b53e-e7d0-420b-8a9a-ad19f737d3fc\") " pod="opendatahub/maas-controller-6d7d866b75-pdkfn"
Jul 08 03:09:09.649824 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:09.649722    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f7768d9d9-54lvq"
Jul 08 03:09:09.784205 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:09.784136    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f7768d9d9-54lvq"]
Jul 08 03:09:09.786387 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:09:09.786362    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c4c985_a2eb_4351_bdbf_56bcab52ca03.slice/crio-7a6d38e825d182070a436eded75da6e07e78f836f8eef64719a3942cd4fed478 WatchSource:0}: Error finding container 7a6d38e825d182070a436eded75da6e07e78f836f8eef64719a3942cd4fed478: Status 404 returned error can't find the container with id 7a6d38e825d182070a436eded75da6e07e78f836f8eef64719a3942cd4fed478
Jul 08 03:09:09.813877 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:09.813844    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f7768d9d9-54lvq" event={"ID":"94c4c985-a2eb-4351-bdbf-56bcab52ca03","Type":"ContainerStarted","Data":"7a6d38e825d182070a436eded75da6e07e78f836f8eef64719a3942cd4fed478"}
Jul 08 03:09:09.841079 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:09.841052    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d7d866b75-pdkfn"
Jul 08 03:09:09.977102 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:09.977074    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d7d866b75-pdkfn"]
Jul 08 03:09:09.978437 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:09:09.978410    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda609b53e_e7d0_420b_8a9a_ad19f737d3fc.slice/crio-69bf8b5d9375d998b1ba952b7fe196537ada9dbf9a95b3a8a0e632fac537eee9 WatchSource:0}: Error finding container 69bf8b5d9375d998b1ba952b7fe196537ada9dbf9a95b3a8a0e632fac537eee9: Status 404 returned error can't find the container with id 69bf8b5d9375d998b1ba952b7fe196537ada9dbf9a95b3a8a0e632fac537eee9
Jul 08 03:09:10.824460 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:10.824372    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d7d866b75-pdkfn" event={"ID":"a609b53e-e7d0-420b-8a9a-ad19f737d3fc","Type":"ContainerStarted","Data":"69bf8b5d9375d998b1ba952b7fe196537ada9dbf9a95b3a8a0e632fac537eee9"}
Jul 08 03:09:12.838484 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:12.838437    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f7768d9d9-54lvq" event={"ID":"94c4c985-a2eb-4351-bdbf-56bcab52ca03","Type":"ContainerStarted","Data":"ce23ddfc3fea27e434e5edf85129fc62695bbf4f8ffcf853cb4249ca34f6ea06"}
Jul 08 03:09:12.839056 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:12.838512    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f7768d9d9-54lvq"
Jul 08 03:09:12.840082 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:12.840055    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d7d866b75-pdkfn" event={"ID":"a609b53e-e7d0-420b-8a9a-ad19f737d3fc","Type":"ContainerStarted","Data":"e293e0dd37461b2b31a67f45a421ce09f0849f3357126dd8b8106eef53d38056"}
Jul 08 03:09:12.840196 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:12.840099    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d7d866b75-pdkfn"
Jul 08 03:09:12.860797 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:12.860734    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f7768d9d9-54lvq" podStartSLOduration=2.837668424 podStartE2EDuration="4.860718458s" totalImagesPullingTime="2.023050034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:09:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:09:12.859673589 +0000 UTC m=+637.171952124" watchObservedRunningTime="2026-07-08 03:09:12.860718458 +0000 UTC m=+637.172996991"
Jul 08 03:09:12.878397 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:12.878345    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d7d866b75-pdkfn" podStartSLOduration=3.036931656 podStartE2EDuration="4.878327222s" totalImagesPullingTime="1.841395566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:09:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:09:12.875973676 +0000 UTC m=+637.188252211" watchObservedRunningTime="2026-07-08 03:09:12.878327222 +0000 UTC m=+637.190605757"
Jul 08 03:09:23.851827 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:23.851800    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d7d866b75-pdkfn"
Jul 08 03:09:23.852210 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:23.851866    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f7768d9d9-54lvq"
Jul 08 03:09:23.915070 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:23.915032    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f7768d9d9-54lvq"]
Jul 08 03:09:23.915310 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:23.915260    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6f7768d9d9-54lvq" podUID="94c4c985-a2eb-4351-bdbf-56bcab52ca03" containerName="manager" containerID="cri-o://ce23ddfc3fea27e434e5edf85129fc62695bbf4f8ffcf853cb4249ca34f6ea06" gracePeriod=30
Jul 08 03:09:24.157974 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.157948    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f7768d9d9-54lvq"
Jul 08 03:09:24.290043 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.290012    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94c4c985-a2eb-4351-bdbf-56bcab52ca03-service-ca\") pod \"94c4c985-a2eb-4351-bdbf-56bcab52ca03\" (UID: \"94c4c985-a2eb-4351-bdbf-56bcab52ca03\") "
Jul 08 03:09:24.290043 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.290051    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94c4c985-a2eb-4351-bdbf-56bcab52ca03-webhook-cert\") pod \"94c4c985-a2eb-4351-bdbf-56bcab52ca03\" (UID: \"94c4c985-a2eb-4351-bdbf-56bcab52ca03\") "
Jul 08 03:09:24.290291 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.290101    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4v5h\" (UniqueName: \"kubernetes.io/projected/94c4c985-a2eb-4351-bdbf-56bcab52ca03-kube-api-access-k4v5h\") pod \"94c4c985-a2eb-4351-bdbf-56bcab52ca03\" (UID: \"94c4c985-a2eb-4351-bdbf-56bcab52ca03\") "
Jul 08 03:09:24.290384 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.290352    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94c4c985-a2eb-4351-bdbf-56bcab52ca03-service-ca" (OuterVolumeSpecName: "service-ca") pod "94c4c985-a2eb-4351-bdbf-56bcab52ca03" (UID: "94c4c985-a2eb-4351-bdbf-56bcab52ca03"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:09:24.292387 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.292356    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94c4c985-a2eb-4351-bdbf-56bcab52ca03-kube-api-access-k4v5h" (OuterVolumeSpecName: "kube-api-access-k4v5h") pod "94c4c985-a2eb-4351-bdbf-56bcab52ca03" (UID: "94c4c985-a2eb-4351-bdbf-56bcab52ca03"). InnerVolumeSpecName "kube-api-access-k4v5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:09:24.292387 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.292377    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94c4c985-a2eb-4351-bdbf-56bcab52ca03-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "94c4c985-a2eb-4351-bdbf-56bcab52ca03" (UID: "94c4c985-a2eb-4351-bdbf-56bcab52ca03"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:09:24.391024 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.390929    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94c4c985-a2eb-4351-bdbf-56bcab52ca03-service-ca\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:09:24.391024 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.390969    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94c4c985-a2eb-4351-bdbf-56bcab52ca03-webhook-cert\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:09:24.391024 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.390981    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4v5h\" (UniqueName: \"kubernetes.io/projected/94c4c985-a2eb-4351-bdbf-56bcab52ca03-kube-api-access-k4v5h\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:09:24.900648 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.900618    2578 generic.go:356] "Generic (PLEG): container finished" podID="94c4c985-a2eb-4351-bdbf-56bcab52ca03" containerID="ce23ddfc3fea27e434e5edf85129fc62695bbf4f8ffcf853cb4249ca34f6ea06" exitCode=0
Jul 08 03:09:24.901047 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.900662    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f7768d9d9-54lvq"
Jul 08 03:09:24.901047 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.900666    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f7768d9d9-54lvq" event={"ID":"94c4c985-a2eb-4351-bdbf-56bcab52ca03","Type":"ContainerDied","Data":"ce23ddfc3fea27e434e5edf85129fc62695bbf4f8ffcf853cb4249ca34f6ea06"}
Jul 08 03:09:24.901047 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.900785    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f7768d9d9-54lvq" event={"ID":"94c4c985-a2eb-4351-bdbf-56bcab52ca03","Type":"ContainerDied","Data":"7a6d38e825d182070a436eded75da6e07e78f836f8eef64719a3942cd4fed478"}
Jul 08 03:09:24.901047 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.900807    2578 scope.go:117] "RemoveContainer" containerID="ce23ddfc3fea27e434e5edf85129fc62695bbf4f8ffcf853cb4249ca34f6ea06"
Jul 08 03:09:24.909939 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.909922    2578 scope.go:117] "RemoveContainer" containerID="ce23ddfc3fea27e434e5edf85129fc62695bbf4f8ffcf853cb4249ca34f6ea06"
Jul 08 03:09:24.910191 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:09:24.910173    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce23ddfc3fea27e434e5edf85129fc62695bbf4f8ffcf853cb4249ca34f6ea06\": container with ID starting with ce23ddfc3fea27e434e5edf85129fc62695bbf4f8ffcf853cb4249ca34f6ea06 not found: ID does not exist" containerID="ce23ddfc3fea27e434e5edf85129fc62695bbf4f8ffcf853cb4249ca34f6ea06"
Jul 08 03:09:24.910228 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.910202    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce23ddfc3fea27e434e5edf85129fc62695bbf4f8ffcf853cb4249ca34f6ea06"} err="failed to get container status \"ce23ddfc3fea27e434e5edf85129fc62695bbf4f8ffcf853cb4249ca34f6ea06\": rpc error: code = NotFound desc = could not find container \"ce23ddfc3fea27e434e5edf85129fc62695bbf4f8ffcf853cb4249ca34f6ea06\": container with ID starting with ce23ddfc3fea27e434e5edf85129fc62695bbf4f8ffcf853cb4249ca34f6ea06 not found: ID does not exist"
Jul 08 03:09:24.921201 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.921171    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f7768d9d9-54lvq"]
Jul 08 03:09:24.925785 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:24.925765    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f7768d9d9-54lvq"]
Jul 08 03:09:26.163306 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:26.163274    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94c4c985-a2eb-4351-bdbf-56bcab52ca03" path="/var/lib/kubelet/pods/94c4c985-a2eb-4351-bdbf-56bcab52ca03/volumes"
Jul 08 03:09:42.222971 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.222930    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-69845b454b-fqczm"]
Jul 08 03:09:42.223378 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.223230    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94c4c985-a2eb-4351-bdbf-56bcab52ca03" containerName="manager"
Jul 08 03:09:42.223378 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.223240    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="94c4c985-a2eb-4351-bdbf-56bcab52ca03" containerName="manager"
Jul 08 03:09:42.223378 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.223292    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="94c4c985-a2eb-4351-bdbf-56bcab52ca03" containerName="manager"
Jul 08 03:09:42.227561 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.227539    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-69845b454b-fqczm"
Jul 08 03:09:42.233513 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.233486    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jdwqj\""
Jul 08 03:09:42.234037 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.233811    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 08 03:09:42.240430 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.240408    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-69845b454b-fqczm"]
Jul 08 03:09:42.349354 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.349305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/689ce469-1f9e-4120-b815-f6b3506500dd-openshift-service-ca\") pod \"maas-api-69845b454b-fqczm\" (UID: \"689ce469-1f9e-4120-b815-f6b3506500dd\") " pod="odh-ai-gateway-infra/maas-api-69845b454b-fqczm"
Jul 08 03:09:42.349354 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.349362    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/689ce469-1f9e-4120-b815-f6b3506500dd-maas-api-tls\") pod \"maas-api-69845b454b-fqczm\" (UID: \"689ce469-1f9e-4120-b815-f6b3506500dd\") " pod="odh-ai-gateway-infra/maas-api-69845b454b-fqczm"
Jul 08 03:09:42.349575 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.349466    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lgrm\" (UniqueName: \"kubernetes.io/projected/689ce469-1f9e-4120-b815-f6b3506500dd-kube-api-access-6lgrm\") pod \"maas-api-69845b454b-fqczm\" (UID: \"689ce469-1f9e-4120-b815-f6b3506500dd\") " pod="odh-ai-gateway-infra/maas-api-69845b454b-fqczm"
Jul 08 03:09:42.450110 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.450076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/689ce469-1f9e-4120-b815-f6b3506500dd-openshift-service-ca\") pod \"maas-api-69845b454b-fqczm\" (UID: \"689ce469-1f9e-4120-b815-f6b3506500dd\") " pod="odh-ai-gateway-infra/maas-api-69845b454b-fqczm"
Jul 08 03:09:42.450267 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.450123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/689ce469-1f9e-4120-b815-f6b3506500dd-maas-api-tls\") pod \"maas-api-69845b454b-fqczm\" (UID: \"689ce469-1f9e-4120-b815-f6b3506500dd\") " pod="odh-ai-gateway-infra/maas-api-69845b454b-fqczm"
Jul 08 03:09:42.450267 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.450195    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lgrm\" (UniqueName: \"kubernetes.io/projected/689ce469-1f9e-4120-b815-f6b3506500dd-kube-api-access-6lgrm\") pod \"maas-api-69845b454b-fqczm\" (UID: \"689ce469-1f9e-4120-b815-f6b3506500dd\") " pod="odh-ai-gateway-infra/maas-api-69845b454b-fqczm"
Jul 08 03:09:42.450348 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:09:42.450306    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 08 03:09:42.450382 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:09:42.450373    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/689ce469-1f9e-4120-b815-f6b3506500dd-maas-api-tls podName:689ce469-1f9e-4120-b815-f6b3506500dd nodeName:}" failed. No retries permitted until 2026-07-08 03:09:42.950355568 +0000 UTC m=+667.262634086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/689ce469-1f9e-4120-b815-f6b3506500dd-maas-api-tls") pod "maas-api-69845b454b-fqczm" (UID: "689ce469-1f9e-4120-b815-f6b3506500dd") : secret "maas-api-serving-cert" not found
Jul 08 03:09:42.450846 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.450829    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/689ce469-1f9e-4120-b815-f6b3506500dd-openshift-service-ca\") pod \"maas-api-69845b454b-fqczm\" (UID: \"689ce469-1f9e-4120-b815-f6b3506500dd\") " pod="odh-ai-gateway-infra/maas-api-69845b454b-fqczm"
Jul 08 03:09:42.458907 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.458884    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lgrm\" (UniqueName: \"kubernetes.io/projected/689ce469-1f9e-4120-b815-f6b3506500dd-kube-api-access-6lgrm\") pod \"maas-api-69845b454b-fqczm\" (UID: \"689ce469-1f9e-4120-b815-f6b3506500dd\") " pod="odh-ai-gateway-infra/maas-api-69845b454b-fqczm"
Jul 08 03:09:42.722777 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.722728    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-pjjrf"]
Jul 08 03:09:42.726290 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.726270    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-pjjrf"
Jul 08 03:09:42.728401 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.728379    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 08 03:09:42.728498 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.728399    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2qp5f\""
Jul 08 03:09:42.737052 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.737025    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-pjjrf"]
Jul 08 03:09:42.745338 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.745300    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-cs2dn"]
Jul 08 03:09:42.749091 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.749074    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-cs2dn"
Jul 08 03:09:42.758548 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.758525    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-cs2dn"]
Jul 08 03:09:42.854266 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.854224    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92jcx\" (UniqueName: \"kubernetes.io/projected/a2c1fb59-2cc8-44f7-9e88-672d2a467f33-kube-api-access-92jcx\") pod \"payload-processing-58f86c7798-cs2dn\" (UID: \"a2c1fb59-2cc8-44f7-9e88-672d2a467f33\") " pod="openshift-ingress/payload-processing-58f86c7798-cs2dn"
Jul 08 03:09:42.854443 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.854367    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbwz9\" (UniqueName: \"kubernetes.io/projected/90a0a0d8-6e82-4ae6-9ddc-6ad6e99384c8-kube-api-access-qbwz9\") pod \"payload-pre-processing-7964457696-pjjrf\" (UID: \"90a0a0d8-6e82-4ae6-9ddc-6ad6e99384c8\") " pod="openshift-ingress/payload-pre-processing-7964457696-pjjrf"
Jul 08 03:09:42.854443 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.854409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90a0a0d8-6e82-4ae6-9ddc-6ad6e99384c8-plugins-config-volume\") pod \"payload-pre-processing-7964457696-pjjrf\" (UID: \"90a0a0d8-6e82-4ae6-9ddc-6ad6e99384c8\") " pod="openshift-ingress/payload-pre-processing-7964457696-pjjrf"
Jul 08 03:09:42.854443 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.854438    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2c1fb59-2cc8-44f7-9e88-672d2a467f33-plugins-config-volume\") pod \"payload-processing-58f86c7798-cs2dn\" (UID: \"a2c1fb59-2cc8-44f7-9e88-672d2a467f33\") " pod="openshift-ingress/payload-processing-58f86c7798-cs2dn"
Jul 08 03:09:42.955820 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.955784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbwz9\" (UniqueName: \"kubernetes.io/projected/90a0a0d8-6e82-4ae6-9ddc-6ad6e99384c8-kube-api-access-qbwz9\") pod \"payload-pre-processing-7964457696-pjjrf\" (UID: \"90a0a0d8-6e82-4ae6-9ddc-6ad6e99384c8\") " pod="openshift-ingress/payload-pre-processing-7964457696-pjjrf"
Jul 08 03:09:42.956015 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.955827    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90a0a0d8-6e82-4ae6-9ddc-6ad6e99384c8-plugins-config-volume\") pod \"payload-pre-processing-7964457696-pjjrf\" (UID: \"90a0a0d8-6e82-4ae6-9ddc-6ad6e99384c8\") " pod="openshift-ingress/payload-pre-processing-7964457696-pjjrf"
Jul 08 03:09:42.956015 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.955846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2c1fb59-2cc8-44f7-9e88-672d2a467f33-plugins-config-volume\") pod \"payload-processing-58f86c7798-cs2dn\" (UID: \"a2c1fb59-2cc8-44f7-9e88-672d2a467f33\") " pod="openshift-ingress/payload-processing-58f86c7798-cs2dn"
Jul 08 03:09:42.956015 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.955891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/689ce469-1f9e-4120-b815-f6b3506500dd-maas-api-tls\") pod \"maas-api-69845b454b-fqczm\" (UID: \"689ce469-1f9e-4120-b815-f6b3506500dd\") " pod="odh-ai-gateway-infra/maas-api-69845b454b-fqczm"
Jul 08 03:09:42.956185 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.956041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92jcx\" (UniqueName: \"kubernetes.io/projected/a2c1fb59-2cc8-44f7-9e88-672d2a467f33-kube-api-access-92jcx\") pod \"payload-processing-58f86c7798-cs2dn\" (UID: \"a2c1fb59-2cc8-44f7-9e88-672d2a467f33\") " pod="openshift-ingress/payload-processing-58f86c7798-cs2dn"
Jul 08 03:09:42.956625 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.956604    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2c1fb59-2cc8-44f7-9e88-672d2a467f33-plugins-config-volume\") pod \"payload-processing-58f86c7798-cs2dn\" (UID: \"a2c1fb59-2cc8-44f7-9e88-672d2a467f33\") " pod="openshift-ingress/payload-processing-58f86c7798-cs2dn"
Jul 08 03:09:42.956736 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.956676    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90a0a0d8-6e82-4ae6-9ddc-6ad6e99384c8-plugins-config-volume\") pod \"payload-pre-processing-7964457696-pjjrf\" (UID: \"90a0a0d8-6e82-4ae6-9ddc-6ad6e99384c8\") " pod="openshift-ingress/payload-pre-processing-7964457696-pjjrf"
Jul 08 03:09:42.958445 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.958424    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/689ce469-1f9e-4120-b815-f6b3506500dd-maas-api-tls\") pod \"maas-api-69845b454b-fqczm\" (UID: \"689ce469-1f9e-4120-b815-f6b3506500dd\") " pod="odh-ai-gateway-infra/maas-api-69845b454b-fqczm"
Jul 08 03:09:42.967426 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.967399    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92jcx\" (UniqueName: \"kubernetes.io/projected/a2c1fb59-2cc8-44f7-9e88-672d2a467f33-kube-api-access-92jcx\") pod \"payload-processing-58f86c7798-cs2dn\" (UID: \"a2c1fb59-2cc8-44f7-9e88-672d2a467f33\") " pod="openshift-ingress/payload-processing-58f86c7798-cs2dn"
Jul 08 03:09:42.967941 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:42.967920    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbwz9\" (UniqueName: \"kubernetes.io/projected/90a0a0d8-6e82-4ae6-9ddc-6ad6e99384c8-kube-api-access-qbwz9\") pod \"payload-pre-processing-7964457696-pjjrf\" (UID: \"90a0a0d8-6e82-4ae6-9ddc-6ad6e99384c8\") " pod="openshift-ingress/payload-pre-processing-7964457696-pjjrf"
Jul 08 03:09:43.038088 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:43.038016    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-pjjrf"
Jul 08 03:09:43.059221 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:43.059194    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-cs2dn"
Jul 08 03:09:43.138015 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:43.137823    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-69845b454b-fqczm"
Jul 08 03:09:43.184407 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:43.184368    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-pjjrf"]
Jul 08 03:09:43.185917 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:09:43.185838    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a0a0d8_6e82_4ae6_9ddc_6ad6e99384c8.slice/crio-6119a35ac71e48de9d7d90ac308aa8e79312b546e3f04501401743b53869c30b WatchSource:0}: Error finding container 6119a35ac71e48de9d7d90ac308aa8e79312b546e3f04501401743b53869c30b: Status 404 returned error can't find the container with id 6119a35ac71e48de9d7d90ac308aa8e79312b546e3f04501401743b53869c30b
Jul 08 03:09:43.189056 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:43.188452    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 03:09:43.219702 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:43.219677    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-cs2dn"]
Jul 08 03:09:43.222193 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:09:43.222161    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2c1fb59_2cc8_44f7_9e88_672d2a467f33.slice/crio-3aa72ee3d34e52299e97199b6347a75ab9b3526f6a731fc527684c57a1572d61 WatchSource:0}: Error finding container 3aa72ee3d34e52299e97199b6347a75ab9b3526f6a731fc527684c57a1572d61: Status 404 returned error can't find the container with id 3aa72ee3d34e52299e97199b6347a75ab9b3526f6a731fc527684c57a1572d61
Jul 08 03:09:43.282469 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:43.282444    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-69845b454b-fqczm"]
Jul 08 03:09:43.284801 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:09:43.284773    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod689ce469_1f9e_4120_b815_f6b3506500dd.slice/crio-f7e6ff4a18c67faafde97c1b6f923f81157ea5ae3ea27f139408f8ebeb02b893 WatchSource:0}: Error finding container f7e6ff4a18c67faafde97c1b6f923f81157ea5ae3ea27f139408f8ebeb02b893: Status 404 returned error can't find the container with id f7e6ff4a18c67faafde97c1b6f923f81157ea5ae3ea27f139408f8ebeb02b893
Jul 08 03:09:43.999766 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:43.999702    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-cs2dn" event={"ID":"a2c1fb59-2cc8-44f7-9e88-672d2a467f33","Type":"ContainerStarted","Data":"3aa72ee3d34e52299e97199b6347a75ab9b3526f6a731fc527684c57a1572d61"}
Jul 08 03:09:44.001466 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:44.001400    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-pjjrf" event={"ID":"90a0a0d8-6e82-4ae6-9ddc-6ad6e99384c8","Type":"ContainerStarted","Data":"6119a35ac71e48de9d7d90ac308aa8e79312b546e3f04501401743b53869c30b"}
Jul 08 03:09:44.003805 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:44.003686    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-69845b454b-fqczm" event={"ID":"689ce469-1f9e-4120-b815-f6b3506500dd","Type":"ContainerStarted","Data":"f7e6ff4a18c67faafde97c1b6f923f81157ea5ae3ea27f139408f8ebeb02b893"}
Jul 08 03:09:45.011912 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:45.011836    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-cs2dn" event={"ID":"a2c1fb59-2cc8-44f7-9e88-672d2a467f33","Type":"ContainerStarted","Data":"a6fa5154bdf56f2f8f7618aa74b6b0676054e5270205cb23f53b8392933da052"}
Jul 08 03:09:45.012378 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:45.011971    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-cs2dn"
Jul 08 03:09:45.013708 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:45.013671    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-pjjrf" event={"ID":"90a0a0d8-6e82-4ae6-9ddc-6ad6e99384c8","Type":"ContainerStarted","Data":"1ed361ca7961b4fed3aa17e97ac467e170ea2ff947e043150ac4c3d2c1221785"}
Jul 08 03:09:45.013864 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:45.013781    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-pjjrf"
Jul 08 03:09:45.028650 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:45.028580    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-cs2dn" podStartSLOduration=1.6587579730000002 podStartE2EDuration="3.028559641s" totalImagesPullingTime="1.369801668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:09:45.025978883 +0000 UTC m=+669.338257420" watchObservedRunningTime="2026-07-08 03:09:45.028559641 +0000 UTC m=+669.340838176"
Jul 08 03:09:45.042369 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:45.042299    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-pjjrf" podStartSLOduration=1.634049422 podStartE2EDuration="3.042279708s" totalImagesPullingTime="1.408230286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:09:45.039482014 +0000 UTC m=+669.351760549" watchObservedRunningTime="2026-07-08 03:09:45.042279708 +0000 UTC m=+669.354558259"
Jul 08 03:09:46.020814 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:46.020778    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-69845b454b-fqczm" event={"ID":"689ce469-1f9e-4120-b815-f6b3506500dd","Type":"ContainerStarted","Data":"546f36d738f98f9f3d29ce82277134610d387501174d7d0562ddcf8e25a47304"}
Jul 08 03:09:46.021257 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:46.020879    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-69845b454b-fqczm"
Jul 08 03:09:46.038960 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:46.038846    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-69845b454b-fqczm" podStartSLOduration=2.160055348 podStartE2EDuration="4.038826625s" totalImagesPullingTime="1.878771277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:09:46.037875888 +0000 UTC m=+670.350154436" watchObservedRunningTime="2026-07-08 03:09:46.038826625 +0000 UTC m=+670.351105160"
Jul 08 03:09:52.032202 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:52.032172    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-69845b454b-fqczm"
Jul 08 03:09:56.023142 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:56.023111    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-cs2dn"
Jul 08 03:09:56.023560 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:56.023180    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-pjjrf"
Jul 08 03:09:58.013270 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.013230    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"]
Jul 08 03:09:58.017720 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.017697    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.020078 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.020054    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mv7gx\""
Jul 08 03:09:58.020186 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.020124    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 08 03:09:58.020501 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.020481    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 03:09:58.020586 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.020543    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 03:09:58.025079 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.025062    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"]
Jul 08 03:09:58.083306 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.083276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25742ae8-1045-4277-a94d-e67e9df49c73-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67\" (UID: \"25742ae8-1045-4277-a94d-e67e9df49c73\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.083434 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.083312    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25742ae8-1045-4277-a94d-e67e9df49c73-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67\" (UID: \"25742ae8-1045-4277-a94d-e67e9df49c73\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.083434 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.083344    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25742ae8-1045-4277-a94d-e67e9df49c73-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67\" (UID: \"25742ae8-1045-4277-a94d-e67e9df49c73\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.083434 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.083375    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25742ae8-1045-4277-a94d-e67e9df49c73-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67\" (UID: \"25742ae8-1045-4277-a94d-e67e9df49c73\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.083547 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.083445    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25742ae8-1045-4277-a94d-e67e9df49c73-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67\" (UID: \"25742ae8-1045-4277-a94d-e67e9df49c73\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.083547 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.083489    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc47k\" (UniqueName: \"kubernetes.io/projected/25742ae8-1045-4277-a94d-e67e9df49c73-kube-api-access-hc47k\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67\" (UID: \"25742ae8-1045-4277-a94d-e67e9df49c73\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.184254 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.184222    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25742ae8-1045-4277-a94d-e67e9df49c73-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67\" (UID: \"25742ae8-1045-4277-a94d-e67e9df49c73\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.184442 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.184303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc47k\" (UniqueName: \"kubernetes.io/projected/25742ae8-1045-4277-a94d-e67e9df49c73-kube-api-access-hc47k\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67\" (UID: \"25742ae8-1045-4277-a94d-e67e9df49c73\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.184442 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.184335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25742ae8-1045-4277-a94d-e67e9df49c73-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67\" (UID: \"25742ae8-1045-4277-a94d-e67e9df49c73\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.184442 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.184365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25742ae8-1045-4277-a94d-e67e9df49c73-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67\" (UID: \"25742ae8-1045-4277-a94d-e67e9df49c73\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.184442 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.184390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25742ae8-1045-4277-a94d-e67e9df49c73-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67\" (UID: \"25742ae8-1045-4277-a94d-e67e9df49c73\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.184442 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.184413    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25742ae8-1045-4277-a94d-e67e9df49c73-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67\" (UID: \"25742ae8-1045-4277-a94d-e67e9df49c73\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.184728 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.184684    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25742ae8-1045-4277-a94d-e67e9df49c73-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67\" (UID: \"25742ae8-1045-4277-a94d-e67e9df49c73\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.184794 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.184733    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25742ae8-1045-4277-a94d-e67e9df49c73-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67\" (UID: \"25742ae8-1045-4277-a94d-e67e9df49c73\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.184855 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.184835    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25742ae8-1045-4277-a94d-e67e9df49c73-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67\" (UID: \"25742ae8-1045-4277-a94d-e67e9df49c73\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.186963 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.186940    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25742ae8-1045-4277-a94d-e67e9df49c73-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67\" (UID: \"25742ae8-1045-4277-a94d-e67e9df49c73\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.187110 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.187092    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25742ae8-1045-4277-a94d-e67e9df49c73-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67\" (UID: \"25742ae8-1045-4277-a94d-e67e9df49c73\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.193805 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.193760    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc47k\" (UniqueName: \"kubernetes.io/projected/25742ae8-1045-4277-a94d-e67e9df49c73-kube-api-access-hc47k\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67\" (UID: \"25742ae8-1045-4277-a94d-e67e9df49c73\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.328556 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.328514    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:09:58.466239 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:58.466143    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"]
Jul 08 03:09:58.468399 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:09:58.468373    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25742ae8_1045_4277_a94d_e67e9df49c73.slice/crio-4e7b09bad6a5f7a0431f7cd83b86402ace50585af7724c5e79095f1d4a440760 WatchSource:0}: Error finding container 4e7b09bad6a5f7a0431f7cd83b86402ace50585af7724c5e79095f1d4a440760: Status 404 returned error can't find the container with id 4e7b09bad6a5f7a0431f7cd83b86402ace50585af7724c5e79095f1d4a440760
Jul 08 03:09:59.086466 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:09:59.086433    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67" event={"ID":"25742ae8-1045-4277-a94d-e67e9df49c73","Type":"ContainerStarted","Data":"4e7b09bad6a5f7a0431f7cd83b86402ace50585af7724c5e79095f1d4a440760"}
Jul 08 03:10:00.092876 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:00.092841    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67" event={"ID":"25742ae8-1045-4277-a94d-e67e9df49c73","Type":"ContainerStarted","Data":"7856dc0eca71787a12a433631e0119cabead2321bf64ce4bde2d644a45d5e629"}
Jul 08 03:10:00.110516 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:00.110472    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67" podStartSLOduration=1.947366632 podStartE2EDuration="3.11045685s" totalImagesPullingTime="1.163090218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:10:00.109529255 +0000 UTC m=+684.421807804" watchObservedRunningTime="2026-07-08 03:10:00.11045685 +0000 UTC m=+684.422735385"
Jul 08 03:10:08.329094 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:08.329058    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:10:08.329596 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:08.329133    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:10:08.341595 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:08.341570    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:10:09.147458 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:09.147431    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67"
Jul 08 03:10:21.135993 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.135955    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"]
Jul 08 03:10:21.142144 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.142114    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.146277 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.145994    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 08 03:10:21.149582 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.149444    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"]
Jul 08 03:10:21.183244 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.183212    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7f93999-ca21-489b-841c-fdcc7ee84097-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4zj7\" (UID: \"c7f93999-ca21-489b-841c-fdcc7ee84097\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.183378 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.183253    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7f93999-ca21-489b-841c-fdcc7ee84097-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4zj7\" (UID: \"c7f93999-ca21-489b-841c-fdcc7ee84097\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.183378 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.183273    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7f93999-ca21-489b-841c-fdcc7ee84097-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4zj7\" (UID: \"c7f93999-ca21-489b-841c-fdcc7ee84097\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.183378 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.183296    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7f93999-ca21-489b-841c-fdcc7ee84097-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4zj7\" (UID: \"c7f93999-ca21-489b-841c-fdcc7ee84097\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.183378 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.183339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xtl5\" (UniqueName: \"kubernetes.io/projected/c7f93999-ca21-489b-841c-fdcc7ee84097-kube-api-access-9xtl5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4zj7\" (UID: \"c7f93999-ca21-489b-841c-fdcc7ee84097\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.183378 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.183359    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7f93999-ca21-489b-841c-fdcc7ee84097-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4zj7\" (UID: \"c7f93999-ca21-489b-841c-fdcc7ee84097\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.284938 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.284888    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7f93999-ca21-489b-841c-fdcc7ee84097-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4zj7\" (UID: \"c7f93999-ca21-489b-841c-fdcc7ee84097\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.285118 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.284951    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7f93999-ca21-489b-841c-fdcc7ee84097-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4zj7\" (UID: \"c7f93999-ca21-489b-841c-fdcc7ee84097\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.285118 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.284983    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7f93999-ca21-489b-841c-fdcc7ee84097-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4zj7\" (UID: \"c7f93999-ca21-489b-841c-fdcc7ee84097\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.285282 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.285129    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7f93999-ca21-489b-841c-fdcc7ee84097-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4zj7\" (UID: \"c7f93999-ca21-489b-841c-fdcc7ee84097\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.285420 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.285389    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7f93999-ca21-489b-841c-fdcc7ee84097-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4zj7\" (UID: \"c7f93999-ca21-489b-841c-fdcc7ee84097\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.285547 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.285334    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7f93999-ca21-489b-841c-fdcc7ee84097-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4zj7\" (UID: \"c7f93999-ca21-489b-841c-fdcc7ee84097\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.285547 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.285443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xtl5\" (UniqueName: \"kubernetes.io/projected/c7f93999-ca21-489b-841c-fdcc7ee84097-kube-api-access-9xtl5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4zj7\" (UID: \"c7f93999-ca21-489b-841c-fdcc7ee84097\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.285547 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.285487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7f93999-ca21-489b-841c-fdcc7ee84097-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4zj7\" (UID: \"c7f93999-ca21-489b-841c-fdcc7ee84097\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.285547 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.285522    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7f93999-ca21-489b-841c-fdcc7ee84097-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4zj7\" (UID: \"c7f93999-ca21-489b-841c-fdcc7ee84097\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.287718 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.287697    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7f93999-ca21-489b-841c-fdcc7ee84097-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4zj7\" (UID: \"c7f93999-ca21-489b-841c-fdcc7ee84097\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.287833 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.287706    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7f93999-ca21-489b-841c-fdcc7ee84097-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4zj7\" (UID: \"c7f93999-ca21-489b-841c-fdcc7ee84097\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.293936 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.293913    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xtl5\" (UniqueName: \"kubernetes.io/projected/c7f93999-ca21-489b-841c-fdcc7ee84097-kube-api-access-9xtl5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-s4zj7\" (UID: \"c7f93999-ca21-489b-841c-fdcc7ee84097\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.453651 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.453549    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:21.587359 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:21.587319    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"]
Jul 08 03:10:21.588935 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:10:21.588907    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7f93999_ca21_489b_841c_fdcc7ee84097.slice/crio-76d1952407ef480d4a546e10097973f332ba832450a415c0d89ef801d68d8882 WatchSource:0}: Error finding container 76d1952407ef480d4a546e10097973f332ba832450a415c0d89ef801d68d8882: Status 404 returned error can't find the container with id 76d1952407ef480d4a546e10097973f332ba832450a415c0d89ef801d68d8882
Jul 08 03:10:22.197445 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:22.197358    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7" event={"ID":"c7f93999-ca21-489b-841c-fdcc7ee84097","Type":"ContainerStarted","Data":"6331985c99461706715e763c5c4ca18962bf9aa5f4ae05b5db2c9edc5a8c6493"}
Jul 08 03:10:22.197445 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:22.197404    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7" event={"ID":"c7f93999-ca21-489b-841c-fdcc7ee84097","Type":"ContainerStarted","Data":"76d1952407ef480d4a546e10097973f332ba832450a415c0d89ef801d68d8882"}
Jul 08 03:10:22.215726 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:22.215680    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7" podStartSLOduration=0.988041459 podStartE2EDuration="1.215664049s" totalImagesPullingTime="227.62259ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:10:22.214053404 +0000 UTC m=+706.526331931" watchObservedRunningTime="2026-07-08 03:10:22.215664049 +0000 UTC m=+706.527942893"
Jul 08 03:10:31.453992 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:31.453911    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:31.454342 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:31.453989    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:31.466567 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:31.466538    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:10:32.253110 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:10:32.253086    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-s4zj7"
Jul 08 03:12:13.517370 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:12:13.517292    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d679799f-tlvkn"]
Jul 08 03:12:13.520587 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:12:13.520567    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d679799f-tlvkn"
Jul 08 03:12:13.522626 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:12:13.522606    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 03:12:13.523156 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:12:13.523137    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 03:12:13.523156 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:12:13.523150    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pptkn\""
Jul 08 03:12:13.523290 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:12:13.523207    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 08 03:12:13.529577 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:12:13.529557    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d679799f-tlvkn"]
Jul 08 03:12:13.644512 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:12:13.644478    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc8ef898-c00c-4cbd-8fc8-bc4712533499-tls-cert\") pod \"authorino-6d679799f-tlvkn\" (UID: \"dc8ef898-c00c-4cbd-8fc8-bc4712533499\") " pod="kuadrant-system/authorino-6d679799f-tlvkn"
Jul 08 03:12:13.644512 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:12:13.644515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z42fk\" (UniqueName: \"kubernetes.io/projected/dc8ef898-c00c-4cbd-8fc8-bc4712533499-kube-api-access-z42fk\") pod \"authorino-6d679799f-tlvkn\" (UID: \"dc8ef898-c00c-4cbd-8fc8-bc4712533499\") " pod="kuadrant-system/authorino-6d679799f-tlvkn"
Jul 08 03:12:13.747914 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:12:13.746657    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc8ef898-c00c-4cbd-8fc8-bc4712533499-tls-cert\") pod \"authorino-6d679799f-tlvkn\" (UID: \"dc8ef898-c00c-4cbd-8fc8-bc4712533499\") " pod="kuadrant-system/authorino-6d679799f-tlvkn"
Jul 08 03:12:13.747914 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:12:13.746718    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z42fk\" (UniqueName: \"kubernetes.io/projected/dc8ef898-c00c-4cbd-8fc8-bc4712533499-kube-api-access-z42fk\") pod \"authorino-6d679799f-tlvkn\" (UID: \"dc8ef898-c00c-4cbd-8fc8-bc4712533499\") " pod="kuadrant-system/authorino-6d679799f-tlvkn"
Jul 08 03:12:13.750385 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:12:13.750348    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dc8ef898-c00c-4cbd-8fc8-bc4712533499-tls-cert\") pod \"authorino-6d679799f-tlvkn\" (UID: \"dc8ef898-c00c-4cbd-8fc8-bc4712533499\") " pod="kuadrant-system/authorino-6d679799f-tlvkn"
Jul 08 03:12:13.755556 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:12:13.755533    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z42fk\" (UniqueName: \"kubernetes.io/projected/dc8ef898-c00c-4cbd-8fc8-bc4712533499-kube-api-access-z42fk\") pod \"authorino-6d679799f-tlvkn\" (UID: \"dc8ef898-c00c-4cbd-8fc8-bc4712533499\") " pod="kuadrant-system/authorino-6d679799f-tlvkn"
Jul 08 03:12:13.830071 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:12:13.830046    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d679799f-tlvkn"
Jul 08 03:12:13.957075 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:12:13.957049    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d679799f-tlvkn"]
Jul 08 03:12:13.958972 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:12:13.958947    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc8ef898_c00c_4cbd_8fc8_bc4712533499.slice/crio-9cb022bda8aa0b348eac114dba4b0fc5b8b07f298e1c64345bd3f415f2855762 WatchSource:0}: Error finding container 9cb022bda8aa0b348eac114dba4b0fc5b8b07f298e1c64345bd3f415f2855762: Status 404 returned error can't find the container with id 9cb022bda8aa0b348eac114dba4b0fc5b8b07f298e1c64345bd3f415f2855762
Jul 08 03:12:14.733652 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:12:14.733615    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d679799f-tlvkn" event={"ID":"dc8ef898-c00c-4cbd-8fc8-bc4712533499","Type":"ContainerStarted","Data":"7dfe314d2b28800561b3a5fb1dd469dddb1ec7da95cb4a238f9506085957fa4d"}
Jul 08 03:12:14.734050 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:12:14.733665    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d679799f-tlvkn" event={"ID":"dc8ef898-c00c-4cbd-8fc8-bc4712533499","Type":"ContainerStarted","Data":"9cb022bda8aa0b348eac114dba4b0fc5b8b07f298e1c64345bd3f415f2855762"}
Jul 08 03:12:14.750955 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:12:14.750898    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d679799f-tlvkn" podStartSLOduration=1.42734399 podStartE2EDuration="1.75088199s" totalImagesPullingTime="323.538ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:12:14.748824249 +0000 UTC m=+819.061102784" watchObservedRunningTime="2026-07-08 03:12:14.75088199 +0000 UTC m=+819.063160526"
Jul 08 03:13:26.286535 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:26.286496    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d7d866b75-pdkfn"]
Jul 08 03:13:26.287140 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:26.286723    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6d7d866b75-pdkfn" podUID="a609b53e-e7d0-420b-8a9a-ad19f737d3fc" containerName="manager" containerID="cri-o://e293e0dd37461b2b31a67f45a421ce09f0849f3357126dd8b8106eef53d38056" gracePeriod=30
Jul 08 03:13:26.538341 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:26.538280    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d7d866b75-pdkfn"
Jul 08 03:13:26.570868 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:26.570801    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjtzv\" (UniqueName: \"kubernetes.io/projected/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-kube-api-access-sjtzv\") pod \"a609b53e-e7d0-420b-8a9a-ad19f737d3fc\" (UID: \"a609b53e-e7d0-420b-8a9a-ad19f737d3fc\") "
Jul 08 03:13:26.571015 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:26.570920    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-webhook-cert\") pod \"a609b53e-e7d0-420b-8a9a-ad19f737d3fc\" (UID: \"a609b53e-e7d0-420b-8a9a-ad19f737d3fc\") "
Jul 08 03:13:26.571015 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:26.570947    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-service-ca\") pod \"a609b53e-e7d0-420b-8a9a-ad19f737d3fc\" (UID: \"a609b53e-e7d0-420b-8a9a-ad19f737d3fc\") "
Jul 08 03:13:26.571348 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:26.571324    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-service-ca" (OuterVolumeSpecName: "service-ca") pod "a609b53e-e7d0-420b-8a9a-ad19f737d3fc" (UID: "a609b53e-e7d0-420b-8a9a-ad19f737d3fc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:13:26.573006 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:26.572980    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-kube-api-access-sjtzv" (OuterVolumeSpecName: "kube-api-access-sjtzv") pod "a609b53e-e7d0-420b-8a9a-ad19f737d3fc" (UID: "a609b53e-e7d0-420b-8a9a-ad19f737d3fc"). InnerVolumeSpecName "kube-api-access-sjtzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:13:26.573498 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:26.573468    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a609b53e-e7d0-420b-8a9a-ad19f737d3fc" (UID: "a609b53e-e7d0-420b-8a9a-ad19f737d3fc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:13:26.672198 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:26.672165    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjtzv\" (UniqueName: \"kubernetes.io/projected/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-kube-api-access-sjtzv\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:13:26.672198 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:26.672193    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-webhook-cert\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:13:26.672198 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:26.672201    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a609b53e-e7d0-420b-8a9a-ad19f737d3fc-service-ca\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:13:27.099121 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.099085    2578 generic.go:356] "Generic (PLEG): container finished" podID="a609b53e-e7d0-420b-8a9a-ad19f737d3fc" containerID="e293e0dd37461b2b31a67f45a421ce09f0849f3357126dd8b8106eef53d38056" exitCode=0
Jul 08 03:13:27.099318 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.099133    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d7d866b75-pdkfn"
Jul 08 03:13:27.099318 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.099164    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d7d866b75-pdkfn" event={"ID":"a609b53e-e7d0-420b-8a9a-ad19f737d3fc","Type":"ContainerDied","Data":"e293e0dd37461b2b31a67f45a421ce09f0849f3357126dd8b8106eef53d38056"}
Jul 08 03:13:27.099318 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.099216    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d7d866b75-pdkfn" event={"ID":"a609b53e-e7d0-420b-8a9a-ad19f737d3fc","Type":"ContainerDied","Data":"69bf8b5d9375d998b1ba952b7fe196537ada9dbf9a95b3a8a0e632fac537eee9"}
Jul 08 03:13:27.099318 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.099238    2578 scope.go:117] "RemoveContainer" containerID="e293e0dd37461b2b31a67f45a421ce09f0849f3357126dd8b8106eef53d38056"
Jul 08 03:13:27.108702 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.108684    2578 scope.go:117] "RemoveContainer" containerID="e293e0dd37461b2b31a67f45a421ce09f0849f3357126dd8b8106eef53d38056"
Jul 08 03:13:27.108999 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:13:27.108982    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e293e0dd37461b2b31a67f45a421ce09f0849f3357126dd8b8106eef53d38056\": container with ID starting with e293e0dd37461b2b31a67f45a421ce09f0849f3357126dd8b8106eef53d38056 not found: ID does not exist" containerID="e293e0dd37461b2b31a67f45a421ce09f0849f3357126dd8b8106eef53d38056"
Jul 08 03:13:27.109062 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.109009    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e293e0dd37461b2b31a67f45a421ce09f0849f3357126dd8b8106eef53d38056"} err="failed to get container status \"e293e0dd37461b2b31a67f45a421ce09f0849f3357126dd8b8106eef53d38056\": rpc error: code = NotFound desc = could not find container \"e293e0dd37461b2b31a67f45a421ce09f0849f3357126dd8b8106eef53d38056\": container with ID starting with e293e0dd37461b2b31a67f45a421ce09f0849f3357126dd8b8106eef53d38056 not found: ID does not exist"
Jul 08 03:13:27.120771 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.120732    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d7d866b75-pdkfn"]
Jul 08 03:13:27.122680 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.122662    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d7d866b75-pdkfn"]
Jul 08 03:13:27.876753 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.876706    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d7d866b75-dmktk"]
Jul 08 03:13:27.877130 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.877052    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a609b53e-e7d0-420b-8a9a-ad19f737d3fc" containerName="manager"
Jul 08 03:13:27.877130 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.877063    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a609b53e-e7d0-420b-8a9a-ad19f737d3fc" containerName="manager"
Jul 08 03:13:27.877130 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.877127    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a609b53e-e7d0-420b-8a9a-ad19f737d3fc" containerName="manager"
Jul 08 03:13:27.881313 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.881293    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d7d866b75-dmktk"
Jul 08 03:13:27.883241 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.883223    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 03:13:27.883915 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.883887    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 03:13:27.883915 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.883912    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lm9mt\""
Jul 08 03:13:27.889603 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.889583    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d7d866b75-dmktk"]
Jul 08 03:13:27.984160 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.984126    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d85dd141-59c6-4607-a81e-1e5675769ff2-service-ca\") pod \"maas-controller-6d7d866b75-dmktk\" (UID: \"d85dd141-59c6-4607-a81e-1e5675769ff2\") " pod="opendatahub/maas-controller-6d7d866b75-dmktk"
Jul 08 03:13:27.984321 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.984161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7w2b\" (UniqueName: \"kubernetes.io/projected/d85dd141-59c6-4607-a81e-1e5675769ff2-kube-api-access-x7w2b\") pod \"maas-controller-6d7d866b75-dmktk\" (UID: \"d85dd141-59c6-4607-a81e-1e5675769ff2\") " pod="opendatahub/maas-controller-6d7d866b75-dmktk"
Jul 08 03:13:27.984321 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:27.984246    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d85dd141-59c6-4607-a81e-1e5675769ff2-webhook-cert\") pod \"maas-controller-6d7d866b75-dmktk\" (UID: \"d85dd141-59c6-4607-a81e-1e5675769ff2\") " pod="opendatahub/maas-controller-6d7d866b75-dmktk"
Jul 08 03:13:28.085100 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:28.085070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d85dd141-59c6-4607-a81e-1e5675769ff2-webhook-cert\") pod \"maas-controller-6d7d866b75-dmktk\" (UID: \"d85dd141-59c6-4607-a81e-1e5675769ff2\") " pod="opendatahub/maas-controller-6d7d866b75-dmktk"
Jul 08 03:13:28.085264 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:28.085144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d85dd141-59c6-4607-a81e-1e5675769ff2-service-ca\") pod \"maas-controller-6d7d866b75-dmktk\" (UID: \"d85dd141-59c6-4607-a81e-1e5675769ff2\") " pod="opendatahub/maas-controller-6d7d866b75-dmktk"
Jul 08 03:13:28.085264 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:28.085172    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7w2b\" (UniqueName: \"kubernetes.io/projected/d85dd141-59c6-4607-a81e-1e5675769ff2-kube-api-access-x7w2b\") pod \"maas-controller-6d7d866b75-dmktk\" (UID: \"d85dd141-59c6-4607-a81e-1e5675769ff2\") " pod="opendatahub/maas-controller-6d7d866b75-dmktk"
Jul 08 03:13:28.085846 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:28.085816    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d85dd141-59c6-4607-a81e-1e5675769ff2-service-ca\") pod \"maas-controller-6d7d866b75-dmktk\" (UID: \"d85dd141-59c6-4607-a81e-1e5675769ff2\") " pod="opendatahub/maas-controller-6d7d866b75-dmktk"
Jul 08 03:13:28.087694 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:28.087672    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d85dd141-59c6-4607-a81e-1e5675769ff2-webhook-cert\") pod \"maas-controller-6d7d866b75-dmktk\" (UID: \"d85dd141-59c6-4607-a81e-1e5675769ff2\") " pod="opendatahub/maas-controller-6d7d866b75-dmktk"
Jul 08 03:13:28.092465 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:28.092443    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7w2b\" (UniqueName: \"kubernetes.io/projected/d85dd141-59c6-4607-a81e-1e5675769ff2-kube-api-access-x7w2b\") pod \"maas-controller-6d7d866b75-dmktk\" (UID: \"d85dd141-59c6-4607-a81e-1e5675769ff2\") " pod="opendatahub/maas-controller-6d7d866b75-dmktk"
Jul 08 03:13:28.162985 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:28.162910    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a609b53e-e7d0-420b-8a9a-ad19f737d3fc" path="/var/lib/kubelet/pods/a609b53e-e7d0-420b-8a9a-ad19f737d3fc/volumes"
Jul 08 03:13:28.191969 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:28.191939    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d7d866b75-dmktk"
Jul 08 03:13:28.332353 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:28.332312    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d7d866b75-dmktk"]
Jul 08 03:13:29.111198 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:29.111113    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d7d866b75-dmktk" event={"ID":"d85dd141-59c6-4607-a81e-1e5675769ff2","Type":"ContainerStarted","Data":"60ef71f79eb0be50d9c36da7f35ce2938849ba155cd1ab3fe8f367e3e2ea1a7b"}
Jul 08 03:13:29.111198 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:29.111167    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d7d866b75-dmktk" event={"ID":"d85dd141-59c6-4607-a81e-1e5675769ff2","Type":"ContainerStarted","Data":"3a80cce4cfc37dcf7a67b1732371499446a57ebb223d05bddedf2747d4659f55"}
Jul 08 03:13:29.111579 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:29.111213    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d7d866b75-dmktk"
Jul 08 03:13:29.128390 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:29.128345    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d7d866b75-dmktk" podStartSLOduration=1.622035785 podStartE2EDuration="2.128330987s" totalImagesPullingTime="506.295202ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:13:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:13:29.126999246 +0000 UTC m=+893.439277783" watchObservedRunningTime="2026-07-08 03:13:29.128330987 +0000 UTC m=+893.440609521"
Jul 08 03:13:40.122320 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:13:40.122289    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d7d866b75-dmktk"
Jul 08 03:25:28.509642 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:28.509608    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"]
Jul 08 03:25:28.512988 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:28.512971    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"
Jul 08 03:25:28.515193 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:28.515166    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-261cc1da-serving-cert\""
Jul 08 03:25:28.523636 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:28.523616    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"]
Jul 08 03:25:28.611842 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:28.611808    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b27a04-6f70-4b9b-b969-5c89f6ae326f-maas-api-tls\") pod \"maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh\" (UID: \"90b27a04-6f70-4b9b-b969-5c89f6ae326f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"
Jul 08 03:25:28.612024 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:28.611863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wdjv\" (UniqueName: \"kubernetes.io/projected/90b27a04-6f70-4b9b-b969-5c89f6ae326f-kube-api-access-7wdjv\") pod \"maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh\" (UID: \"90b27a04-6f70-4b9b-b969-5c89f6ae326f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"
Jul 08 03:25:28.612024 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:28.611996    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b27a04-6f70-4b9b-b969-5c89f6ae326f-openshift-service-ca\") pod \"maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh\" (UID: \"90b27a04-6f70-4b9b-b969-5c89f6ae326f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"
Jul 08 03:25:28.713114 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:28.713083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wdjv\" (UniqueName: \"kubernetes.io/projected/90b27a04-6f70-4b9b-b969-5c89f6ae326f-kube-api-access-7wdjv\") pod \"maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh\" (UID: \"90b27a04-6f70-4b9b-b969-5c89f6ae326f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"
Jul 08 03:25:28.713291 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:28.713150    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b27a04-6f70-4b9b-b969-5c89f6ae326f-openshift-service-ca\") pod \"maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh\" (UID: \"90b27a04-6f70-4b9b-b969-5c89f6ae326f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"
Jul 08 03:25:28.713291 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:28.713194    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b27a04-6f70-4b9b-b969-5c89f6ae326f-maas-api-tls\") pod \"maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh\" (UID: \"90b27a04-6f70-4b9b-b969-5c89f6ae326f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"
Jul 08 03:25:28.713291 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:25:28.713288    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-serving-cert: secret "maas-api-e2e-ait-261cc1da-serving-cert" not found
Jul 08 03:25:28.713416 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:25:28.713350    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b27a04-6f70-4b9b-b969-5c89f6ae326f-maas-api-tls podName:90b27a04-6f70-4b9b-b969-5c89f6ae326f nodeName:}" failed. No retries permitted until 2026-07-08 03:25:29.21333315 +0000 UTC m=+1613.525611663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/90b27a04-6f70-4b9b-b969-5c89f6ae326f-maas-api-tls") pod "maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh" (UID: "90b27a04-6f70-4b9b-b969-5c89f6ae326f") : secret "maas-api-e2e-ait-261cc1da-serving-cert" not found
Jul 08 03:25:28.713836 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:28.713818    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b27a04-6f70-4b9b-b969-5c89f6ae326f-openshift-service-ca\") pod \"maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh\" (UID: \"90b27a04-6f70-4b9b-b969-5c89f6ae326f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"
Jul 08 03:25:28.721850 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:28.721819    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wdjv\" (UniqueName: \"kubernetes.io/projected/90b27a04-6f70-4b9b-b969-5c89f6ae326f-kube-api-access-7wdjv\") pod \"maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh\" (UID: \"90b27a04-6f70-4b9b-b969-5c89f6ae326f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"
Jul 08 03:25:29.218570 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:29.218533    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b27a04-6f70-4b9b-b969-5c89f6ae326f-maas-api-tls\") pod \"maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh\" (UID: \"90b27a04-6f70-4b9b-b969-5c89f6ae326f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"
Jul 08 03:25:29.221160 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:29.221119    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b27a04-6f70-4b9b-b969-5c89f6ae326f-maas-api-tls\") pod \"maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh\" (UID: \"90b27a04-6f70-4b9b-b969-5c89f6ae326f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"
Jul 08 03:25:29.423949 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:29.423909    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"
Jul 08 03:25:29.561211 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:29.561185    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"]
Jul 08 03:25:29.563142 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:25:29.563107    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b27a04_6f70_4b9b_b969_5c89f6ae326f.slice/crio-ffef95838bdc8fb40e915a1b7075a7a1d41366a7d6b7cd717b84a4624a4c559d WatchSource:0}: Error finding container ffef95838bdc8fb40e915a1b7075a7a1d41366a7d6b7cd717b84a4624a4c559d: Status 404 returned error can't find the container with id ffef95838bdc8fb40e915a1b7075a7a1d41366a7d6b7cd717b84a4624a4c559d
Jul 08 03:25:29.564418 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:29.564399    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 03:25:29.690095 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:29.690057    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh" event={"ID":"90b27a04-6f70-4b9b-b969-5c89f6ae326f","Type":"ContainerStarted","Data":"ffef95838bdc8fb40e915a1b7075a7a1d41366a7d6b7cd717b84a4624a4c559d"}
Jul 08 03:25:30.698409 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:30.698373    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh" event={"ID":"90b27a04-6f70-4b9b-b969-5c89f6ae326f","Type":"ContainerStarted","Data":"c117adb760b36cc1a908b82bfcb86c3d58d0ebe6cd4bd01c96f3d776ee9908d7"}
Jul 08 03:25:30.698861 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:30.698505    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"
Jul 08 03:25:30.716633 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:30.716587    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh" podStartSLOduration=2.241470694 podStartE2EDuration="2.716571728s" totalImagesPullingTime="475.101034ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:25:30.713977053 +0000 UTC m=+1615.026255587" watchObservedRunningTime="2026-07-08 03:25:30.716571728 +0000 UTC m=+1615.028850261"
Jul 08 03:25:36.308361 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.308333    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"]
Jul 08 03:25:36.308797 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.308508    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh" podUID="90b27a04-6f70-4b9b-b969-5c89f6ae326f" containerName="maas-api" containerID="cri-o://c117adb760b36cc1a908b82bfcb86c3d58d0ebe6cd4bd01c96f3d776ee9908d7" gracePeriod=30
Jul 08 03:25:36.314156 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.314130    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"
Jul 08 03:25:36.558272 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.558249    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"
Jul 08 03:25:36.681521 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.681444    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b27a04-6f70-4b9b-b969-5c89f6ae326f-openshift-service-ca\") pod \"90b27a04-6f70-4b9b-b969-5c89f6ae326f\" (UID: \"90b27a04-6f70-4b9b-b969-5c89f6ae326f\") "
Jul 08 03:25:36.681521 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.681506    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b27a04-6f70-4b9b-b969-5c89f6ae326f-maas-api-tls\") pod \"90b27a04-6f70-4b9b-b969-5c89f6ae326f\" (UID: \"90b27a04-6f70-4b9b-b969-5c89f6ae326f\") "
Jul 08 03:25:36.681693 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.681523    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wdjv\" (UniqueName: \"kubernetes.io/projected/90b27a04-6f70-4b9b-b969-5c89f6ae326f-kube-api-access-7wdjv\") pod \"90b27a04-6f70-4b9b-b969-5c89f6ae326f\" (UID: \"90b27a04-6f70-4b9b-b969-5c89f6ae326f\") "
Jul 08 03:25:36.681841 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.681819    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90b27a04-6f70-4b9b-b969-5c89f6ae326f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "90b27a04-6f70-4b9b-b969-5c89f6ae326f" (UID: "90b27a04-6f70-4b9b-b969-5c89f6ae326f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:25:36.683888 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.683863    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90b27a04-6f70-4b9b-b969-5c89f6ae326f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "90b27a04-6f70-4b9b-b969-5c89f6ae326f" (UID: "90b27a04-6f70-4b9b-b969-5c89f6ae326f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:25:36.684005 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.683885    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90b27a04-6f70-4b9b-b969-5c89f6ae326f-kube-api-access-7wdjv" (OuterVolumeSpecName: "kube-api-access-7wdjv") pod "90b27a04-6f70-4b9b-b969-5c89f6ae326f" (UID: "90b27a04-6f70-4b9b-b969-5c89f6ae326f"). InnerVolumeSpecName "kube-api-access-7wdjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:25:36.728204 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.728174    2578 generic.go:356] "Generic (PLEG): container finished" podID="90b27a04-6f70-4b9b-b969-5c89f6ae326f" containerID="c117adb760b36cc1a908b82bfcb86c3d58d0ebe6cd4bd01c96f3d776ee9908d7" exitCode=0
Jul 08 03:25:36.728325 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.728227    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"
Jul 08 03:25:36.728325 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.728228    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh" event={"ID":"90b27a04-6f70-4b9b-b969-5c89f6ae326f","Type":"ContainerDied","Data":"c117adb760b36cc1a908b82bfcb86c3d58d0ebe6cd4bd01c96f3d776ee9908d7"}
Jul 08 03:25:36.728325 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.728282    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh" event={"ID":"90b27a04-6f70-4b9b-b969-5c89f6ae326f","Type":"ContainerDied","Data":"ffef95838bdc8fb40e915a1b7075a7a1d41366a7d6b7cd717b84a4624a4c559d"}
Jul 08 03:25:36.728325 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.728304    2578 scope.go:117] "RemoveContainer" containerID="c117adb760b36cc1a908b82bfcb86c3d58d0ebe6cd4bd01c96f3d776ee9908d7"
Jul 08 03:25:36.737305 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.737287    2578 scope.go:117] "RemoveContainer" containerID="c117adb760b36cc1a908b82bfcb86c3d58d0ebe6cd4bd01c96f3d776ee9908d7"
Jul 08 03:25:36.737558 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:25:36.737541    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c117adb760b36cc1a908b82bfcb86c3d58d0ebe6cd4bd01c96f3d776ee9908d7\": container with ID starting with c117adb760b36cc1a908b82bfcb86c3d58d0ebe6cd4bd01c96f3d776ee9908d7 not found: ID does not exist" containerID="c117adb760b36cc1a908b82bfcb86c3d58d0ebe6cd4bd01c96f3d776ee9908d7"
Jul 08 03:25:36.737612 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.737566    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c117adb760b36cc1a908b82bfcb86c3d58d0ebe6cd4bd01c96f3d776ee9908d7"} err="failed to get container status \"c117adb760b36cc1a908b82bfcb86c3d58d0ebe6cd4bd01c96f3d776ee9908d7\": rpc error: code = NotFound desc = could not find container \"c117adb760b36cc1a908b82bfcb86c3d58d0ebe6cd4bd01c96f3d776ee9908d7\": container with ID starting with c117adb760b36cc1a908b82bfcb86c3d58d0ebe6cd4bd01c96f3d776ee9908d7 not found: ID does not exist"
Jul 08 03:25:36.750799 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.750775    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"]
Jul 08 03:25:36.756174 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.756153    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-261cc1da-775b586fcd-4ltrh"]
Jul 08 03:25:36.782112 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.782086    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b27a04-6f70-4b9b-b969-5c89f6ae326f-openshift-service-ca\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:25:36.782112 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.782108    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b27a04-6f70-4b9b-b969-5c89f6ae326f-maas-api-tls\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:25:36.782245 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:36.782119    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wdjv\" (UniqueName: \"kubernetes.io/projected/90b27a04-6f70-4b9b-b969-5c89f6ae326f-kube-api-access-7wdjv\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:25:38.163685 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:38.163652    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90b27a04-6f70-4b9b-b969-5c89f6ae326f" path="/var/lib/kubelet/pods/90b27a04-6f70-4b9b-b969-5c89f6ae326f/volumes"
Jul 08 03:25:43.794861 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:43.794830    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"]
Jul 08 03:25:43.795315 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:43.795146    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90b27a04-6f70-4b9b-b969-5c89f6ae326f" containerName="maas-api"
Jul 08 03:25:43.795315 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:43.795156    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="90b27a04-6f70-4b9b-b969-5c89f6ae326f" containerName="maas-api"
Jul 08 03:25:43.795315 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:43.795223    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="90b27a04-6f70-4b9b-b969-5c89f6ae326f" containerName="maas-api"
Jul 08 03:25:43.799608 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:43.799586    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"
Jul 08 03:25:43.801829 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:43.801801    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-17a37341-serving-cert\""
Jul 08 03:25:43.809765 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:43.809719    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"]
Jul 08 03:25:43.944111 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:43.944079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gphw\" (UniqueName: \"kubernetes.io/projected/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-kube-api-access-2gphw\") pod \"maas-api-e2e-ait-17a37341-589dcb577b-jdw88\" (UID: \"cd9c13ce-5086-4a6d-ace5-950456cf4ce9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"
Jul 08 03:25:43.944287 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:43.944141    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-openshift-service-ca\") pod \"maas-api-e2e-ait-17a37341-589dcb577b-jdw88\" (UID: \"cd9c13ce-5086-4a6d-ace5-950456cf4ce9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"
Jul 08 03:25:43.944287 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:43.944212    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-maas-api-tls\") pod \"maas-api-e2e-ait-17a37341-589dcb577b-jdw88\" (UID: \"cd9c13ce-5086-4a6d-ace5-950456cf4ce9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"
Jul 08 03:25:44.045040 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:44.044932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-openshift-service-ca\") pod \"maas-api-e2e-ait-17a37341-589dcb577b-jdw88\" (UID: \"cd9c13ce-5086-4a6d-ace5-950456cf4ce9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"
Jul 08 03:25:44.045040 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:44.044990    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-maas-api-tls\") pod \"maas-api-e2e-ait-17a37341-589dcb577b-jdw88\" (UID: \"cd9c13ce-5086-4a6d-ace5-950456cf4ce9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"
Jul 08 03:25:44.045040 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:44.045048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gphw\" (UniqueName: \"kubernetes.io/projected/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-kube-api-access-2gphw\") pod \"maas-api-e2e-ait-17a37341-589dcb577b-jdw88\" (UID: \"cd9c13ce-5086-4a6d-ace5-950456cf4ce9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"
Jul 08 03:25:44.045342 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:25:44.045166    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-serving-cert: secret "maas-api-e2e-ait-17a37341-serving-cert" not found
Jul 08 03:25:44.045342 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:25:44.045237    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-maas-api-tls podName:cd9c13ce-5086-4a6d-ace5-950456cf4ce9 nodeName:}" failed. No retries permitted until 2026-07-08 03:25:44.545221964 +0000 UTC m=+1628.857500476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-maas-api-tls") pod "maas-api-e2e-ait-17a37341-589dcb577b-jdw88" (UID: "cd9c13ce-5086-4a6d-ace5-950456cf4ce9") : secret "maas-api-e2e-ait-17a37341-serving-cert" not found
Jul 08 03:25:44.045764 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:44.045719    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-openshift-service-ca\") pod \"maas-api-e2e-ait-17a37341-589dcb577b-jdw88\" (UID: \"cd9c13ce-5086-4a6d-ace5-950456cf4ce9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"
Jul 08 03:25:44.063468 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:44.063443    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gphw\" (UniqueName: \"kubernetes.io/projected/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-kube-api-access-2gphw\") pod \"maas-api-e2e-ait-17a37341-589dcb577b-jdw88\" (UID: \"cd9c13ce-5086-4a6d-ace5-950456cf4ce9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"
Jul 08 03:25:44.550337 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:44.550307    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-maas-api-tls\") pod \"maas-api-e2e-ait-17a37341-589dcb577b-jdw88\" (UID: \"cd9c13ce-5086-4a6d-ace5-950456cf4ce9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"
Jul 08 03:25:44.550505 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:25:44.550437    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-serving-cert: secret "maas-api-e2e-ait-17a37341-serving-cert" not found
Jul 08 03:25:44.550505 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:25:44.550496    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-maas-api-tls podName:cd9c13ce-5086-4a6d-ace5-950456cf4ce9 nodeName:}" failed. No retries permitted until 2026-07-08 03:25:45.550483545 +0000 UTC m=+1629.862762057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-maas-api-tls") pod "maas-api-e2e-ait-17a37341-589dcb577b-jdw88" (UID: "cd9c13ce-5086-4a6d-ace5-950456cf4ce9") : secret "maas-api-e2e-ait-17a37341-serving-cert" not found
Jul 08 03:25:45.559189 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:45.559146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-maas-api-tls\") pod \"maas-api-e2e-ait-17a37341-589dcb577b-jdw88\" (UID: \"cd9c13ce-5086-4a6d-ace5-950456cf4ce9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"
Jul 08 03:25:45.561804 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:45.561780    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-maas-api-tls\") pod \"maas-api-e2e-ait-17a37341-589dcb577b-jdw88\" (UID: \"cd9c13ce-5086-4a6d-ace5-950456cf4ce9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"
Jul 08 03:25:45.611760 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:45.611712    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"
Jul 08 03:25:45.747636 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:45.747566    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"]
Jul 08 03:25:45.751863 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:25:45.751835    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd9c13ce_5086_4a6d_ace5_950456cf4ce9.slice/crio-16ee22fd55fb8085dd8a75498d0a69fed2a83fa0c8174e21b258714ff83f0b4f WatchSource:0}: Error finding container 16ee22fd55fb8085dd8a75498d0a69fed2a83fa0c8174e21b258714ff83f0b4f: Status 404 returned error can't find the container with id 16ee22fd55fb8085dd8a75498d0a69fed2a83fa0c8174e21b258714ff83f0b4f
Jul 08 03:25:45.774977 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:45.774939    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88" event={"ID":"cd9c13ce-5086-4a6d-ace5-950456cf4ce9","Type":"ContainerStarted","Data":"16ee22fd55fb8085dd8a75498d0a69fed2a83fa0c8174e21b258714ff83f0b4f"}
Jul 08 03:25:46.780892 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:46.780862    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88" event={"ID":"cd9c13ce-5086-4a6d-ace5-950456cf4ce9","Type":"ContainerStarted","Data":"a1b0bfb311770417fce4a5cecb927b80dd87d1b388827fb1a7d3ea2eafa8ae10"}
Jul 08 03:25:46.781253 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:46.780942    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"
Jul 08 03:25:46.799898 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:46.799770    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88" podStartSLOduration=3.435130148 podStartE2EDuration="3.799734813s" totalImagesPullingTime="364.604665ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:25:46.798774486 +0000 UTC m=+1631.111053021" watchObservedRunningTime="2026-07-08 03:25:46.799734813 +0000 UTC m=+1631.112013350"
Jul 08 03:25:51.780015 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:51.779945    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"]
Jul 08 03:25:51.780500 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:51.780263    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88" podUID="cd9c13ce-5086-4a6d-ace5-950456cf4ce9" containerName="maas-api" containerID="cri-o://a1b0bfb311770417fce4a5cecb927b80dd87d1b388827fb1a7d3ea2eafa8ae10" gracePeriod=30
Jul 08 03:25:51.786691 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:51.786670    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"
Jul 08 03:25:52.037577 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.037516    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"
Jul 08 03:25:52.116722 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.116692    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-maas-api-tls\") pod \"cd9c13ce-5086-4a6d-ace5-950456cf4ce9\" (UID: \"cd9c13ce-5086-4a6d-ace5-950456cf4ce9\") "
Jul 08 03:25:52.117244 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.116737    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gphw\" (UniqueName: \"kubernetes.io/projected/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-kube-api-access-2gphw\") pod \"cd9c13ce-5086-4a6d-ace5-950456cf4ce9\" (UID: \"cd9c13ce-5086-4a6d-ace5-950456cf4ce9\") "
Jul 08 03:25:52.117244 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.116779    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-openshift-service-ca\") pod \"cd9c13ce-5086-4a6d-ace5-950456cf4ce9\" (UID: \"cd9c13ce-5086-4a6d-ace5-950456cf4ce9\") "
Jul 08 03:25:52.117446 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.117235    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cd9c13ce-5086-4a6d-ace5-950456cf4ce9" (UID: "cd9c13ce-5086-4a6d-ace5-950456cf4ce9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:25:52.118954 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.118932    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-kube-api-access-2gphw" (OuterVolumeSpecName: "kube-api-access-2gphw") pod "cd9c13ce-5086-4a6d-ace5-950456cf4ce9" (UID: "cd9c13ce-5086-4a6d-ace5-950456cf4ce9"). InnerVolumeSpecName "kube-api-access-2gphw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:25:52.119055 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.119021    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cd9c13ce-5086-4a6d-ace5-950456cf4ce9" (UID: "cd9c13ce-5086-4a6d-ace5-950456cf4ce9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:25:52.217362 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.217325    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-maas-api-tls\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:25:52.217362 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.217356    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gphw\" (UniqueName: \"kubernetes.io/projected/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-kube-api-access-2gphw\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:25:52.217362 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.217365    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd9c13ce-5086-4a6d-ace5-950456cf4ce9-openshift-service-ca\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:25:52.813721 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.813686    2578 generic.go:356] "Generic (PLEG): container finished" podID="cd9c13ce-5086-4a6d-ace5-950456cf4ce9" containerID="a1b0bfb311770417fce4a5cecb927b80dd87d1b388827fb1a7d3ea2eafa8ae10" exitCode=0
Jul 08 03:25:52.814201 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.813734    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"
Jul 08 03:25:52.814201 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.813783    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88" event={"ID":"cd9c13ce-5086-4a6d-ace5-950456cf4ce9","Type":"ContainerDied","Data":"a1b0bfb311770417fce4a5cecb927b80dd87d1b388827fb1a7d3ea2eafa8ae10"}
Jul 08 03:25:52.814201 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.813851    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88" event={"ID":"cd9c13ce-5086-4a6d-ace5-950456cf4ce9","Type":"ContainerDied","Data":"16ee22fd55fb8085dd8a75498d0a69fed2a83fa0c8174e21b258714ff83f0b4f"}
Jul 08 03:25:52.814201 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.813883    2578 scope.go:117] "RemoveContainer" containerID="a1b0bfb311770417fce4a5cecb927b80dd87d1b388827fb1a7d3ea2eafa8ae10"
Jul 08 03:25:52.824663 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.824637    2578 scope.go:117] "RemoveContainer" containerID="a1b0bfb311770417fce4a5cecb927b80dd87d1b388827fb1a7d3ea2eafa8ae10"
Jul 08 03:25:52.825213 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:25:52.825188    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1b0bfb311770417fce4a5cecb927b80dd87d1b388827fb1a7d3ea2eafa8ae10\": container with ID starting with a1b0bfb311770417fce4a5cecb927b80dd87d1b388827fb1a7d3ea2eafa8ae10 not found: ID does not exist" containerID="a1b0bfb311770417fce4a5cecb927b80dd87d1b388827fb1a7d3ea2eafa8ae10"
Jul 08 03:25:52.825308 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.825225    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1b0bfb311770417fce4a5cecb927b80dd87d1b388827fb1a7d3ea2eafa8ae10"} err="failed to get container status \"a1b0bfb311770417fce4a5cecb927b80dd87d1b388827fb1a7d3ea2eafa8ae10\": rpc error: code = NotFound desc = could not find container \"a1b0bfb311770417fce4a5cecb927b80dd87d1b388827fb1a7d3ea2eafa8ae10\": container with ID starting with a1b0bfb311770417fce4a5cecb927b80dd87d1b388827fb1a7d3ea2eafa8ae10 not found: ID does not exist"
Jul 08 03:25:52.830912 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.830890    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"]
Jul 08 03:25:52.834496 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:52.834474    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-17a37341-589dcb577b-jdw88"]
Jul 08 03:25:54.162801 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:25:54.162771    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd9c13ce-5086-4a6d-ace5-950456cf4ce9" path="/var/lib/kubelet/pods/cd9c13ce-5086-4a6d-ace5-950456cf4ce9/volumes"
Jul 08 03:26:00.229038 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:00.229005    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"]
Jul 08 03:26:00.229486 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:00.229402    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd9c13ce-5086-4a6d-ace5-950456cf4ce9" containerName="maas-api"
Jul 08 03:26:00.229486 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:00.229415    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd9c13ce-5086-4a6d-ace5-950456cf4ce9" containerName="maas-api"
Jul 08 03:26:00.229583 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:00.229493    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd9c13ce-5086-4a6d-ace5-950456cf4ce9" containerName="maas-api"
Jul 08 03:26:00.233875 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:00.233855    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"
Jul 08 03:26:00.236032 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:00.236011    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-b93aa927-serving-cert\""
Jul 08 03:26:00.243488 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:00.243461    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"]
Jul 08 03:26:00.281508 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:00.281475    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz57f\" (UniqueName: \"kubernetes.io/projected/59527039-ec34-4140-882a-d82a2ebe0a0b-kube-api-access-rz57f\") pod \"maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r\" (UID: \"59527039-ec34-4140-882a-d82a2ebe0a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"
Jul 08 03:26:00.281670 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:00.281517    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59527039-ec34-4140-882a-d82a2ebe0a0b-maas-api-tls\") pod \"maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r\" (UID: \"59527039-ec34-4140-882a-d82a2ebe0a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"
Jul 08 03:26:00.281670 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:00.281583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59527039-ec34-4140-882a-d82a2ebe0a0b-openshift-service-ca\") pod \"maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r\" (UID: \"59527039-ec34-4140-882a-d82a2ebe0a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"
Jul 08 03:26:00.382808 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:00.382767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz57f\" (UniqueName: \"kubernetes.io/projected/59527039-ec34-4140-882a-d82a2ebe0a0b-kube-api-access-rz57f\") pod \"maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r\" (UID: \"59527039-ec34-4140-882a-d82a2ebe0a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"
Jul 08 03:26:00.382986 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:00.382819    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59527039-ec34-4140-882a-d82a2ebe0a0b-maas-api-tls\") pod \"maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r\" (UID: \"59527039-ec34-4140-882a-d82a2ebe0a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"
Jul 08 03:26:00.382986 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:00.382936    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59527039-ec34-4140-882a-d82a2ebe0a0b-openshift-service-ca\") pod \"maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r\" (UID: \"59527039-ec34-4140-882a-d82a2ebe0a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"
Jul 08 03:26:00.383111 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:26:00.382992    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-serving-cert: secret "maas-api-e2e-derive-b93aa927-serving-cert" not found
Jul 08 03:26:00.383111 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:26:00.383056    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59527039-ec34-4140-882a-d82a2ebe0a0b-maas-api-tls podName:59527039-ec34-4140-882a-d82a2ebe0a0b nodeName:}" failed. No retries permitted until 2026-07-08 03:26:00.883040023 +0000 UTC m=+1645.195318535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/59527039-ec34-4140-882a-d82a2ebe0a0b-maas-api-tls") pod "maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r" (UID: "59527039-ec34-4140-882a-d82a2ebe0a0b") : secret "maas-api-e2e-derive-b93aa927-serving-cert" not found
Jul 08 03:26:00.383441 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:00.383424    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59527039-ec34-4140-882a-d82a2ebe0a0b-openshift-service-ca\") pod \"maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r\" (UID: \"59527039-ec34-4140-882a-d82a2ebe0a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"
Jul 08 03:26:00.391115 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:00.391088    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz57f\" (UniqueName: \"kubernetes.io/projected/59527039-ec34-4140-882a-d82a2ebe0a0b-kube-api-access-rz57f\") pod \"maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r\" (UID: \"59527039-ec34-4140-882a-d82a2ebe0a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"
Jul 08 03:26:00.887484 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:00.887440    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59527039-ec34-4140-882a-d82a2ebe0a0b-maas-api-tls\") pod \"maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r\" (UID: \"59527039-ec34-4140-882a-d82a2ebe0a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"
Jul 08 03:26:00.890079 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:00.890056    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59527039-ec34-4140-882a-d82a2ebe0a0b-maas-api-tls\") pod \"maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r\" (UID: \"59527039-ec34-4140-882a-d82a2ebe0a0b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"
Jul 08 03:26:01.144639 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:01.144552    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"
Jul 08 03:26:01.295309 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:01.295282    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"]
Jul 08 03:26:01.297849 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:26:01.297819    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59527039_ec34_4140_882a_d82a2ebe0a0b.slice/crio-493598f03cb70cefdbb0fb19423fe65bd99a9d69f121f36f8657daae34797fcb WatchSource:0}: Error finding container 493598f03cb70cefdbb0fb19423fe65bd99a9d69f121f36f8657daae34797fcb: Status 404 returned error can't find the container with id 493598f03cb70cefdbb0fb19423fe65bd99a9d69f121f36f8657daae34797fcb
Jul 08 03:26:01.863279 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:01.863239    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r" event={"ID":"59527039-ec34-4140-882a-d82a2ebe0a0b","Type":"ContainerStarted","Data":"c31e1e69abc4f8a67d69f9a2869922a8e7804ebc8e95f0399f8a5c4ab4b0777e"}
Jul 08 03:26:01.863453 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:01.863299    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r" event={"ID":"59527039-ec34-4140-882a-d82a2ebe0a0b","Type":"ContainerStarted","Data":"493598f03cb70cefdbb0fb19423fe65bd99a9d69f121f36f8657daae34797fcb"}
Jul 08 03:26:01.863453 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:01.863351    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"
Jul 08 03:26:01.881362 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:01.881309    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r" podStartSLOduration=1.472965471 podStartE2EDuration="1.881292846s" totalImagesPullingTime="408.327375ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:26:01.879528336 +0000 UTC m=+1646.191806872" watchObservedRunningTime="2026-07-08 03:26:01.881292846 +0000 UTC m=+1646.193571418"
Jul 08 03:26:07.482763 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.482713    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"]
Jul 08 03:26:07.483249 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.482984    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r" podUID="59527039-ec34-4140-882a-d82a2ebe0a0b" containerName="maas-api" containerID="cri-o://c31e1e69abc4f8a67d69f9a2869922a8e7804ebc8e95f0399f8a5c4ab4b0777e" gracePeriod=30
Jul 08 03:26:07.488791 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.488771    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"
Jul 08 03:26:07.736368 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.736308    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"
Jul 08 03:26:07.849065 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.849036    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59527039-ec34-4140-882a-d82a2ebe0a0b-maas-api-tls\") pod \"59527039-ec34-4140-882a-d82a2ebe0a0b\" (UID: \"59527039-ec34-4140-882a-d82a2ebe0a0b\") "
Jul 08 03:26:07.849249 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.849070    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59527039-ec34-4140-882a-d82a2ebe0a0b-openshift-service-ca\") pod \"59527039-ec34-4140-882a-d82a2ebe0a0b\" (UID: \"59527039-ec34-4140-882a-d82a2ebe0a0b\") "
Jul 08 03:26:07.849249 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.849104    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rz57f\" (UniqueName: \"kubernetes.io/projected/59527039-ec34-4140-882a-d82a2ebe0a0b-kube-api-access-rz57f\") pod \"59527039-ec34-4140-882a-d82a2ebe0a0b\" (UID: \"59527039-ec34-4140-882a-d82a2ebe0a0b\") "
Jul 08 03:26:07.849510 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.849482    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59527039-ec34-4140-882a-d82a2ebe0a0b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "59527039-ec34-4140-882a-d82a2ebe0a0b" (UID: "59527039-ec34-4140-882a-d82a2ebe0a0b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:26:07.851440 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.851418    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59527039-ec34-4140-882a-d82a2ebe0a0b-kube-api-access-rz57f" (OuterVolumeSpecName: "kube-api-access-rz57f") pod "59527039-ec34-4140-882a-d82a2ebe0a0b" (UID: "59527039-ec34-4140-882a-d82a2ebe0a0b"). InnerVolumeSpecName "kube-api-access-rz57f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:26:07.851528 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.851451    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59527039-ec34-4140-882a-d82a2ebe0a0b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "59527039-ec34-4140-882a-d82a2ebe0a0b" (UID: "59527039-ec34-4140-882a-d82a2ebe0a0b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:26:07.893304 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.893269    2578 generic.go:356] "Generic (PLEG): container finished" podID="59527039-ec34-4140-882a-d82a2ebe0a0b" containerID="c31e1e69abc4f8a67d69f9a2869922a8e7804ebc8e95f0399f8a5c4ab4b0777e" exitCode=0
Jul 08 03:26:07.893476 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.893321    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"
Jul 08 03:26:07.893476 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.893364    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r" event={"ID":"59527039-ec34-4140-882a-d82a2ebe0a0b","Type":"ContainerDied","Data":"c31e1e69abc4f8a67d69f9a2869922a8e7804ebc8e95f0399f8a5c4ab4b0777e"}
Jul 08 03:26:07.893476 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.893422    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r" event={"ID":"59527039-ec34-4140-882a-d82a2ebe0a0b","Type":"ContainerDied","Data":"493598f03cb70cefdbb0fb19423fe65bd99a9d69f121f36f8657daae34797fcb"}
Jul 08 03:26:07.893476 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.893447    2578 scope.go:117] "RemoveContainer" containerID="c31e1e69abc4f8a67d69f9a2869922a8e7804ebc8e95f0399f8a5c4ab4b0777e"
Jul 08 03:26:07.902588 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.902572    2578 scope.go:117] "RemoveContainer" containerID="c31e1e69abc4f8a67d69f9a2869922a8e7804ebc8e95f0399f8a5c4ab4b0777e"
Jul 08 03:26:07.902889 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:26:07.902871    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c31e1e69abc4f8a67d69f9a2869922a8e7804ebc8e95f0399f8a5c4ab4b0777e\": container with ID starting with c31e1e69abc4f8a67d69f9a2869922a8e7804ebc8e95f0399f8a5c4ab4b0777e not found: ID does not exist" containerID="c31e1e69abc4f8a67d69f9a2869922a8e7804ebc8e95f0399f8a5c4ab4b0777e"
Jul 08 03:26:07.902960 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.902897    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c31e1e69abc4f8a67d69f9a2869922a8e7804ebc8e95f0399f8a5c4ab4b0777e"} err="failed to get container status \"c31e1e69abc4f8a67d69f9a2869922a8e7804ebc8e95f0399f8a5c4ab4b0777e\": rpc error: code = NotFound desc = could not find container \"c31e1e69abc4f8a67d69f9a2869922a8e7804ebc8e95f0399f8a5c4ab4b0777e\": container with ID starting with c31e1e69abc4f8a67d69f9a2869922a8e7804ebc8e95f0399f8a5c4ab4b0777e not found: ID does not exist"
Jul 08 03:26:07.913755 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.913718    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"]
Jul 08 03:26:07.919212 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.919191    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b93aa927-f6d8cdb6b-wmr4r"]
Jul 08 03:26:07.950250 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.950226    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59527039-ec34-4140-882a-d82a2ebe0a0b-maas-api-tls\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:26:07.950250 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.950247    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59527039-ec34-4140-882a-d82a2ebe0a0b-openshift-service-ca\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:26:07.950385 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:07.950258    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rz57f\" (UniqueName: \"kubernetes.io/projected/59527039-ec34-4140-882a-d82a2ebe0a0b-kube-api-access-rz57f\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:26:08.163738 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:26:08.163704    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59527039-ec34-4140-882a-d82a2ebe0a0b" path="/var/lib/kubelet/pods/59527039-ec34-4140-882a-d82a2ebe0a0b/volumes"
Jul 08 03:29:47.434837 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:47.434795    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"]
Jul 08 03:29:47.435318 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:47.435302    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59527039-ec34-4140-882a-d82a2ebe0a0b" containerName="maas-api"
Jul 08 03:29:47.435362 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:47.435321    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="59527039-ec34-4140-882a-d82a2ebe0a0b" containerName="maas-api"
Jul 08 03:29:47.435433 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:47.435422    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="59527039-ec34-4140-882a-d82a2ebe0a0b" containerName="maas-api"
Jul 08 03:29:47.438660 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:47.438637    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"
Jul 08 03:29:47.440830 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:47.440805    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ee0d907f-serving-cert\""
Jul 08 03:29:47.450481 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:47.450447    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"]
Jul 08 03:29:47.497555 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:47.497521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f01b74f1-b306-444c-a455-71f47cbc914a-maas-api-tls\") pod \"maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6\" (UID: \"f01b74f1-b306-444c-a455-71f47cbc914a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"
Jul 08 03:29:47.497734 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:47.497582    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f01b74f1-b306-444c-a455-71f47cbc914a-openshift-service-ca\") pod \"maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6\" (UID: \"f01b74f1-b306-444c-a455-71f47cbc914a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"
Jul 08 03:29:47.497734 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:47.497669    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2xff\" (UniqueName: \"kubernetes.io/projected/f01b74f1-b306-444c-a455-71f47cbc914a-kube-api-access-p2xff\") pod \"maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6\" (UID: \"f01b74f1-b306-444c-a455-71f47cbc914a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"
Jul 08 03:29:47.598813 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:47.598780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f01b74f1-b306-444c-a455-71f47cbc914a-maas-api-tls\") pod \"maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6\" (UID: \"f01b74f1-b306-444c-a455-71f47cbc914a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"
Jul 08 03:29:47.599019 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:47.598843    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f01b74f1-b306-444c-a455-71f47cbc914a-openshift-service-ca\") pod \"maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6\" (UID: \"f01b74f1-b306-444c-a455-71f47cbc914a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"
Jul 08 03:29:47.599019 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:47.598885    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2xff\" (UniqueName: \"kubernetes.io/projected/f01b74f1-b306-444c-a455-71f47cbc914a-kube-api-access-p2xff\") pod \"maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6\" (UID: \"f01b74f1-b306-444c-a455-71f47cbc914a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"
Jul 08 03:29:47.599019 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:29:47.598949    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-serving-cert: secret "maas-api-e2e-mt-ee0d907f-serving-cert" not found
Jul 08 03:29:47.599203 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:29:47.599031    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f01b74f1-b306-444c-a455-71f47cbc914a-maas-api-tls podName:f01b74f1-b306-444c-a455-71f47cbc914a nodeName:}" failed. No retries permitted until 2026-07-08 03:29:48.099008309 +0000 UTC m=+1872.411286821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f01b74f1-b306-444c-a455-71f47cbc914a-maas-api-tls") pod "maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6" (UID: "f01b74f1-b306-444c-a455-71f47cbc914a") : secret "maas-api-e2e-mt-ee0d907f-serving-cert" not found
Jul 08 03:29:47.599407 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:47.599387    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f01b74f1-b306-444c-a455-71f47cbc914a-openshift-service-ca\") pod \"maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6\" (UID: \"f01b74f1-b306-444c-a455-71f47cbc914a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"
Jul 08 03:29:47.634348 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:47.634320    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2xff\" (UniqueName: \"kubernetes.io/projected/f01b74f1-b306-444c-a455-71f47cbc914a-kube-api-access-p2xff\") pod \"maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6\" (UID: \"f01b74f1-b306-444c-a455-71f47cbc914a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"
Jul 08 03:29:48.103691 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:48.103643    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f01b74f1-b306-444c-a455-71f47cbc914a-maas-api-tls\") pod \"maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6\" (UID: \"f01b74f1-b306-444c-a455-71f47cbc914a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"
Jul 08 03:29:48.106199 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:48.106174    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f01b74f1-b306-444c-a455-71f47cbc914a-maas-api-tls\") pod \"maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6\" (UID: \"f01b74f1-b306-444c-a455-71f47cbc914a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"
Jul 08 03:29:48.358853 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:48.358735    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"
Jul 08 03:29:48.532306 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:48.532280    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"]
Jul 08 03:29:48.534240 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:29:48.534212    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf01b74f1_b306_444c_a455_71f47cbc914a.slice/crio-9e2485453de4b54579ebaf129fa2743734f7a27ffb35e9b75f634485fd69b448 WatchSource:0}: Error finding container 9e2485453de4b54579ebaf129fa2743734f7a27ffb35e9b75f634485fd69b448: Status 404 returned error can't find the container with id 9e2485453de4b54579ebaf129fa2743734f7a27ffb35e9b75f634485fd69b448
Jul 08 03:29:48.978277 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:48.978246    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6" event={"ID":"f01b74f1-b306-444c-a455-71f47cbc914a","Type":"ContainerStarted","Data":"9e2485453de4b54579ebaf129fa2743734f7a27ffb35e9b75f634485fd69b448"}
Jul 08 03:29:49.985065 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:49.985023    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6" event={"ID":"f01b74f1-b306-444c-a455-71f47cbc914a","Type":"ContainerStarted","Data":"b0eb1c59d0e719dc78374c5c0411b200fffe57d0c56c8e4e70a3e4dee0110f75"}
Jul 08 03:29:49.985530 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:49.985114    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"
Jul 08 03:29:50.000637 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:50.000590    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6" podStartSLOduration=2.5036084929999998 podStartE2EDuration="3.000575287s" totalImagesPullingTime="496.966794ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:29:49.999346256 +0000 UTC m=+1874.311624788" watchObservedRunningTime="2026-07-08 03:29:50.000575287 +0000 UTC m=+1874.312853820"
Jul 08 03:29:55.995525 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:55.995500    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"
Jul 08 03:29:59.446051 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:59.445970    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"]
Jul 08 03:29:59.446486 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:59.446208    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6" podUID="f01b74f1-b306-444c-a455-71f47cbc914a" containerName="maas-api" containerID="cri-o://b0eb1c59d0e719dc78374c5c0411b200fffe57d0c56c8e4e70a3e4dee0110f75" gracePeriod=30
Jul 08 03:29:59.689075 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:59.689054    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"
Jul 08 03:29:59.814073 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:59.814046    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f01b74f1-b306-444c-a455-71f47cbc914a-maas-api-tls\") pod \"f01b74f1-b306-444c-a455-71f47cbc914a\" (UID: \"f01b74f1-b306-444c-a455-71f47cbc914a\") "
Jul 08 03:29:59.814236 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:59.814082    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2xff\" (UniqueName: \"kubernetes.io/projected/f01b74f1-b306-444c-a455-71f47cbc914a-kube-api-access-p2xff\") pod \"f01b74f1-b306-444c-a455-71f47cbc914a\" (UID: \"f01b74f1-b306-444c-a455-71f47cbc914a\") "
Jul 08 03:29:59.814236 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:59.814111    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f01b74f1-b306-444c-a455-71f47cbc914a-openshift-service-ca\") pod \"f01b74f1-b306-444c-a455-71f47cbc914a\" (UID: \"f01b74f1-b306-444c-a455-71f47cbc914a\") "
Jul 08 03:29:59.814487 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:59.814454    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f01b74f1-b306-444c-a455-71f47cbc914a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f01b74f1-b306-444c-a455-71f47cbc914a" (UID: "f01b74f1-b306-444c-a455-71f47cbc914a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:29:59.816313 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:59.816286    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f01b74f1-b306-444c-a455-71f47cbc914a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f01b74f1-b306-444c-a455-71f47cbc914a" (UID: "f01b74f1-b306-444c-a455-71f47cbc914a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:29:59.816388 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:59.816306    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f01b74f1-b306-444c-a455-71f47cbc914a-kube-api-access-p2xff" (OuterVolumeSpecName: "kube-api-access-p2xff") pod "f01b74f1-b306-444c-a455-71f47cbc914a" (UID: "f01b74f1-b306-444c-a455-71f47cbc914a"). InnerVolumeSpecName "kube-api-access-p2xff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:29:59.914889 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:59.914855    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f01b74f1-b306-444c-a455-71f47cbc914a-maas-api-tls\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:29:59.914889 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:59.914881    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2xff\" (UniqueName: \"kubernetes.io/projected/f01b74f1-b306-444c-a455-71f47cbc914a-kube-api-access-p2xff\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:29:59.914889 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:29:59.914891    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f01b74f1-b306-444c-a455-71f47cbc914a-openshift-service-ca\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:30:00.037180 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:00.037139    2578 generic.go:356] "Generic (PLEG): container finished" podID="f01b74f1-b306-444c-a455-71f47cbc914a" containerID="b0eb1c59d0e719dc78374c5c0411b200fffe57d0c56c8e4e70a3e4dee0110f75" exitCode=0
Jul 08 03:30:00.037346 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:00.037191    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"
Jul 08 03:30:00.037346 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:00.037223    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6" event={"ID":"f01b74f1-b306-444c-a455-71f47cbc914a","Type":"ContainerDied","Data":"b0eb1c59d0e719dc78374c5c0411b200fffe57d0c56c8e4e70a3e4dee0110f75"}
Jul 08 03:30:00.037346 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:00.037282    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6" event={"ID":"f01b74f1-b306-444c-a455-71f47cbc914a","Type":"ContainerDied","Data":"9e2485453de4b54579ebaf129fa2743734f7a27ffb35e9b75f634485fd69b448"}
Jul 08 03:30:00.037346 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:00.037312    2578 scope.go:117] "RemoveContainer" containerID="b0eb1c59d0e719dc78374c5c0411b200fffe57d0c56c8e4e70a3e4dee0110f75"
Jul 08 03:30:00.046858 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:00.046835    2578 scope.go:117] "RemoveContainer" containerID="b0eb1c59d0e719dc78374c5c0411b200fffe57d0c56c8e4e70a3e4dee0110f75"
Jul 08 03:30:00.047120 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:30:00.047103    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0eb1c59d0e719dc78374c5c0411b200fffe57d0c56c8e4e70a3e4dee0110f75\": container with ID starting with b0eb1c59d0e719dc78374c5c0411b200fffe57d0c56c8e4e70a3e4dee0110f75 not found: ID does not exist" containerID="b0eb1c59d0e719dc78374c5c0411b200fffe57d0c56c8e4e70a3e4dee0110f75"
Jul 08 03:30:00.047164 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:00.047129    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0eb1c59d0e719dc78374c5c0411b200fffe57d0c56c8e4e70a3e4dee0110f75"} err="failed to get container status \"b0eb1c59d0e719dc78374c5c0411b200fffe57d0c56c8e4e70a3e4dee0110f75\": rpc error: code = NotFound desc = could not find container \"b0eb1c59d0e719dc78374c5c0411b200fffe57d0c56c8e4e70a3e4dee0110f75\": container with ID starting with b0eb1c59d0e719dc78374c5c0411b200fffe57d0c56c8e4e70a3e4dee0110f75 not found: ID does not exist"
Jul 08 03:30:00.059666 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:00.059642    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"]
Jul 08 03:30:00.063147 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:00.063126    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ee0d907f-5bd8975854-b98c6"]
Jul 08 03:30:00.168496 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:00.164834    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f01b74f1-b306-444c-a455-71f47cbc914a" path="/var/lib/kubelet/pods/f01b74f1-b306-444c-a455-71f47cbc914a/volumes"
Jul 08 03:30:27.581485 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:27.581446    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"]
Jul 08 03:30:27.581995 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:27.581819    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f01b74f1-b306-444c-a455-71f47cbc914a" containerName="maas-api"
Jul 08 03:30:27.581995 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:27.581831    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f01b74f1-b306-444c-a455-71f47cbc914a" containerName="maas-api"
Jul 08 03:30:27.581995 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:27.581886    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f01b74f1-b306-444c-a455-71f47cbc914a" containerName="maas-api"
Jul 08 03:30:27.584784 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:27.584766    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"
Jul 08 03:30:27.586822 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:27.586800    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-1cf90851-serving-cert\""
Jul 08 03:30:27.594855 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:27.594818    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"]
Jul 08 03:30:27.646138 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:27.646107    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9659e5ef-11be-46d0-b01d-bfa221c80b2a-maas-api-tls\") pod \"maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c\" (UID: \"9659e5ef-11be-46d0-b01d-bfa221c80b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"
Jul 08 03:30:27.646277 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:27.646151    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh7k2\" (UniqueName: \"kubernetes.io/projected/9659e5ef-11be-46d0-b01d-bfa221c80b2a-kube-api-access-nh7k2\") pod \"maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c\" (UID: \"9659e5ef-11be-46d0-b01d-bfa221c80b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"
Jul 08 03:30:27.646277 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:27.646225    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9659e5ef-11be-46d0-b01d-bfa221c80b2a-openshift-service-ca\") pod \"maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c\" (UID: \"9659e5ef-11be-46d0-b01d-bfa221c80b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"
Jul 08 03:30:27.746830 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:27.746793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9659e5ef-11be-46d0-b01d-bfa221c80b2a-openshift-service-ca\") pod \"maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c\" (UID: \"9659e5ef-11be-46d0-b01d-bfa221c80b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"
Jul 08 03:30:27.747010 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:27.746873    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9659e5ef-11be-46d0-b01d-bfa221c80b2a-maas-api-tls\") pod \"maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c\" (UID: \"9659e5ef-11be-46d0-b01d-bfa221c80b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"
Jul 08 03:30:27.747010 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:27.746923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh7k2\" (UniqueName: \"kubernetes.io/projected/9659e5ef-11be-46d0-b01d-bfa221c80b2a-kube-api-access-nh7k2\") pod \"maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c\" (UID: \"9659e5ef-11be-46d0-b01d-bfa221c80b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"
Jul 08 03:30:27.747125 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:30:27.747015    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-serving-cert: secret "maas-api-e2e-mt-1cf90851-serving-cert" not found
Jul 08 03:30:27.747125 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:30:27.747090    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9659e5ef-11be-46d0-b01d-bfa221c80b2a-maas-api-tls podName:9659e5ef-11be-46d0-b01d-bfa221c80b2a nodeName:}" failed. No retries permitted until 2026-07-08 03:30:28.247074752 +0000 UTC m=+1912.559353264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9659e5ef-11be-46d0-b01d-bfa221c80b2a-maas-api-tls") pod "maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c" (UID: "9659e5ef-11be-46d0-b01d-bfa221c80b2a") : secret "maas-api-e2e-mt-1cf90851-serving-cert" not found
Jul 08 03:30:27.747487 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:27.747467    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9659e5ef-11be-46d0-b01d-bfa221c80b2a-openshift-service-ca\") pod \"maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c\" (UID: \"9659e5ef-11be-46d0-b01d-bfa221c80b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"
Jul 08 03:30:27.757823 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:27.757796    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh7k2\" (UniqueName: \"kubernetes.io/projected/9659e5ef-11be-46d0-b01d-bfa221c80b2a-kube-api-access-nh7k2\") pod \"maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c\" (UID: \"9659e5ef-11be-46d0-b01d-bfa221c80b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"
Jul 08 03:30:28.252573 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:28.252535    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9659e5ef-11be-46d0-b01d-bfa221c80b2a-maas-api-tls\") pod \"maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c\" (UID: \"9659e5ef-11be-46d0-b01d-bfa221c80b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"
Jul 08 03:30:28.255035 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:28.255011    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9659e5ef-11be-46d0-b01d-bfa221c80b2a-maas-api-tls\") pod \"maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c\" (UID: \"9659e5ef-11be-46d0-b01d-bfa221c80b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"
Jul 08 03:30:28.496821 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:28.496785    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"
Jul 08 03:30:28.631673 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:28.631642    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"]
Jul 08 03:30:28.635209 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:30:28.635173    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9659e5ef_11be_46d0_b01d_bfa221c80b2a.slice/crio-e5a8b1f12d21895132f366ee7041de51bab4f7d10f0ea260614ed47368ff4341 WatchSource:0}: Error finding container e5a8b1f12d21895132f366ee7041de51bab4f7d10f0ea260614ed47368ff4341: Status 404 returned error can't find the container with id e5a8b1f12d21895132f366ee7041de51bab4f7d10f0ea260614ed47368ff4341
Jul 08 03:30:29.177399 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:29.177365    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c" event={"ID":"9659e5ef-11be-46d0-b01d-bfa221c80b2a","Type":"ContainerStarted","Data":"8dd35f2bef2cedf0c66ecc31fdb36d1f28e45677a647f8b728364499c38bff9b"}
Jul 08 03:30:29.177399 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:29.177411    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c" event={"ID":"9659e5ef-11be-46d0-b01d-bfa221c80b2a","Type":"ContainerStarted","Data":"e5a8b1f12d21895132f366ee7041de51bab4f7d10f0ea260614ed47368ff4341"}
Jul 08 03:30:29.177624 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:29.177430    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"
Jul 08 03:30:29.194461 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:29.194360    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c" podStartSLOduration=1.898032348 podStartE2EDuration="2.19434642s" totalImagesPullingTime="296.314072ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:30:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:30:29.191467867 +0000 UTC m=+1913.503746401" watchObservedRunningTime="2026-07-08 03:30:29.19434642 +0000 UTC m=+1913.506624954"
Jul 08 03:30:35.187628 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:30:35.187596    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"
Jul 08 03:31:26.020715 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.020678    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"]
Jul 08 03:31:26.021288 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.020961    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c" podUID="9659e5ef-11be-46d0-b01d-bfa221c80b2a" containerName="maas-api" containerID="cri-o://8dd35f2bef2cedf0c66ecc31fdb36d1f28e45677a647f8b728364499c38bff9b" gracePeriod=30
Jul 08 03:31:26.268954 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.268927    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"
Jul 08 03:31:26.384685 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.384653    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9659e5ef-11be-46d0-b01d-bfa221c80b2a-maas-api-tls\") pod \"9659e5ef-11be-46d0-b01d-bfa221c80b2a\" (UID: \"9659e5ef-11be-46d0-b01d-bfa221c80b2a\") "
Jul 08 03:31:26.384932 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.384716    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nh7k2\" (UniqueName: \"kubernetes.io/projected/9659e5ef-11be-46d0-b01d-bfa221c80b2a-kube-api-access-nh7k2\") pod \"9659e5ef-11be-46d0-b01d-bfa221c80b2a\" (UID: \"9659e5ef-11be-46d0-b01d-bfa221c80b2a\") "
Jul 08 03:31:26.384932 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.384803    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9659e5ef-11be-46d0-b01d-bfa221c80b2a-openshift-service-ca\") pod \"9659e5ef-11be-46d0-b01d-bfa221c80b2a\" (UID: \"9659e5ef-11be-46d0-b01d-bfa221c80b2a\") "
Jul 08 03:31:26.385176 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.385136    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9659e5ef-11be-46d0-b01d-bfa221c80b2a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9659e5ef-11be-46d0-b01d-bfa221c80b2a" (UID: "9659e5ef-11be-46d0-b01d-bfa221c80b2a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:31:26.386966 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.386942    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9659e5ef-11be-46d0-b01d-bfa221c80b2a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9659e5ef-11be-46d0-b01d-bfa221c80b2a" (UID: "9659e5ef-11be-46d0-b01d-bfa221c80b2a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:31:26.387047 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.387005    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9659e5ef-11be-46d0-b01d-bfa221c80b2a-kube-api-access-nh7k2" (OuterVolumeSpecName: "kube-api-access-nh7k2") pod "9659e5ef-11be-46d0-b01d-bfa221c80b2a" (UID: "9659e5ef-11be-46d0-b01d-bfa221c80b2a"). InnerVolumeSpecName "kube-api-access-nh7k2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:31:26.460936 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.460900    2578 generic.go:356] "Generic (PLEG): container finished" podID="9659e5ef-11be-46d0-b01d-bfa221c80b2a" containerID="8dd35f2bef2cedf0c66ecc31fdb36d1f28e45677a647f8b728364499c38bff9b" exitCode=0
Jul 08 03:31:26.461108 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.460941    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"
Jul 08 03:31:26.461108 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.460984    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c" event={"ID":"9659e5ef-11be-46d0-b01d-bfa221c80b2a","Type":"ContainerDied","Data":"8dd35f2bef2cedf0c66ecc31fdb36d1f28e45677a647f8b728364499c38bff9b"}
Jul 08 03:31:26.461108 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.461042    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c" event={"ID":"9659e5ef-11be-46d0-b01d-bfa221c80b2a","Type":"ContainerDied","Data":"e5a8b1f12d21895132f366ee7041de51bab4f7d10f0ea260614ed47368ff4341"}
Jul 08 03:31:26.461108 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.461070    2578 scope.go:117] "RemoveContainer" containerID="8dd35f2bef2cedf0c66ecc31fdb36d1f28e45677a647f8b728364499c38bff9b"
Jul 08 03:31:26.470232 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.470145    2578 scope.go:117] "RemoveContainer" containerID="8dd35f2bef2cedf0c66ecc31fdb36d1f28e45677a647f8b728364499c38bff9b"
Jul 08 03:31:26.470406 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:31:26.470388    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dd35f2bef2cedf0c66ecc31fdb36d1f28e45677a647f8b728364499c38bff9b\": container with ID starting with 8dd35f2bef2cedf0c66ecc31fdb36d1f28e45677a647f8b728364499c38bff9b not found: ID does not exist" containerID="8dd35f2bef2cedf0c66ecc31fdb36d1f28e45677a647f8b728364499c38bff9b"
Jul 08 03:31:26.470455 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.470417    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dd35f2bef2cedf0c66ecc31fdb36d1f28e45677a647f8b728364499c38bff9b"} err="failed to get container status \"8dd35f2bef2cedf0c66ecc31fdb36d1f28e45677a647f8b728364499c38bff9b\": rpc error: code = NotFound desc = could not find container \"8dd35f2bef2cedf0c66ecc31fdb36d1f28e45677a647f8b728364499c38bff9b\": container with ID starting with 8dd35f2bef2cedf0c66ecc31fdb36d1f28e45677a647f8b728364499c38bff9b not found: ID does not exist"
Jul 08 03:31:26.481699 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.481680    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"]
Jul 08 03:31:26.485843 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.485818    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1cf90851-6b9d4fd9d5-rcm4c"]
Jul 08 03:31:26.486272 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.486253    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9659e5ef-11be-46d0-b01d-bfa221c80b2a-openshift-service-ca\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:31:26.486338 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.486280    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9659e5ef-11be-46d0-b01d-bfa221c80b2a-maas-api-tls\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:31:26.486338 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:26.486296    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nh7k2\" (UniqueName: \"kubernetes.io/projected/9659e5ef-11be-46d0-b01d-bfa221c80b2a-kube-api-access-nh7k2\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:31:28.162818 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:31:28.162782    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9659e5ef-11be-46d0-b01d-bfa221c80b2a" path="/var/lib/kubelet/pods/9659e5ef-11be-46d0-b01d-bfa221c80b2a/volumes"
Jul 08 03:34:42.778358 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:42.778283    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"]
Jul 08 03:34:42.778822 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:42.778641    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9659e5ef-11be-46d0-b01d-bfa221c80b2a" containerName="maas-api"
Jul 08 03:34:42.778822 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:42.778652    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9659e5ef-11be-46d0-b01d-bfa221c80b2a" containerName="maas-api"
Jul 08 03:34:42.778822 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:42.778700    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9659e5ef-11be-46d0-b01d-bfa221c80b2a" containerName="maas-api"
Jul 08 03:34:42.781610 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:42.781593    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"
Jul 08 03:34:42.784197 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:42.784178    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-2515cc-serving-cert\""
Jul 08 03:34:42.810113 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:42.810084    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"]
Jul 08 03:34:42.927517 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:42.927482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/413f5b28-765d-45a5-abe6-dd74e091b14e-maas-api-tls\") pod \"maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55\" (UID: \"413f5b28-765d-45a5-abe6-dd74e091b14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"
Jul 08 03:34:42.927678 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:42.927532    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/413f5b28-765d-45a5-abe6-dd74e091b14e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55\" (UID: \"413f5b28-765d-45a5-abe6-dd74e091b14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"
Jul 08 03:34:42.927678 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:42.927549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj7q4\" (UniqueName: \"kubernetes.io/projected/413f5b28-765d-45a5-abe6-dd74e091b14e-kube-api-access-zj7q4\") pod \"maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55\" (UID: \"413f5b28-765d-45a5-abe6-dd74e091b14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"
Jul 08 03:34:43.028732 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:43.028649    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/413f5b28-765d-45a5-abe6-dd74e091b14e-maas-api-tls\") pod \"maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55\" (UID: \"413f5b28-765d-45a5-abe6-dd74e091b14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"
Jul 08 03:34:43.028732 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:43.028700    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/413f5b28-765d-45a5-abe6-dd74e091b14e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55\" (UID: \"413f5b28-765d-45a5-abe6-dd74e091b14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"
Jul 08 03:34:43.028732 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:43.028720    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj7q4\" (UniqueName: \"kubernetes.io/projected/413f5b28-765d-45a5-abe6-dd74e091b14e-kube-api-access-zj7q4\") pod \"maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55\" (UID: \"413f5b28-765d-45a5-abe6-dd74e091b14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"
Jul 08 03:34:43.028965 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:34:43.028846    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-serving-cert: secret "maas-api-e2e-inf-a-2515cc-serving-cert" not found
Jul 08 03:34:43.028965 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:34:43.028923    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/413f5b28-765d-45a5-abe6-dd74e091b14e-maas-api-tls podName:413f5b28-765d-45a5-abe6-dd74e091b14e nodeName:}" failed. No retries permitted until 2026-07-08 03:34:43.528903604 +0000 UTC m=+2167.841182116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/413f5b28-765d-45a5-abe6-dd74e091b14e-maas-api-tls") pod "maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55" (UID: "413f5b28-765d-45a5-abe6-dd74e091b14e") : secret "maas-api-e2e-inf-a-2515cc-serving-cert" not found
Jul 08 03:34:43.029407 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:43.029387    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/413f5b28-765d-45a5-abe6-dd74e091b14e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55\" (UID: \"413f5b28-765d-45a5-abe6-dd74e091b14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"
Jul 08 03:34:43.038843 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:43.038821    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj7q4\" (UniqueName: \"kubernetes.io/projected/413f5b28-765d-45a5-abe6-dd74e091b14e-kube-api-access-zj7q4\") pod \"maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55\" (UID: \"413f5b28-765d-45a5-abe6-dd74e091b14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"
Jul 08 03:34:43.534080 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:43.534049    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/413f5b28-765d-45a5-abe6-dd74e091b14e-maas-api-tls\") pod \"maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55\" (UID: \"413f5b28-765d-45a5-abe6-dd74e091b14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"
Jul 08 03:34:43.536527 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:43.536497    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/413f5b28-765d-45a5-abe6-dd74e091b14e-maas-api-tls\") pod \"maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55\" (UID: \"413f5b28-765d-45a5-abe6-dd74e091b14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"
Jul 08 03:34:43.691556 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:43.691520    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"
Jul 08 03:34:43.829663 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:43.829640    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"]
Jul 08 03:34:43.831803 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:34:43.831770    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod413f5b28_765d_45a5_abe6_dd74e091b14e.slice/crio-44a1947bfa423db34729e6b3d1600b6dc6048e453cc5e370a7f9616de8a475a2 WatchSource:0}: Error finding container 44a1947bfa423db34729e6b3d1600b6dc6048e453cc5e370a7f9616de8a475a2: Status 404 returned error can't find the container with id 44a1947bfa423db34729e6b3d1600b6dc6048e453cc5e370a7f9616de8a475a2
Jul 08 03:34:43.833197 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:43.833181    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 03:34:44.460616 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:44.460580    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55" event={"ID":"413f5b28-765d-45a5-abe6-dd74e091b14e","Type":"ContainerStarted","Data":"c767ab710e7db30b764830630b32f78c3df70c6596192ab2a6502ad956e68a97"}
Jul 08 03:34:44.460818 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:44.460642    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55" event={"ID":"413f5b28-765d-45a5-abe6-dd74e091b14e","Type":"ContainerStarted","Data":"44a1947bfa423db34729e6b3d1600b6dc6048e453cc5e370a7f9616de8a475a2"}
Jul 08 03:34:44.460818 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:44.460706    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"
Jul 08 03:34:44.479481 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:44.479434    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55" podStartSLOduration=2.0491813739999998 podStartE2EDuration="2.479420816s" totalImagesPullingTime="430.239442ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:34:44.476931037 +0000 UTC m=+2168.789209572" watchObservedRunningTime="2026-07-08 03:34:44.479420816 +0000 UTC m=+2168.791699350"
Jul 08 03:34:50.470883 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:50.470849    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"
Jul 08 03:34:54.438242 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:54.438203    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"]
Jul 08 03:34:54.442406 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:54.442384    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"
Jul 08 03:34:54.444836 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:54.444810    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-7142f2-serving-cert\""
Jul 08 03:34:54.452395 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:54.452369    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"]
Jul 08 03:34:54.532585 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:54.532555    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwwqv\" (UniqueName: \"kubernetes.io/projected/26c511d3-f77a-479a-842c-dc72185561ea-kube-api-access-rwwqv\") pod \"maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp\" (UID: \"26c511d3-f77a-479a-842c-dc72185561ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"
Jul 08 03:34:54.532804 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:54.532600    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26c511d3-f77a-479a-842c-dc72185561ea-maas-api-tls\") pod \"maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp\" (UID: \"26c511d3-f77a-479a-842c-dc72185561ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"
Jul 08 03:34:54.532804 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:54.532637    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26c511d3-f77a-479a-842c-dc72185561ea-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp\" (UID: \"26c511d3-f77a-479a-842c-dc72185561ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"
Jul 08 03:34:54.633853 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:54.633813    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26c511d3-f77a-479a-842c-dc72185561ea-maas-api-tls\") pod \"maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp\" (UID: \"26c511d3-f77a-479a-842c-dc72185561ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"
Jul 08 03:34:54.634017 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:54.633871    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26c511d3-f77a-479a-842c-dc72185561ea-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp\" (UID: \"26c511d3-f77a-479a-842c-dc72185561ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"
Jul 08 03:34:54.634017 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:54.633935    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwwqv\" (UniqueName: \"kubernetes.io/projected/26c511d3-f77a-479a-842c-dc72185561ea-kube-api-access-rwwqv\") pod \"maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp\" (UID: \"26c511d3-f77a-479a-842c-dc72185561ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"
Jul 08 03:34:54.634594 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:54.634575    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26c511d3-f77a-479a-842c-dc72185561ea-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp\" (UID: \"26c511d3-f77a-479a-842c-dc72185561ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"
Jul 08 03:34:54.636395 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:54.636374    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26c511d3-f77a-479a-842c-dc72185561ea-maas-api-tls\") pod \"maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp\" (UID: \"26c511d3-f77a-479a-842c-dc72185561ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"
Jul 08 03:34:54.641518 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:54.641491    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwwqv\" (UniqueName: \"kubernetes.io/projected/26c511d3-f77a-479a-842c-dc72185561ea-kube-api-access-rwwqv\") pod \"maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp\" (UID: \"26c511d3-f77a-479a-842c-dc72185561ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"
Jul 08 03:34:54.755026 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:54.754941    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"
Jul 08 03:34:54.893678 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:54.893655    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"]
Jul 08 03:34:54.896453 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:34:54.896427    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c511d3_f77a_479a_842c_dc72185561ea.slice/crio-c3ef11f726efb75d8e41d1e8f984226fa6e14a02349a08c48d39fa560cb4d0bf WatchSource:0}: Error finding container c3ef11f726efb75d8e41d1e8f984226fa6e14a02349a08c48d39fa560cb4d0bf: Status 404 returned error can't find the container with id c3ef11f726efb75d8e41d1e8f984226fa6e14a02349a08c48d39fa560cb4d0bf
Jul 08 03:34:55.519136 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:55.519054    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp" event={"ID":"26c511d3-f77a-479a-842c-dc72185561ea","Type":"ContainerStarted","Data":"6d02f4cb5629d2f3640159f4a3b4d55fdab8ba8b0f81a887a276a0b51a894237"}
Jul 08 03:34:55.519136 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:55.519103    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp" event={"ID":"26c511d3-f77a-479a-842c-dc72185561ea","Type":"ContainerStarted","Data":"c3ef11f726efb75d8e41d1e8f984226fa6e14a02349a08c48d39fa560cb4d0bf"}
Jul 08 03:34:55.519526 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:55.519148    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"
Jul 08 03:34:55.538343 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:34:55.538300    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp" podStartSLOduration=1.190952499 podStartE2EDuration="1.538285006s" totalImagesPullingTime="347.332507ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:34:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:34:55.535617666 +0000 UTC m=+2179.847896200" watchObservedRunningTime="2026-07-08 03:34:55.538285006 +0000 UTC m=+2179.850563540"
Jul 08 03:35:01.530387 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:35:01.530358    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"
Jul 08 03:35:59.906193 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:35:59.906111    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"]
Jul 08 03:35:59.909719 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:35:59.909701    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"
Jul 08 03:35:59.911872 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:35:59.911851    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-reuse-25332d-serving-cert\""
Jul 08 03:35:59.920559 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:35:59.920540    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"]
Jul 08 03:36:00.011232 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:00.011192    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fd2ad51-8633-44ea-b0dd-4fc25525b486-maas-api-tls\") pod \"maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl\" (UID: \"5fd2ad51-8633-44ea-b0dd-4fc25525b486\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"
Jul 08 03:36:00.011417 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:00.011251    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq72m\" (UniqueName: \"kubernetes.io/projected/5fd2ad51-8633-44ea-b0dd-4fc25525b486-kube-api-access-vq72m\") pod \"maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl\" (UID: \"5fd2ad51-8633-44ea-b0dd-4fc25525b486\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"
Jul 08 03:36:00.011417 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:00.011271    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fd2ad51-8633-44ea-b0dd-4fc25525b486-openshift-service-ca\") pod \"maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl\" (UID: \"5fd2ad51-8633-44ea-b0dd-4fc25525b486\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"
Jul 08 03:36:00.112322 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:00.112281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fd2ad51-8633-44ea-b0dd-4fc25525b486-maas-api-tls\") pod \"maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl\" (UID: \"5fd2ad51-8633-44ea-b0dd-4fc25525b486\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"
Jul 08 03:36:00.112508 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:00.112351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq72m\" (UniqueName: \"kubernetes.io/projected/5fd2ad51-8633-44ea-b0dd-4fc25525b486-kube-api-access-vq72m\") pod \"maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl\" (UID: \"5fd2ad51-8633-44ea-b0dd-4fc25525b486\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"
Jul 08 03:36:00.112508 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:00.112380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fd2ad51-8633-44ea-b0dd-4fc25525b486-openshift-service-ca\") pod \"maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl\" (UID: \"5fd2ad51-8633-44ea-b0dd-4fc25525b486\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"
Jul 08 03:36:00.113161 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:00.113142    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fd2ad51-8633-44ea-b0dd-4fc25525b486-openshift-service-ca\") pod \"maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl\" (UID: \"5fd2ad51-8633-44ea-b0dd-4fc25525b486\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"
Jul 08 03:36:00.115093 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:00.115069    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fd2ad51-8633-44ea-b0dd-4fc25525b486-maas-api-tls\") pod \"maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl\" (UID: \"5fd2ad51-8633-44ea-b0dd-4fc25525b486\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"
Jul 08 03:36:00.120823 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:00.120803    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq72m\" (UniqueName: \"kubernetes.io/projected/5fd2ad51-8633-44ea-b0dd-4fc25525b486-kube-api-access-vq72m\") pod \"maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl\" (UID: \"5fd2ad51-8633-44ea-b0dd-4fc25525b486\") " pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"
Jul 08 03:36:00.220182 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:00.220094    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"
Jul 08 03:36:00.357641 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:00.357611    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"]
Jul 08 03:36:00.360684 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:36:00.360661    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd2ad51_8633_44ea_b0dd_4fc25525b486.slice/crio-cbfeae23af9d229b3ed14f16fa8b19ed25a7eff75eed0c86a639df5af7956be6 WatchSource:0}: Error finding container cbfeae23af9d229b3ed14f16fa8b19ed25a7eff75eed0c86a639df5af7956be6: Status 404 returned error can't find the container with id cbfeae23af9d229b3ed14f16fa8b19ed25a7eff75eed0c86a639df5af7956be6
Jul 08 03:36:00.854314 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:00.854280    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl" event={"ID":"5fd2ad51-8633-44ea-b0dd-4fc25525b486","Type":"ContainerStarted","Data":"cfc3406186348aa958c1f2029a8608ba81c907ad93967eb017e5dcc8e73fff0f"}
Jul 08 03:36:00.854478 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:00.854334    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl" event={"ID":"5fd2ad51-8633-44ea-b0dd-4fc25525b486","Type":"ContainerStarted","Data":"cbfeae23af9d229b3ed14f16fa8b19ed25a7eff75eed0c86a639df5af7956be6"}
Jul 08 03:36:00.854478 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:00.854366    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"
Jul 08 03:36:00.873800 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:00.873733    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl" podStartSLOduration=1.503619295 podStartE2EDuration="1.873717187s" totalImagesPullingTime="370.097892ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:35:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:36:00.872436556 +0000 UTC m=+2245.184715094" watchObservedRunningTime="2026-07-08 03:36:00.873717187 +0000 UTC m=+2245.185995721"
Jul 08 03:36:06.865832 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:06.865803    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"
Jul 08 03:36:33.606262 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.606226    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"]
Jul 08 03:36:33.609815 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.609797    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.613190 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.613167    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-25332d\"/\"default-dockercfg-6fkh6\""
Jul 08 03:36:33.613323 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.613174    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-25332d\"/\"test-model-25332d-kserve-self-signed-certs\""
Jul 08 03:36:33.613422 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.613408    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-25332d\"/\"kube-root-ca.crt\""
Jul 08 03:36:33.613488 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.613431    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-25332d\"/\"openshift-service-ca.crt\""
Jul 08 03:36:33.620033 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.620011    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"]
Jul 08 03:36:33.717323 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.717293    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j94rw\" (UniqueName: \"kubernetes.io/projected/42101123-ec43-4cac-b1eb-67063d033fca-kube-api-access-j94rw\") pod \"test-model-25332d-kserve-86755ff75f-wmmxz\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") " pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.717481 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.717343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-home\") pod \"test-model-25332d-kserve-86755ff75f-wmmxz\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") " pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.717481 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.717403    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-dshm\") pod \"test-model-25332d-kserve-86755ff75f-wmmxz\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") " pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.717481 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.717430    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-model-cache\") pod \"test-model-25332d-kserve-86755ff75f-wmmxz\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") " pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.717481 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.717476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-tmp-dir\") pod \"test-model-25332d-kserve-86755ff75f-wmmxz\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") " pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.717621 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.717496    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42101123-ec43-4cac-b1eb-67063d033fca-tls-certs\") pod \"test-model-25332d-kserve-86755ff75f-wmmxz\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") " pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.818416 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.818381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-dshm\") pod \"test-model-25332d-kserve-86755ff75f-wmmxz\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") " pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.818416 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.818414    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-model-cache\") pod \"test-model-25332d-kserve-86755ff75f-wmmxz\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") " pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.818637 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.818460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-tmp-dir\") pod \"test-model-25332d-kserve-86755ff75f-wmmxz\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") " pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.818637 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.818493    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42101123-ec43-4cac-b1eb-67063d033fca-tls-certs\") pod \"test-model-25332d-kserve-86755ff75f-wmmxz\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") " pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.818637 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.818568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j94rw\" (UniqueName: \"kubernetes.io/projected/42101123-ec43-4cac-b1eb-67063d033fca-kube-api-access-j94rw\") pod \"test-model-25332d-kserve-86755ff75f-wmmxz\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") " pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.818637 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.818622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-home\") pod \"test-model-25332d-kserve-86755ff75f-wmmxz\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") " pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.818895 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.818875    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-model-cache\") pod \"test-model-25332d-kserve-86755ff75f-wmmxz\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") " pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.818975 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.818953    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-tmp-dir\") pod \"test-model-25332d-kserve-86755ff75f-wmmxz\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") " pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.819044 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.819024    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-home\") pod \"test-model-25332d-kserve-86755ff75f-wmmxz\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") " pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.820977 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.820955    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-dshm\") pod \"test-model-25332d-kserve-86755ff75f-wmmxz\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") " pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.821150 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.821121    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42101123-ec43-4cac-b1eb-67063d033fca-tls-certs\") pod \"test-model-25332d-kserve-86755ff75f-wmmxz\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") " pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.831959 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.831936    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j94rw\" (UniqueName: \"kubernetes.io/projected/42101123-ec43-4cac-b1eb-67063d033fca-kube-api-access-j94rw\") pod \"test-model-25332d-kserve-86755ff75f-wmmxz\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") " pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:33.920008 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:33.919920    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:34.060387 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:34.060361    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"]
Jul 08 03:36:34.062228 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:36:34.062205    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42101123_ec43_4cac_b1eb_67063d033fca.slice/crio-e73cbe346f85e09a614b969a783c8e74fbc4c9836339c0d516b7e94388e49390 WatchSource:0}: Error finding container e73cbe346f85e09a614b969a783c8e74fbc4c9836339c0d516b7e94388e49390: Status 404 returned error can't find the container with id e73cbe346f85e09a614b969a783c8e74fbc4c9836339c0d516b7e94388e49390
Jul 08 03:36:35.024664 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:35.024610    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz" event={"ID":"42101123-ec43-4cac-b1eb-67063d033fca","Type":"ContainerStarted","Data":"6a680e4ba8d7bac896e21f7988437f2a0b85793ce459e3ee4b3e86b7e00f0d98"}
Jul 08 03:36:35.025097 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:35.024676    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz" event={"ID":"42101123-ec43-4cac-b1eb-67063d033fca","Type":"ContainerStarted","Data":"e73cbe346f85e09a614b969a783c8e74fbc4c9836339c0d516b7e94388e49390"}
Jul 08 03:36:35.045811 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:35.045761    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz" podStartSLOduration=2.045727042 podStartE2EDuration="2.045727042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:36:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:36:35.043935933 +0000 UTC m=+2279.356214469" watchObservedRunningTime="2026-07-08 03:36:35.045727042 +0000 UTC m=+2279.358005575"
Jul 08 03:36:43.920394 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:43.920348    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:43.920887 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:43.920493    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:43.933130 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:43.933106    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:44.080183 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:44.080156    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:36:46.872993 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:46.872946    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"]
Jul 08 03:36:46.873475 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:46.873219    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl" podUID="5fd2ad51-8633-44ea-b0dd-4fc25525b486" containerName="maas-api" containerID="cri-o://cfc3406186348aa958c1f2029a8608ba81c907ad93967eb017e5dcc8e73fff0f" gracePeriod=30
Jul 08 03:36:47.085649 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:47.085612    2578 generic.go:356] "Generic (PLEG): container finished" podID="5fd2ad51-8633-44ea-b0dd-4fc25525b486" containerID="cfc3406186348aa958c1f2029a8608ba81c907ad93967eb017e5dcc8e73fff0f" exitCode=0
Jul 08 03:36:47.085829 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:47.085686    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl" event={"ID":"5fd2ad51-8633-44ea-b0dd-4fc25525b486","Type":"ContainerDied","Data":"cfc3406186348aa958c1f2029a8608ba81c907ad93967eb017e5dcc8e73fff0f"}
Jul 08 03:36:47.119047 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:47.119026    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"
Jul 08 03:36:47.147779 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:47.147687    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fd2ad51-8633-44ea-b0dd-4fc25525b486-maas-api-tls\") pod \"5fd2ad51-8633-44ea-b0dd-4fc25525b486\" (UID: \"5fd2ad51-8633-44ea-b0dd-4fc25525b486\") "
Jul 08 03:36:47.147916 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:47.147783    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq72m\" (UniqueName: \"kubernetes.io/projected/5fd2ad51-8633-44ea-b0dd-4fc25525b486-kube-api-access-vq72m\") pod \"5fd2ad51-8633-44ea-b0dd-4fc25525b486\" (UID: \"5fd2ad51-8633-44ea-b0dd-4fc25525b486\") "
Jul 08 03:36:47.147916 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:47.147809    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fd2ad51-8633-44ea-b0dd-4fc25525b486-openshift-service-ca\") pod \"5fd2ad51-8633-44ea-b0dd-4fc25525b486\" (UID: \"5fd2ad51-8633-44ea-b0dd-4fc25525b486\") "
Jul 08 03:36:47.148210 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:47.148188    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fd2ad51-8633-44ea-b0dd-4fc25525b486-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5fd2ad51-8633-44ea-b0dd-4fc25525b486" (UID: "5fd2ad51-8633-44ea-b0dd-4fc25525b486"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:36:47.149944 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:47.149919    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fd2ad51-8633-44ea-b0dd-4fc25525b486-kube-api-access-vq72m" (OuterVolumeSpecName: "kube-api-access-vq72m") pod "5fd2ad51-8633-44ea-b0dd-4fc25525b486" (UID: "5fd2ad51-8633-44ea-b0dd-4fc25525b486"). InnerVolumeSpecName "kube-api-access-vq72m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:36:47.150047 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:47.149943    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fd2ad51-8633-44ea-b0dd-4fc25525b486-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5fd2ad51-8633-44ea-b0dd-4fc25525b486" (UID: "5fd2ad51-8633-44ea-b0dd-4fc25525b486"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:36:47.248455 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:47.248424    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq72m\" (UniqueName: \"kubernetes.io/projected/5fd2ad51-8633-44ea-b0dd-4fc25525b486-kube-api-access-vq72m\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:36:47.248455 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:47.248452    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fd2ad51-8633-44ea-b0dd-4fc25525b486-openshift-service-ca\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:36:47.248455 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:47.248461    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fd2ad51-8633-44ea-b0dd-4fc25525b486-maas-api-tls\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:36:48.092155 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:48.092127    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"
Jul 08 03:36:48.092620 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:48.092168    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl" event={"ID":"5fd2ad51-8633-44ea-b0dd-4fc25525b486","Type":"ContainerDied","Data":"cbfeae23af9d229b3ed14f16fa8b19ed25a7eff75eed0c86a639df5af7956be6"}
Jul 08 03:36:48.092620 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:48.092229    2578 scope.go:117] "RemoveContainer" containerID="cfc3406186348aa958c1f2029a8608ba81c907ad93967eb017e5dcc8e73fff0f"
Jul 08 03:36:48.115711 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:48.115690    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"]
Jul 08 03:36:48.119347 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:48.119328    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-reuse-25332d-545d7bc49d-8vcbl"]
Jul 08 03:36:48.163535 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:48.163513    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fd2ad51-8633-44ea-b0dd-4fc25525b486" path="/var/lib/kubelet/pods/5fd2ad51-8633-44ea-b0dd-4fc25525b486/volumes"
Jul 08 03:36:51.851463 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:36:51.851432    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"]
Jul 08 03:37:06.872711 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:06.872658    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz" podUID="42101123-ec43-4cac-b1eb-67063d033fca" containerName="main" containerID="cri-o://6a680e4ba8d7bac896e21f7988437f2a0b85793ce459e3ee4b3e86b7e00f0d98" gracePeriod=45
Jul 08 03:37:07.116512 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.116488    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:37:07.189562 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.189487    2578 generic.go:356] "Generic (PLEG): container finished" podID="42101123-ec43-4cac-b1eb-67063d033fca" containerID="6a680e4ba8d7bac896e21f7988437f2a0b85793ce459e3ee4b3e86b7e00f0d98" exitCode=0
Jul 08 03:37:07.189562 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.189521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz" event={"ID":"42101123-ec43-4cac-b1eb-67063d033fca","Type":"ContainerDied","Data":"6a680e4ba8d7bac896e21f7988437f2a0b85793ce459e3ee4b3e86b7e00f0d98"}
Jul 08 03:37:07.189562 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.189524    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"
Jul 08 03:37:07.189562 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.189550    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz" event={"ID":"42101123-ec43-4cac-b1eb-67063d033fca","Type":"ContainerDied","Data":"e73cbe346f85e09a614b969a783c8e74fbc4c9836339c0d516b7e94388e49390"}
Jul 08 03:37:07.189890 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.189566    2578 scope.go:117] "RemoveContainer" containerID="6a680e4ba8d7bac896e21f7988437f2a0b85793ce459e3ee4b3e86b7e00f0d98"
Jul 08 03:37:07.198273 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.198253    2578 scope.go:117] "RemoveContainer" containerID="6a680e4ba8d7bac896e21f7988437f2a0b85793ce459e3ee4b3e86b7e00f0d98"
Jul 08 03:37:07.198526 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:37:07.198509    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a680e4ba8d7bac896e21f7988437f2a0b85793ce459e3ee4b3e86b7e00f0d98\": container with ID starting with 6a680e4ba8d7bac896e21f7988437f2a0b85793ce459e3ee4b3e86b7e00f0d98 not found: ID does not exist" containerID="6a680e4ba8d7bac896e21f7988437f2a0b85793ce459e3ee4b3e86b7e00f0d98"
Jul 08 03:37:07.198568 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.198541    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a680e4ba8d7bac896e21f7988437f2a0b85793ce459e3ee4b3e86b7e00f0d98"} err="failed to get container status \"6a680e4ba8d7bac896e21f7988437f2a0b85793ce459e3ee4b3e86b7e00f0d98\": rpc error: code = NotFound desc = could not find container \"6a680e4ba8d7bac896e21f7988437f2a0b85793ce459e3ee4b3e86b7e00f0d98\": container with ID starting with 6a680e4ba8d7bac896e21f7988437f2a0b85793ce459e3ee4b3e86b7e00f0d98 not found: ID does not exist"
Jul 08 03:37:07.221329 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.221297    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j94rw\" (UniqueName: \"kubernetes.io/projected/42101123-ec43-4cac-b1eb-67063d033fca-kube-api-access-j94rw\") pod \"42101123-ec43-4cac-b1eb-67063d033fca\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") "
Jul 08 03:37:07.221428 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.221340    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42101123-ec43-4cac-b1eb-67063d033fca-tls-certs\") pod \"42101123-ec43-4cac-b1eb-67063d033fca\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") "
Jul 08 03:37:07.221428 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.221366    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-home\") pod \"42101123-ec43-4cac-b1eb-67063d033fca\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") "
Jul 08 03:37:07.221428 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.221392    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-tmp-dir\") pod \"42101123-ec43-4cac-b1eb-67063d033fca\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") "
Jul 08 03:37:07.221578 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.221438    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-dshm\") pod \"42101123-ec43-4cac-b1eb-67063d033fca\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") "
Jul 08 03:37:07.221578 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.221469    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-model-cache\") pod \"42101123-ec43-4cac-b1eb-67063d033fca\" (UID: \"42101123-ec43-4cac-b1eb-67063d033fca\") "
Jul 08 03:37:07.221700 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.221660    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-home" (OuterVolumeSpecName: "home") pod "42101123-ec43-4cac-b1eb-67063d033fca" (UID: "42101123-ec43-4cac-b1eb-67063d033fca"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:37:07.221779 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.221705    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "42101123-ec43-4cac-b1eb-67063d033fca" (UID: "42101123-ec43-4cac-b1eb-67063d033fca"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:37:07.221844 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.221810    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-model-cache" (OuterVolumeSpecName: "model-cache") pod "42101123-ec43-4cac-b1eb-67063d033fca" (UID: "42101123-ec43-4cac-b1eb-67063d033fca"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:37:07.222710 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.222691    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-tmp-dir\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:37:07.222823 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.222714    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-model-cache\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:37:07.222823 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.222734    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-home\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:37:07.223832 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.223803    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-dshm" (OuterVolumeSpecName: "dshm") pod "42101123-ec43-4cac-b1eb-67063d033fca" (UID: "42101123-ec43-4cac-b1eb-67063d033fca"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 03:37:07.223832 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.223822    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42101123-ec43-4cac-b1eb-67063d033fca-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "42101123-ec43-4cac-b1eb-67063d033fca" (UID: "42101123-ec43-4cac-b1eb-67063d033fca"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:37:07.223970 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.223837    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42101123-ec43-4cac-b1eb-67063d033fca-kube-api-access-j94rw" (OuterVolumeSpecName: "kube-api-access-j94rw") pod "42101123-ec43-4cac-b1eb-67063d033fca" (UID: "42101123-ec43-4cac-b1eb-67063d033fca"). InnerVolumeSpecName "kube-api-access-j94rw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:37:07.323429 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.323389    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42101123-ec43-4cac-b1eb-67063d033fca-dshm\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:37:07.323429 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.323423    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j94rw\" (UniqueName: \"kubernetes.io/projected/42101123-ec43-4cac-b1eb-67063d033fca-kube-api-access-j94rw\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:37:07.323657 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.323449    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42101123-ec43-4cac-b1eb-67063d033fca-tls-certs\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:37:07.512240 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.512213    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"]
Jul 08 03:37:07.514694 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:07.514674    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-reuse-25332d/test-model-25332d-kserve-86755ff75f-wmmxz"]
Jul 08 03:37:08.163286 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:08.163255    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42101123-ec43-4cac-b1eb-67063d033fca" path="/var/lib/kubelet/pods/42101123-ec43-4cac-b1eb-67063d033fca/volumes"
Jul 08 03:37:38.439855 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:38.439824    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"]
Jul 08 03:37:38.440400 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:38.440008    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55" podUID="413f5b28-765d-45a5-abe6-dd74e091b14e" containerName="maas-api" containerID="cri-o://c767ab710e7db30b764830630b32f78c3df70c6596192ab2a6502ad956e68a97" gracePeriod=30
Jul 08 03:37:38.692548 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:38.692489    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"
Jul 08 03:37:38.793858 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:38.793827    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/413f5b28-765d-45a5-abe6-dd74e091b14e-openshift-service-ca\") pod \"413f5b28-765d-45a5-abe6-dd74e091b14e\" (UID: \"413f5b28-765d-45a5-abe6-dd74e091b14e\") "
Jul 08 03:37:38.794009 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:38.793900    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/413f5b28-765d-45a5-abe6-dd74e091b14e-maas-api-tls\") pod \"413f5b28-765d-45a5-abe6-dd74e091b14e\" (UID: \"413f5b28-765d-45a5-abe6-dd74e091b14e\") "
Jul 08 03:37:38.794009 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:38.793930    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zj7q4\" (UniqueName: \"kubernetes.io/projected/413f5b28-765d-45a5-abe6-dd74e091b14e-kube-api-access-zj7q4\") pod \"413f5b28-765d-45a5-abe6-dd74e091b14e\" (UID: \"413f5b28-765d-45a5-abe6-dd74e091b14e\") "
Jul 08 03:37:38.794192 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:38.794166    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/413f5b28-765d-45a5-abe6-dd74e091b14e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "413f5b28-765d-45a5-abe6-dd74e091b14e" (UID: "413f5b28-765d-45a5-abe6-dd74e091b14e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:37:38.796041 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:38.796013    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/413f5b28-765d-45a5-abe6-dd74e091b14e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "413f5b28-765d-45a5-abe6-dd74e091b14e" (UID: "413f5b28-765d-45a5-abe6-dd74e091b14e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:37:38.796156 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:38.796089    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/413f5b28-765d-45a5-abe6-dd74e091b14e-kube-api-access-zj7q4" (OuterVolumeSpecName: "kube-api-access-zj7q4") pod "413f5b28-765d-45a5-abe6-dd74e091b14e" (UID: "413f5b28-765d-45a5-abe6-dd74e091b14e"). InnerVolumeSpecName "kube-api-access-zj7q4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:37:38.895364 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:38.895332    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/413f5b28-765d-45a5-abe6-dd74e091b14e-openshift-service-ca\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:37:38.895364 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:38.895361    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/413f5b28-765d-45a5-abe6-dd74e091b14e-maas-api-tls\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:37:38.895564 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:38.895372    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj7q4\" (UniqueName: \"kubernetes.io/projected/413f5b28-765d-45a5-abe6-dd74e091b14e-kube-api-access-zj7q4\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:37:39.352486 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:39.352450    2578 generic.go:356] "Generic (PLEG): container finished" podID="413f5b28-765d-45a5-abe6-dd74e091b14e" containerID="c767ab710e7db30b764830630b32f78c3df70c6596192ab2a6502ad956e68a97" exitCode=0
Jul 08 03:37:39.352486 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:39.352482    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"
Jul 08 03:37:39.352696 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:39.352519    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55" event={"ID":"413f5b28-765d-45a5-abe6-dd74e091b14e","Type":"ContainerDied","Data":"c767ab710e7db30b764830630b32f78c3df70c6596192ab2a6502ad956e68a97"}
Jul 08 03:37:39.352696 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:39.352577    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55" event={"ID":"413f5b28-765d-45a5-abe6-dd74e091b14e","Type":"ContainerDied","Data":"44a1947bfa423db34729e6b3d1600b6dc6048e453cc5e370a7f9616de8a475a2"}
Jul 08 03:37:39.352696 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:39.352599    2578 scope.go:117] "RemoveContainer" containerID="c767ab710e7db30b764830630b32f78c3df70c6596192ab2a6502ad956e68a97"
Jul 08 03:37:39.368113 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:39.368089    2578 scope.go:117] "RemoveContainer" containerID="c767ab710e7db30b764830630b32f78c3df70c6596192ab2a6502ad956e68a97"
Jul 08 03:37:39.368394 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:37:39.368372    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c767ab710e7db30b764830630b32f78c3df70c6596192ab2a6502ad956e68a97\": container with ID starting with c767ab710e7db30b764830630b32f78c3df70c6596192ab2a6502ad956e68a97 not found: ID does not exist" containerID="c767ab710e7db30b764830630b32f78c3df70c6596192ab2a6502ad956e68a97"
Jul 08 03:37:39.368467 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:39.368405    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c767ab710e7db30b764830630b32f78c3df70c6596192ab2a6502ad956e68a97"} err="failed to get container status \"c767ab710e7db30b764830630b32f78c3df70c6596192ab2a6502ad956e68a97\": rpc error: code = NotFound desc = could not find container \"c767ab710e7db30b764830630b32f78c3df70c6596192ab2a6502ad956e68a97\": container with ID starting with c767ab710e7db30b764830630b32f78c3df70c6596192ab2a6502ad956e68a97 not found: ID does not exist"
Jul 08 03:37:39.378572 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:39.378541    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"]
Jul 08 03:37:39.383643 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:39.383622    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2515cc-84f4c4f94c-tws55"]
Jul 08 03:37:40.163292 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:37:40.163260    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="413f5b28-765d-45a5-abe6-dd74e091b14e" path="/var/lib/kubelet/pods/413f5b28-765d-45a5-abe6-dd74e091b14e/volumes"
Jul 08 03:38:21.399262 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:21.399224    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"]
Jul 08 03:38:21.399895 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:21.399482    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp" podUID="26c511d3-f77a-479a-842c-dc72185561ea" containerName="maas-api" containerID="cri-o://6d02f4cb5629d2f3640159f4a3b4d55fdab8ba8b0f81a887a276a0b51a894237" gracePeriod=30
Jul 08 03:38:21.525306 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:21.525259    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp" podUID="26c511d3-f77a-479a-842c-dc72185561ea" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.52:8443/health\": dial tcp 10.133.0.52:8443: connect: connection refused"
Jul 08 03:38:21.569882 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:21.569854    2578 generic.go:356] "Generic (PLEG): container finished" podID="26c511d3-f77a-479a-842c-dc72185561ea" containerID="6d02f4cb5629d2f3640159f4a3b4d55fdab8ba8b0f81a887a276a0b51a894237" exitCode=0
Jul 08 03:38:21.570045 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:21.569926    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp" event={"ID":"26c511d3-f77a-479a-842c-dc72185561ea","Type":"ContainerDied","Data":"6d02f4cb5629d2f3640159f4a3b4d55fdab8ba8b0f81a887a276a0b51a894237"}
Jul 08 03:38:21.645065 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:21.645041    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"
Jul 08 03:38:21.666895 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:21.666845    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26c511d3-f77a-479a-842c-dc72185561ea-maas-api-tls\") pod \"26c511d3-f77a-479a-842c-dc72185561ea\" (UID: \"26c511d3-f77a-479a-842c-dc72185561ea\") "
Jul 08 03:38:21.666985 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:21.666944    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26c511d3-f77a-479a-842c-dc72185561ea-openshift-service-ca\") pod \"26c511d3-f77a-479a-842c-dc72185561ea\" (UID: \"26c511d3-f77a-479a-842c-dc72185561ea\") "
Jul 08 03:38:21.666985 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:21.666976    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwwqv\" (UniqueName: \"kubernetes.io/projected/26c511d3-f77a-479a-842c-dc72185561ea-kube-api-access-rwwqv\") pod \"26c511d3-f77a-479a-842c-dc72185561ea\" (UID: \"26c511d3-f77a-479a-842c-dc72185561ea\") "
Jul 08 03:38:21.667297 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:21.667279    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26c511d3-f77a-479a-842c-dc72185561ea-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "26c511d3-f77a-479a-842c-dc72185561ea" (UID: "26c511d3-f77a-479a-842c-dc72185561ea"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:38:21.668970 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:21.668955    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26c511d3-f77a-479a-842c-dc72185561ea-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "26c511d3-f77a-479a-842c-dc72185561ea" (UID: "26c511d3-f77a-479a-842c-dc72185561ea"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:38:21.669191 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:21.669169    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26c511d3-f77a-479a-842c-dc72185561ea-kube-api-access-rwwqv" (OuterVolumeSpecName: "kube-api-access-rwwqv") pod "26c511d3-f77a-479a-842c-dc72185561ea" (UID: "26c511d3-f77a-479a-842c-dc72185561ea"). InnerVolumeSpecName "kube-api-access-rwwqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:38:21.767708 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:21.767681    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwwqv\" (UniqueName: \"kubernetes.io/projected/26c511d3-f77a-479a-842c-dc72185561ea-kube-api-access-rwwqv\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:38:21.767708 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:21.767707    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26c511d3-f77a-479a-842c-dc72185561ea-maas-api-tls\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:38:21.767708 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:21.767716    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26c511d3-f77a-479a-842c-dc72185561ea-openshift-service-ca\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:38:22.576031 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:22.576006    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"
Jul 08 03:38:22.576504 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:22.576034    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp" event={"ID":"26c511d3-f77a-479a-842c-dc72185561ea","Type":"ContainerDied","Data":"c3ef11f726efb75d8e41d1e8f984226fa6e14a02349a08c48d39fa560cb4d0bf"}
Jul 08 03:38:22.576504 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:22.576090    2578 scope.go:117] "RemoveContainer" containerID="6d02f4cb5629d2f3640159f4a3b4d55fdab8ba8b0f81a887a276a0b51a894237"
Jul 08 03:38:22.613353 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:22.613327    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"]
Jul 08 03:38:22.616151 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:22.616130    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7142f2-74545c4b79-9mwcp"]
Jul 08 03:38:24.163172 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:24.163141    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26c511d3-f77a-479a-842c-dc72185561ea" path="/var/lib/kubelet/pods/26c511d3-f77a-479a-842c-dc72185561ea/volumes"
Jul 08 03:38:31.624812 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.624771    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"]
Jul 08 03:38:31.625207 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.625111    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="413f5b28-765d-45a5-abe6-dd74e091b14e" containerName="maas-api"
Jul 08 03:38:31.625207 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.625129    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="413f5b28-765d-45a5-abe6-dd74e091b14e" containerName="maas-api"
Jul 08 03:38:31.625207 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.625138    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fd2ad51-8633-44ea-b0dd-4fc25525b486" containerName="maas-api"
Jul 08 03:38:31.625207 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.625144    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fd2ad51-8633-44ea-b0dd-4fc25525b486" containerName="maas-api"
Jul 08 03:38:31.625207 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.625150    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42101123-ec43-4cac-b1eb-67063d033fca" containerName="main"
Jul 08 03:38:31.625207 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.625156    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="42101123-ec43-4cac-b1eb-67063d033fca" containerName="main"
Jul 08 03:38:31.625207 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.625165    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26c511d3-f77a-479a-842c-dc72185561ea" containerName="maas-api"
Jul 08 03:38:31.625207 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.625170    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="26c511d3-f77a-479a-842c-dc72185561ea" containerName="maas-api"
Jul 08 03:38:31.625449 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.625237    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fd2ad51-8633-44ea-b0dd-4fc25525b486" containerName="maas-api"
Jul 08 03:38:31.625449 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.625244    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="42101123-ec43-4cac-b1eb-67063d033fca" containerName="main"
Jul 08 03:38:31.625449 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.625250    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="413f5b28-765d-45a5-abe6-dd74e091b14e" containerName="maas-api"
Jul 08 03:38:31.625449 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.625255    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="26c511d3-f77a-479a-842c-dc72185561ea" containerName="maas-api"
Jul 08 03:38:31.629504 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.629483    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"
Jul 08 03:38:31.631697 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.631660    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-e8b238-serving-cert\""
Jul 08 03:38:31.641341 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.641318    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"]
Jul 08 03:38:31.758958 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.758926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3314d93d-679f-4a50-b950-e38ea25aa6a8-maas-api-tls\") pod \"maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx\" (UID: \"3314d93d-679f-4a50-b950-e38ea25aa6a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"
Jul 08 03:38:31.758958 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.758962    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b87r\" (UniqueName: \"kubernetes.io/projected/3314d93d-679f-4a50-b950-e38ea25aa6a8-kube-api-access-5b87r\") pod \"maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx\" (UID: \"3314d93d-679f-4a50-b950-e38ea25aa6a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"
Jul 08 03:38:31.759172 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.759095    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3314d93d-679f-4a50-b950-e38ea25aa6a8-openshift-service-ca\") pod \"maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx\" (UID: \"3314d93d-679f-4a50-b950-e38ea25aa6a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"
Jul 08 03:38:31.859868 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.859833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3314d93d-679f-4a50-b950-e38ea25aa6a8-openshift-service-ca\") pod \"maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx\" (UID: \"3314d93d-679f-4a50-b950-e38ea25aa6a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"
Jul 08 03:38:31.860032 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.859890    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3314d93d-679f-4a50-b950-e38ea25aa6a8-maas-api-tls\") pod \"maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx\" (UID: \"3314d93d-679f-4a50-b950-e38ea25aa6a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"
Jul 08 03:38:31.860032 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.859908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b87r\" (UniqueName: \"kubernetes.io/projected/3314d93d-679f-4a50-b950-e38ea25aa6a8-kube-api-access-5b87r\") pod \"maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx\" (UID: \"3314d93d-679f-4a50-b950-e38ea25aa6a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"
Jul 08 03:38:31.860607 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.860579    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3314d93d-679f-4a50-b950-e38ea25aa6a8-openshift-service-ca\") pod \"maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx\" (UID: \"3314d93d-679f-4a50-b950-e38ea25aa6a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"
Jul 08 03:38:31.862444 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.862427    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3314d93d-679f-4a50-b950-e38ea25aa6a8-maas-api-tls\") pod \"maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx\" (UID: \"3314d93d-679f-4a50-b950-e38ea25aa6a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"
Jul 08 03:38:31.872072 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.872049    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b87r\" (UniqueName: \"kubernetes.io/projected/3314d93d-679f-4a50-b950-e38ea25aa6a8-kube-api-access-5b87r\") pod \"maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx\" (UID: \"3314d93d-679f-4a50-b950-e38ea25aa6a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"
Jul 08 03:38:31.940765 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:31.940689    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"
Jul 08 03:38:32.082932 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:32.082908    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"]
Jul 08 03:38:32.085355 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:38:32.085326    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3314d93d_679f_4a50_b950_e38ea25aa6a8.slice/crio-e73fe8b46cb9f6462050ac87af591bf7c5dad3fd71e10af45ebecf9fe935786c WatchSource:0}: Error finding container e73fe8b46cb9f6462050ac87af591bf7c5dad3fd71e10af45ebecf9fe935786c: Status 404 returned error can't find the container with id e73fe8b46cb9f6462050ac87af591bf7c5dad3fd71e10af45ebecf9fe935786c
Jul 08 03:38:32.627763 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:32.627716    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx" event={"ID":"3314d93d-679f-4a50-b950-e38ea25aa6a8","Type":"ContainerStarted","Data":"e73fe8b46cb9f6462050ac87af591bf7c5dad3fd71e10af45ebecf9fe935786c"}
Jul 08 03:38:33.635136 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:33.635098    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx" event={"ID":"3314d93d-679f-4a50-b950-e38ea25aa6a8","Type":"ContainerStarted","Data":"e64010a431baf24efbd17461e986676926a2865fd2c6510a7e26ab2578fa3e17"}
Jul 08 03:38:33.635555 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:33.635154    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"
Jul 08 03:38:33.657347 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:33.657297    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx" podStartSLOduration=2.16664075 podStartE2EDuration="2.657282299s" totalImagesPullingTime="490.641549ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:38:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:38:33.654648845 +0000 UTC m=+2397.966927376" watchObservedRunningTime="2026-07-08 03:38:33.657282299 +0000 UTC m=+2397.969560831"
Jul 08 03:38:39.647061 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:39.647030    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"
Jul 08 03:38:39.726330 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:39.726283    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"]
Jul 08 03:38:39.731456 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:39.731430    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"
Jul 08 03:38:39.734874 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:39.734847    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-da32fa-serving-cert\""
Jul 08 03:38:39.743172 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:39.743145    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"]
Jul 08 03:38:39.833015 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:39.832983    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdcv6\" (UniqueName: \"kubernetes.io/projected/731d0dea-e927-442e-b995-66e51102382d-kube-api-access-mdcv6\") pod \"maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx\" (UID: \"731d0dea-e927-442e-b995-66e51102382d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"
Jul 08 03:38:39.833226 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:39.833091    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/731d0dea-e927-442e-b995-66e51102382d-maas-api-tls\") pod \"maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx\" (UID: \"731d0dea-e927-442e-b995-66e51102382d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"
Jul 08 03:38:39.833226 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:39.833168    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/731d0dea-e927-442e-b995-66e51102382d-openshift-service-ca\") pod \"maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx\" (UID: \"731d0dea-e927-442e-b995-66e51102382d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"
Jul 08 03:38:39.934170 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:39.934086    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdcv6\" (UniqueName: \"kubernetes.io/projected/731d0dea-e927-442e-b995-66e51102382d-kube-api-access-mdcv6\") pod \"maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx\" (UID: \"731d0dea-e927-442e-b995-66e51102382d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"
Jul 08 03:38:39.934339 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:39.934176    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/731d0dea-e927-442e-b995-66e51102382d-maas-api-tls\") pod \"maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx\" (UID: \"731d0dea-e927-442e-b995-66e51102382d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"
Jul 08 03:38:39.934339 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:39.934224    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/731d0dea-e927-442e-b995-66e51102382d-openshift-service-ca\") pod \"maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx\" (UID: \"731d0dea-e927-442e-b995-66e51102382d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"
Jul 08 03:38:39.934817 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:39.934795    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/731d0dea-e927-442e-b995-66e51102382d-openshift-service-ca\") pod \"maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx\" (UID: \"731d0dea-e927-442e-b995-66e51102382d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"
Jul 08 03:38:39.936991 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:39.936962    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/731d0dea-e927-442e-b995-66e51102382d-maas-api-tls\") pod \"maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx\" (UID: \"731d0dea-e927-442e-b995-66e51102382d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"
Jul 08 03:38:39.953583 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:39.953548    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdcv6\" (UniqueName: \"kubernetes.io/projected/731d0dea-e927-442e-b995-66e51102382d-kube-api-access-mdcv6\") pod \"maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx\" (UID: \"731d0dea-e927-442e-b995-66e51102382d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"
Jul 08 03:38:40.043309 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:40.043273    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"
Jul 08 03:38:40.185362 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:40.185338    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"]
Jul 08 03:38:40.186386 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:38:40.186360    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod731d0dea_e927_442e_b995_66e51102382d.slice/crio-32becd363e3bfc4e4944429173afe7d70117ffe663aca3c6e3626c5b4ca39aee WatchSource:0}: Error finding container 32becd363e3bfc4e4944429173afe7d70117ffe663aca3c6e3626c5b4ca39aee: Status 404 returned error can't find the container with id 32becd363e3bfc4e4944429173afe7d70117ffe663aca3c6e3626c5b4ca39aee
Jul 08 03:38:40.678117 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:40.678084    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx" event={"ID":"731d0dea-e927-442e-b995-66e51102382d","Type":"ContainerStarted","Data":"1607ada314113aafcca6a0ce72be900696a5e430a7a8f7f55becfb7a933c49d5"}
Jul 08 03:38:40.678453 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:40.678150    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx" event={"ID":"731d0dea-e927-442e-b995-66e51102382d","Type":"ContainerStarted","Data":"32becd363e3bfc4e4944429173afe7d70117ffe663aca3c6e3626c5b4ca39aee"}
Jul 08 03:38:40.678453 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:40.678193    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"
Jul 08 03:38:40.699305 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:40.699252    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx" podStartSLOduration=1.27726159 podStartE2EDuration="1.69923603s" totalImagesPullingTime="421.97444ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:38:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:38:40.697644601 +0000 UTC m=+2405.009923129" watchObservedRunningTime="2026-07-08 03:38:40.69923603 +0000 UTC m=+2405.011514563"
Jul 08 03:38:46.688936 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:46.688907    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"
Jul 08 03:38:53.138806 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.138772    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"]
Jul 08 03:38:53.139379 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.138971    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx" podUID="3314d93d-679f-4a50-b950-e38ea25aa6a8" containerName="maas-api" containerID="cri-o://e64010a431baf24efbd17461e986676926a2865fd2c6510a7e26ab2578fa3e17" gracePeriod=30
Jul 08 03:38:53.388572 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.388545    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"
Jul 08 03:38:53.569279 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.569244    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3314d93d-679f-4a50-b950-e38ea25aa6a8-openshift-service-ca\") pod \"3314d93d-679f-4a50-b950-e38ea25aa6a8\" (UID: \"3314d93d-679f-4a50-b950-e38ea25aa6a8\") "
Jul 08 03:38:53.569470 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.569305    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3314d93d-679f-4a50-b950-e38ea25aa6a8-maas-api-tls\") pod \"3314d93d-679f-4a50-b950-e38ea25aa6a8\" (UID: \"3314d93d-679f-4a50-b950-e38ea25aa6a8\") "
Jul 08 03:38:53.569470 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.569341    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5b87r\" (UniqueName: \"kubernetes.io/projected/3314d93d-679f-4a50-b950-e38ea25aa6a8-kube-api-access-5b87r\") pod \"3314d93d-679f-4a50-b950-e38ea25aa6a8\" (UID: \"3314d93d-679f-4a50-b950-e38ea25aa6a8\") "
Jul 08 03:38:53.569640 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.569619    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3314d93d-679f-4a50-b950-e38ea25aa6a8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3314d93d-679f-4a50-b950-e38ea25aa6a8" (UID: "3314d93d-679f-4a50-b950-e38ea25aa6a8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:38:53.571555 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.571530    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3314d93d-679f-4a50-b950-e38ea25aa6a8-kube-api-access-5b87r" (OuterVolumeSpecName: "kube-api-access-5b87r") pod "3314d93d-679f-4a50-b950-e38ea25aa6a8" (UID: "3314d93d-679f-4a50-b950-e38ea25aa6a8"). InnerVolumeSpecName "kube-api-access-5b87r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:38:53.571661 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.571617    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3314d93d-679f-4a50-b950-e38ea25aa6a8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3314d93d-679f-4a50-b950-e38ea25aa6a8" (UID: "3314d93d-679f-4a50-b950-e38ea25aa6a8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:38:53.670244 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.670205    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3314d93d-679f-4a50-b950-e38ea25aa6a8-openshift-service-ca\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:38:53.670244 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.670240    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3314d93d-679f-4a50-b950-e38ea25aa6a8-maas-api-tls\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:38:53.670465 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.670253    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5b87r\" (UniqueName: \"kubernetes.io/projected/3314d93d-679f-4a50-b950-e38ea25aa6a8-kube-api-access-5b87r\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:38:53.747696 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.747653    2578 generic.go:356] "Generic (PLEG): container finished" podID="3314d93d-679f-4a50-b950-e38ea25aa6a8" containerID="e64010a431baf24efbd17461e986676926a2865fd2c6510a7e26ab2578fa3e17" exitCode=0
Jul 08 03:38:53.747873 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.747702    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"
Jul 08 03:38:53.747873 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.747737    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx" event={"ID":"3314d93d-679f-4a50-b950-e38ea25aa6a8","Type":"ContainerDied","Data":"e64010a431baf24efbd17461e986676926a2865fd2c6510a7e26ab2578fa3e17"}
Jul 08 03:38:53.747873 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.747851    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx" event={"ID":"3314d93d-679f-4a50-b950-e38ea25aa6a8","Type":"ContainerDied","Data":"e73fe8b46cb9f6462050ac87af591bf7c5dad3fd71e10af45ebecf9fe935786c"}
Jul 08 03:38:53.747984 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.747880    2578 scope.go:117] "RemoveContainer" containerID="e64010a431baf24efbd17461e986676926a2865fd2c6510a7e26ab2578fa3e17"
Jul 08 03:38:53.757053 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.757035    2578 scope.go:117] "RemoveContainer" containerID="e64010a431baf24efbd17461e986676926a2865fd2c6510a7e26ab2578fa3e17"
Jul 08 03:38:53.757311 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:38:53.757292    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e64010a431baf24efbd17461e986676926a2865fd2c6510a7e26ab2578fa3e17\": container with ID starting with e64010a431baf24efbd17461e986676926a2865fd2c6510a7e26ab2578fa3e17 not found: ID does not exist" containerID="e64010a431baf24efbd17461e986676926a2865fd2c6510a7e26ab2578fa3e17"
Jul 08 03:38:53.757369 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.757320    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e64010a431baf24efbd17461e986676926a2865fd2c6510a7e26ab2578fa3e17"} err="failed to get container status \"e64010a431baf24efbd17461e986676926a2865fd2c6510a7e26ab2578fa3e17\": rpc error: code = NotFound desc = could not find container \"e64010a431baf24efbd17461e986676926a2865fd2c6510a7e26ab2578fa3e17\": container with ID starting with e64010a431baf24efbd17461e986676926a2865fd2c6510a7e26ab2578fa3e17 not found: ID does not exist"
Jul 08 03:38:53.773502 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.773480    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"]
Jul 08 03:38:53.778324 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:53.778303    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e8b238-564c6f56d5-m4wtx"]
Jul 08 03:38:54.163180 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:38:54.163150    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3314d93d-679f-4a50-b950-e38ea25aa6a8" path="/var/lib/kubelet/pods/3314d93d-679f-4a50-b950-e38ea25aa6a8/volumes"
Jul 08 03:39:00.261434 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.261358    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"]
Jul 08 03:39:00.261890 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.261611    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx" podUID="731d0dea-e927-442e-b995-66e51102382d" containerName="maas-api" containerID="cri-o://1607ada314113aafcca6a0ce72be900696a5e430a7a8f7f55becfb7a933c49d5" gracePeriod=30
Jul 08 03:39:00.510339 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.510314    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"
Jul 08 03:39:00.631229 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.631198    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdcv6\" (UniqueName: \"kubernetes.io/projected/731d0dea-e927-442e-b995-66e51102382d-kube-api-access-mdcv6\") pod \"731d0dea-e927-442e-b995-66e51102382d\" (UID: \"731d0dea-e927-442e-b995-66e51102382d\") "
Jul 08 03:39:00.631411 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.631236    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/731d0dea-e927-442e-b995-66e51102382d-maas-api-tls\") pod \"731d0dea-e927-442e-b995-66e51102382d\" (UID: \"731d0dea-e927-442e-b995-66e51102382d\") "
Jul 08 03:39:00.631411 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.631307    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/731d0dea-e927-442e-b995-66e51102382d-openshift-service-ca\") pod \"731d0dea-e927-442e-b995-66e51102382d\" (UID: \"731d0dea-e927-442e-b995-66e51102382d\") "
Jul 08 03:39:00.631731 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.631702    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/731d0dea-e927-442e-b995-66e51102382d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "731d0dea-e927-442e-b995-66e51102382d" (UID: "731d0dea-e927-442e-b995-66e51102382d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:39:00.633425 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.633405    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/731d0dea-e927-442e-b995-66e51102382d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "731d0dea-e927-442e-b995-66e51102382d" (UID: "731d0dea-e927-442e-b995-66e51102382d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:39:00.633496 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.633436    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/731d0dea-e927-442e-b995-66e51102382d-kube-api-access-mdcv6" (OuterVolumeSpecName: "kube-api-access-mdcv6") pod "731d0dea-e927-442e-b995-66e51102382d" (UID: "731d0dea-e927-442e-b995-66e51102382d"). InnerVolumeSpecName "kube-api-access-mdcv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:39:00.732105 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.732070    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/731d0dea-e927-442e-b995-66e51102382d-openshift-service-ca\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:39:00.732105 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.732101    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdcv6\" (UniqueName: \"kubernetes.io/projected/731d0dea-e927-442e-b995-66e51102382d-kube-api-access-mdcv6\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:39:00.732105 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.732111    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/731d0dea-e927-442e-b995-66e51102382d-maas-api-tls\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:39:00.788368 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.788331    2578 generic.go:356] "Generic (PLEG): container finished" podID="731d0dea-e927-442e-b995-66e51102382d" containerID="1607ada314113aafcca6a0ce72be900696a5e430a7a8f7f55becfb7a933c49d5" exitCode=0
Jul 08 03:39:00.788540 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.788381    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"
Jul 08 03:39:00.788540 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.788398    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx" event={"ID":"731d0dea-e927-442e-b995-66e51102382d","Type":"ContainerDied","Data":"1607ada314113aafcca6a0ce72be900696a5e430a7a8f7f55becfb7a933c49d5"}
Jul 08 03:39:00.788540 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.788437    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx" event={"ID":"731d0dea-e927-442e-b995-66e51102382d","Type":"ContainerDied","Data":"32becd363e3bfc4e4944429173afe7d70117ffe663aca3c6e3626c5b4ca39aee"}
Jul 08 03:39:00.788540 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.788458    2578 scope.go:117] "RemoveContainer" containerID="1607ada314113aafcca6a0ce72be900696a5e430a7a8f7f55becfb7a933c49d5"
Jul 08 03:39:00.797380 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.797364    2578 scope.go:117] "RemoveContainer" containerID="1607ada314113aafcca6a0ce72be900696a5e430a7a8f7f55becfb7a933c49d5"
Jul 08 03:39:00.797611 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:39:00.797596    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1607ada314113aafcca6a0ce72be900696a5e430a7a8f7f55becfb7a933c49d5\": container with ID starting with 1607ada314113aafcca6a0ce72be900696a5e430a7a8f7f55becfb7a933c49d5 not found: ID does not exist" containerID="1607ada314113aafcca6a0ce72be900696a5e430a7a8f7f55becfb7a933c49d5"
Jul 08 03:39:00.797656 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.797618    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1607ada314113aafcca6a0ce72be900696a5e430a7a8f7f55becfb7a933c49d5"} err="failed to get container status \"1607ada314113aafcca6a0ce72be900696a5e430a7a8f7f55becfb7a933c49d5\": rpc error: code = NotFound desc = could not find container \"1607ada314113aafcca6a0ce72be900696a5e430a7a8f7f55becfb7a933c49d5\": container with ID starting with 1607ada314113aafcca6a0ce72be900696a5e430a7a8f7f55becfb7a933c49d5 not found: ID does not exist"
Jul 08 03:39:00.809754 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.809722    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"]
Jul 08 03:39:00.813972 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:00.813952    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-da32fa-6cdbb74f7f-wgtdx"]
Jul 08 03:39:02.164022 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:02.163982    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="731d0dea-e927-442e-b995-66e51102382d" path="/var/lib/kubelet/pods/731d0dea-e927-442e-b995-66e51102382d/volumes"
Jul 08 03:39:09.895876 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:09.895844    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"]
Jul 08 03:39:09.896371 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:09.896352    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3314d93d-679f-4a50-b950-e38ea25aa6a8" containerName="maas-api"
Jul 08 03:39:09.896451 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:09.896375    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3314d93d-679f-4a50-b950-e38ea25aa6a8" containerName="maas-api"
Jul 08 03:39:09.896451 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:09.896387    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="731d0dea-e927-442e-b995-66e51102382d" containerName="maas-api"
Jul 08 03:39:09.896451 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:09.896394    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="731d0dea-e927-442e-b995-66e51102382d" containerName="maas-api"
Jul 08 03:39:09.896599 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:09.896509    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3314d93d-679f-4a50-b950-e38ea25aa6a8" containerName="maas-api"
Jul 08 03:39:09.896599 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:09.896522    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="731d0dea-e927-442e-b995-66e51102382d" containerName="maas-api"
Jul 08 03:39:09.900686 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:09.900664    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"
Jul 08 03:39:09.902857 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:09.902836    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-788e6a-serving-cert\""
Jul 08 03:39:09.910695 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:09.910664    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xng2p\" (UniqueName: \"kubernetes.io/projected/1bb318b2-d94b-4c04-91fa-d4f600a7a721-kube-api-access-xng2p\") pod \"maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8\" (UID: \"1bb318b2-d94b-4c04-91fa-d4f600a7a721\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"
Jul 08 03:39:09.910833 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:09.910707    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb318b2-d94b-4c04-91fa-d4f600a7a721-maas-api-tls\") pod \"maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8\" (UID: \"1bb318b2-d94b-4c04-91fa-d4f600a7a721\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"
Jul 08 03:39:09.910833 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:09.910802    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb318b2-d94b-4c04-91fa-d4f600a7a721-openshift-service-ca\") pod \"maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8\" (UID: \"1bb318b2-d94b-4c04-91fa-d4f600a7a721\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"
Jul 08 03:39:09.913230 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:09.913208    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"]
Jul 08 03:39:10.011802 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:10.011768    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xng2p\" (UniqueName: \"kubernetes.io/projected/1bb318b2-d94b-4c04-91fa-d4f600a7a721-kube-api-access-xng2p\") pod \"maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8\" (UID: \"1bb318b2-d94b-4c04-91fa-d4f600a7a721\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"
Jul 08 03:39:10.011802 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:10.011806    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb318b2-d94b-4c04-91fa-d4f600a7a721-maas-api-tls\") pod \"maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8\" (UID: \"1bb318b2-d94b-4c04-91fa-d4f600a7a721\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"
Jul 08 03:39:10.012056 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:10.011848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb318b2-d94b-4c04-91fa-d4f600a7a721-openshift-service-ca\") pod \"maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8\" (UID: \"1bb318b2-d94b-4c04-91fa-d4f600a7a721\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"
Jul 08 03:39:10.012441 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:10.012422    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb318b2-d94b-4c04-91fa-d4f600a7a721-openshift-service-ca\") pod \"maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8\" (UID: \"1bb318b2-d94b-4c04-91fa-d4f600a7a721\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"
Jul 08 03:39:10.014405 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:10.014383    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb318b2-d94b-4c04-91fa-d4f600a7a721-maas-api-tls\") pod \"maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8\" (UID: \"1bb318b2-d94b-4c04-91fa-d4f600a7a721\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"
Jul 08 03:39:10.020894 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:10.020870    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xng2p\" (UniqueName: \"kubernetes.io/projected/1bb318b2-d94b-4c04-91fa-d4f600a7a721-kube-api-access-xng2p\") pod \"maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8\" (UID: \"1bb318b2-d94b-4c04-91fa-d4f600a7a721\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"
Jul 08 03:39:10.211541 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:10.211453    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"
Jul 08 03:39:10.357676 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:10.357645    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"]
Jul 08 03:39:10.360276 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:39:10.360250    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb318b2_d94b_4c04_91fa_d4f600a7a721.slice/crio-6c4749c8ad4aefa93dd4da8393254413667560378d3ca0493d6fb24d6034882a WatchSource:0}: Error finding container 6c4749c8ad4aefa93dd4da8393254413667560378d3ca0493d6fb24d6034882a: Status 404 returned error can't find the container with id 6c4749c8ad4aefa93dd4da8393254413667560378d3ca0493d6fb24d6034882a
Jul 08 03:39:10.839341 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:10.839309    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8" event={"ID":"1bb318b2-d94b-4c04-91fa-d4f600a7a721","Type":"ContainerStarted","Data":"3f9a8e728c4e5633315c58b9284678247c9cb4d828feac2fe084684c296edd53"}
Jul 08 03:39:10.839509 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:10.839366    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8" event={"ID":"1bb318b2-d94b-4c04-91fa-d4f600a7a721","Type":"ContainerStarted","Data":"6c4749c8ad4aefa93dd4da8393254413667560378d3ca0493d6fb24d6034882a"}
Jul 08 03:39:10.839509 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:10.839429    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"
Jul 08 03:39:10.856065 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:10.856021    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8" podStartSLOduration=1.508896888 podStartE2EDuration="1.856005839s" totalImagesPullingTime="347.108951ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:39:10.854923392 +0000 UTC m=+2435.167201928" watchObservedRunningTime="2026-07-08 03:39:10.856005839 +0000 UTC m=+2435.168284372"
Jul 08 03:39:16.849087 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:16.849048    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"
Jul 08 03:39:18.127517 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:18.127482    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"]
Jul 08 03:39:18.131655 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:18.131597    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"
Jul 08 03:39:18.134060 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:18.134038    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-705492-serving-cert\""
Jul 08 03:39:18.143091 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:18.143064    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"]
Jul 08 03:39:18.193387 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:18.193356    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbs7n\" (UniqueName: \"kubernetes.io/projected/f78be967-06ff-4571-bc30-73fb15018fc6-kube-api-access-qbs7n\") pod \"maas-api-e2e-shared-b-705492-6965c9858d-zzg87\" (UID: \"f78be967-06ff-4571-bc30-73fb15018fc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"
Jul 08 03:39:18.193555 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:18.193427    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f78be967-06ff-4571-bc30-73fb15018fc6-maas-api-tls\") pod \"maas-api-e2e-shared-b-705492-6965c9858d-zzg87\" (UID: \"f78be967-06ff-4571-bc30-73fb15018fc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"
Jul 08 03:39:18.193555 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:18.193446    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f78be967-06ff-4571-bc30-73fb15018fc6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-705492-6965c9858d-zzg87\" (UID: \"f78be967-06ff-4571-bc30-73fb15018fc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"
Jul 08 03:39:18.294103 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:18.294071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbs7n\" (UniqueName: \"kubernetes.io/projected/f78be967-06ff-4571-bc30-73fb15018fc6-kube-api-access-qbs7n\") pod \"maas-api-e2e-shared-b-705492-6965c9858d-zzg87\" (UID: \"f78be967-06ff-4571-bc30-73fb15018fc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"
Jul 08 03:39:18.294303 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:18.294171    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f78be967-06ff-4571-bc30-73fb15018fc6-maas-api-tls\") pod \"maas-api-e2e-shared-b-705492-6965c9858d-zzg87\" (UID: \"f78be967-06ff-4571-bc30-73fb15018fc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"
Jul 08 03:39:18.294303 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:18.294196    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f78be967-06ff-4571-bc30-73fb15018fc6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-705492-6965c9858d-zzg87\" (UID: \"f78be967-06ff-4571-bc30-73fb15018fc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"
Jul 08 03:39:18.294888 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:18.294865    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f78be967-06ff-4571-bc30-73fb15018fc6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-705492-6965c9858d-zzg87\" (UID: \"f78be967-06ff-4571-bc30-73fb15018fc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"
Jul 08 03:39:18.296784 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:18.296763    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f78be967-06ff-4571-bc30-73fb15018fc6-maas-api-tls\") pod \"maas-api-e2e-shared-b-705492-6965c9858d-zzg87\" (UID: \"f78be967-06ff-4571-bc30-73fb15018fc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"
Jul 08 03:39:18.304957 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:18.304935    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbs7n\" (UniqueName: \"kubernetes.io/projected/f78be967-06ff-4571-bc30-73fb15018fc6-kube-api-access-qbs7n\") pod \"maas-api-e2e-shared-b-705492-6965c9858d-zzg87\" (UID: \"f78be967-06ff-4571-bc30-73fb15018fc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"
Jul 08 03:39:18.445654 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:18.445571    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"
Jul 08 03:39:18.599301 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:18.599268    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"]
Jul 08 03:39:18.602914 ip-10-0-129-199 kubenswrapper[2578]: W0708 03:39:18.602888    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78be967_06ff_4571_bc30_73fb15018fc6.slice/crio-7f3d9cfffb95423683512f91b69046fbf502b6cb7aa175fb68fa9a8e209226c3 WatchSource:0}: Error finding container 7f3d9cfffb95423683512f91b69046fbf502b6cb7aa175fb68fa9a8e209226c3: Status 404 returned error can't find the container with id 7f3d9cfffb95423683512f91b69046fbf502b6cb7aa175fb68fa9a8e209226c3
Jul 08 03:39:18.880456 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:18.880422    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87" event={"ID":"f78be967-06ff-4571-bc30-73fb15018fc6","Type":"ContainerStarted","Data":"7f3d9cfffb95423683512f91b69046fbf502b6cb7aa175fb68fa9a8e209226c3"}
Jul 08 03:39:19.887069 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:19.887028    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87" event={"ID":"f78be967-06ff-4571-bc30-73fb15018fc6","Type":"ContainerStarted","Data":"24ea3e658f64a1bd4b2ff0eec400563a02a12d181b1c93dc7643545b5e1ac666"}
Jul 08 03:39:19.887465 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:19.887160    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"
Jul 08 03:39:19.905232 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:19.905183    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87" podStartSLOduration=1.5840013320000002 podStartE2EDuration="1.905166587s" totalImagesPullingTime="321.165255ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 03:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:39:19.903359972 +0000 UTC m=+2444.215638496" watchObservedRunningTime="2026-07-08 03:39:19.905166587 +0000 UTC m=+2444.217445132"
Jul 08 03:39:25.898135 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:39:25.898103    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"
Jul 08 03:42:28.071558 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.071481    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"]
Jul 08 03:42:28.072084 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.071681    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8" podUID="1bb318b2-d94b-4c04-91fa-d4f600a7a721" containerName="maas-api" containerID="cri-o://3f9a8e728c4e5633315c58b9284678247c9cb4d828feac2fe084684c296edd53" gracePeriod=30
Jul 08 03:42:28.324870 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.324810    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"
Jul 08 03:42:28.398461 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.398428    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb318b2-d94b-4c04-91fa-d4f600a7a721-maas-api-tls\") pod \"1bb318b2-d94b-4c04-91fa-d4f600a7a721\" (UID: \"1bb318b2-d94b-4c04-91fa-d4f600a7a721\") "
Jul 08 03:42:28.398620 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.398505    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xng2p\" (UniqueName: \"kubernetes.io/projected/1bb318b2-d94b-4c04-91fa-d4f600a7a721-kube-api-access-xng2p\") pod \"1bb318b2-d94b-4c04-91fa-d4f600a7a721\" (UID: \"1bb318b2-d94b-4c04-91fa-d4f600a7a721\") "
Jul 08 03:42:28.398620 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.398535    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb318b2-d94b-4c04-91fa-d4f600a7a721-openshift-service-ca\") pod \"1bb318b2-d94b-4c04-91fa-d4f600a7a721\" (UID: \"1bb318b2-d94b-4c04-91fa-d4f600a7a721\") "
Jul 08 03:42:28.398955 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.398932    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bb318b2-d94b-4c04-91fa-d4f600a7a721-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1bb318b2-d94b-4c04-91fa-d4f600a7a721" (UID: "1bb318b2-d94b-4c04-91fa-d4f600a7a721"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:42:28.400722 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.400700    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb318b2-d94b-4c04-91fa-d4f600a7a721-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1bb318b2-d94b-4c04-91fa-d4f600a7a721" (UID: "1bb318b2-d94b-4c04-91fa-d4f600a7a721"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:42:28.400849 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.400715    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb318b2-d94b-4c04-91fa-d4f600a7a721-kube-api-access-xng2p" (OuterVolumeSpecName: "kube-api-access-xng2p") pod "1bb318b2-d94b-4c04-91fa-d4f600a7a721" (UID: "1bb318b2-d94b-4c04-91fa-d4f600a7a721"). InnerVolumeSpecName "kube-api-access-xng2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:42:28.499791 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.499728    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xng2p\" (UniqueName: \"kubernetes.io/projected/1bb318b2-d94b-4c04-91fa-d4f600a7a721-kube-api-access-xng2p\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:42:28.499791 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.499785    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb318b2-d94b-4c04-91fa-d4f600a7a721-openshift-service-ca\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:42:28.499791 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.499795    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb318b2-d94b-4c04-91fa-d4f600a7a721-maas-api-tls\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:42:28.829229 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.829195    2578 generic.go:356] "Generic (PLEG): container finished" podID="1bb318b2-d94b-4c04-91fa-d4f600a7a721" containerID="3f9a8e728c4e5633315c58b9284678247c9cb4d828feac2fe084684c296edd53" exitCode=0
Jul 08 03:42:28.829429 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.829240    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"
Jul 08 03:42:28.829429 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.829289    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8" event={"ID":"1bb318b2-d94b-4c04-91fa-d4f600a7a721","Type":"ContainerDied","Data":"3f9a8e728c4e5633315c58b9284678247c9cb4d828feac2fe084684c296edd53"}
Jul 08 03:42:28.829429 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.829347    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8" event={"ID":"1bb318b2-d94b-4c04-91fa-d4f600a7a721","Type":"ContainerDied","Data":"6c4749c8ad4aefa93dd4da8393254413667560378d3ca0493d6fb24d6034882a"}
Jul 08 03:42:28.829429 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.829377    2578 scope.go:117] "RemoveContainer" containerID="3f9a8e728c4e5633315c58b9284678247c9cb4d828feac2fe084684c296edd53"
Jul 08 03:42:28.839040 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.839028    2578 scope.go:117] "RemoveContainer" containerID="3f9a8e728c4e5633315c58b9284678247c9cb4d828feac2fe084684c296edd53"
Jul 08 03:42:28.839298 ip-10-0-129-199 kubenswrapper[2578]: E0708 03:42:28.839279    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f9a8e728c4e5633315c58b9284678247c9cb4d828feac2fe084684c296edd53\": container with ID starting with 3f9a8e728c4e5633315c58b9284678247c9cb4d828feac2fe084684c296edd53 not found: ID does not exist" containerID="3f9a8e728c4e5633315c58b9284678247c9cb4d828feac2fe084684c296edd53"
Jul 08 03:42:28.839360 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.839307    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f9a8e728c4e5633315c58b9284678247c9cb4d828feac2fe084684c296edd53"} err="failed to get container status \"3f9a8e728c4e5633315c58b9284678247c9cb4d828feac2fe084684c296edd53\": rpc error: code = NotFound desc = could not find container \"3f9a8e728c4e5633315c58b9284678247c9cb4d828feac2fe084684c296edd53\": container with ID starting with 3f9a8e728c4e5633315c58b9284678247c9cb4d828feac2fe084684c296edd53 not found: ID does not exist"
Jul 08 03:42:28.852492 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.852462    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"]
Jul 08 03:42:28.858300 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:28.858282    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-788e6a-f767fbd6f-8trr8"]
Jul 08 03:42:30.163310 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:30.163273    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bb318b2-d94b-4c04-91fa-d4f600a7a721" path="/var/lib/kubelet/pods/1bb318b2-d94b-4c04-91fa-d4f600a7a721/volumes"
Jul 08 03:42:34.727809 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:34.727775    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"]
Jul 08 03:42:34.728199 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:34.728031    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87" podUID="f78be967-06ff-4571-bc30-73fb15018fc6" containerName="maas-api" containerID="cri-o://24ea3e658f64a1bd4b2ff0eec400563a02a12d181b1c93dc7643545b5e1ac666" gracePeriod=30
Jul 08 03:42:34.861958 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:34.861929    2578 generic.go:356] "Generic (PLEG): container finished" podID="f78be967-06ff-4571-bc30-73fb15018fc6" containerID="24ea3e658f64a1bd4b2ff0eec400563a02a12d181b1c93dc7643545b5e1ac666" exitCode=0
Jul 08 03:42:34.862105 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:34.862004    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87" event={"ID":"f78be967-06ff-4571-bc30-73fb15018fc6","Type":"ContainerDied","Data":"24ea3e658f64a1bd4b2ff0eec400563a02a12d181b1c93dc7643545b5e1ac666"}
Jul 08 03:42:34.988069 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:34.988010    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"
Jul 08 03:42:35.162386 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:35.162355    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbs7n\" (UniqueName: \"kubernetes.io/projected/f78be967-06ff-4571-bc30-73fb15018fc6-kube-api-access-qbs7n\") pod \"f78be967-06ff-4571-bc30-73fb15018fc6\" (UID: \"f78be967-06ff-4571-bc30-73fb15018fc6\") "
Jul 08 03:42:35.162575 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:35.162422    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f78be967-06ff-4571-bc30-73fb15018fc6-openshift-service-ca\") pod \"f78be967-06ff-4571-bc30-73fb15018fc6\" (UID: \"f78be967-06ff-4571-bc30-73fb15018fc6\") "
Jul 08 03:42:35.162575 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:35.162438    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f78be967-06ff-4571-bc30-73fb15018fc6-maas-api-tls\") pod \"f78be967-06ff-4571-bc30-73fb15018fc6\" (UID: \"f78be967-06ff-4571-bc30-73fb15018fc6\") "
Jul 08 03:42:35.162819 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:35.162794    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f78be967-06ff-4571-bc30-73fb15018fc6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f78be967-06ff-4571-bc30-73fb15018fc6" (UID: "f78be967-06ff-4571-bc30-73fb15018fc6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 03:42:35.164626 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:35.164590    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f78be967-06ff-4571-bc30-73fb15018fc6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f78be967-06ff-4571-bc30-73fb15018fc6" (UID: "f78be967-06ff-4571-bc30-73fb15018fc6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 03:42:35.164626 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:35.164601    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f78be967-06ff-4571-bc30-73fb15018fc6-kube-api-access-qbs7n" (OuterVolumeSpecName: "kube-api-access-qbs7n") pod "f78be967-06ff-4571-bc30-73fb15018fc6" (UID: "f78be967-06ff-4571-bc30-73fb15018fc6"). InnerVolumeSpecName "kube-api-access-qbs7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 03:42:35.263449 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:35.263364    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbs7n\" (UniqueName: \"kubernetes.io/projected/f78be967-06ff-4571-bc30-73fb15018fc6-kube-api-access-qbs7n\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:42:35.263449 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:35.263389    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f78be967-06ff-4571-bc30-73fb15018fc6-openshift-service-ca\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:42:35.263449 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:35.263402    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f78be967-06ff-4571-bc30-73fb15018fc6-maas-api-tls\") on node \"ip-10-0-129-199.ec2.internal\" DevicePath \"\""
Jul 08 03:42:35.868239 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:35.868204    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87" event={"ID":"f78be967-06ff-4571-bc30-73fb15018fc6","Type":"ContainerDied","Data":"7f3d9cfffb95423683512f91b69046fbf502b6cb7aa175fb68fa9a8e209226c3"}
Jul 08 03:42:35.868239 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:35.868225    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"
Jul 08 03:42:35.868714 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:35.868278    2578 scope.go:117] "RemoveContainer" containerID="24ea3e658f64a1bd4b2ff0eec400563a02a12d181b1c93dc7643545b5e1ac666"
Jul 08 03:42:35.888450 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:35.888426    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"]
Jul 08 03:42:35.891736 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:35.891717    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-705492-6965c9858d-zzg87"]
Jul 08 03:42:36.163408 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:36.163329    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f78be967-06ff-4571-bc30-73fb15018fc6" path="/var/lib/kubelet/pods/f78be967-06ff-4571-bc30-73fb15018fc6/volumes"
Jul 08 03:42:41.059707 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:41.059672    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d679799f-tlvkn_dc8ef898-c00c-4cbd-8fc8-bc4712533499/authorino/0.log"
Jul 08 03:42:45.722950 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:45.722926    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d7d866b75-dmktk_d85dd141-59c6-4607-a81e-1e5675769ff2/manager/0.log"
Jul 08 03:42:46.066932 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:46.066907    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64b8ffddd6-2gj42_b3723836-e219-403a-8e47-8eef454876c2/copy-manifests/0.log"
Jul 08 03:42:46.073376 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:46.073358    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64b8ffddd6-2gj42_b3723836-e219-403a-8e47-8eef454876c2/manager/0.log"
Jul 08 03:42:47.093877 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:47.093845    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9_0482e618-69f4-4bba-bfd1-c72ea5dde0bd/pull/0.log"
Jul 08 03:42:47.099986 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:47.099967    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9_0482e618-69f4-4bba-bfd1-c72ea5dde0bd/extract/0.log"
Jul 08 03:42:47.105789 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:47.105771    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9_0482e618-69f4-4bba-bfd1-c72ea5dde0bd/util/0.log"
Jul 08 03:42:47.212630 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:47.212606    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz_1308bace-3157-4bf6-ab3d-5cf22cf72ed8/util/0.log"
Jul 08 03:42:47.218998 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:47.218977    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz_1308bace-3157-4bf6-ab3d-5cf22cf72ed8/pull/0.log"
Jul 08 03:42:47.224826 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:47.224783    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz_1308bace-3157-4bf6-ab3d-5cf22cf72ed8/extract/0.log"
Jul 08 03:42:47.337222 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:47.337172    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs_36346dad-a9eb-483c-b78f-3328116652a8/extract/0.log"
Jul 08 03:42:47.343291 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:47.343271    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs_36346dad-a9eb-483c-b78f-3328116652a8/util/0.log"
Jul 08 03:42:47.349268 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:47.349218    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs_36346dad-a9eb-483c-b78f-3328116652a8/pull/0.log"
Jul 08 03:42:47.458284 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:47.458257    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2_5e2b3c56-7e81-4019-83ec-f57ec67c9c66/util/0.log"
Jul 08 03:42:47.464716 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:47.464695    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2_5e2b3c56-7e81-4019-83ec-f57ec67c9c66/pull/0.log"
Jul 08 03:42:47.471513 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:47.471494    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2_5e2b3c56-7e81-4019-83ec-f57ec67c9c66/extract/0.log"
Jul 08 03:42:47.585643 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:47.585614    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d679799f-tlvkn_dc8ef898-c00c-4cbd-8fc8-bc4712533499/authorino/0.log"
Jul 08 03:42:48.822411 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:48.822380    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-78m6p_b7a4454d-3688-4766-925f-882cf38819a7/discovery/0.log"
Jul 08 03:42:49.270779 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:49.270693    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-pjjrf_90a0a0d8-6e82-4ae6-9ddc-6ad6e99384c8/payload-pre-processing/0.log"
Jul 08 03:42:49.386974 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:49.386946    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-cs2dn_a2c1fb59-2cc8-44f7-9e88-672d2a467f33/payload-processing/0.log"
Jul 08 03:42:49.827542 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:49.827510    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-qnz67_25742ae8-1045-4277-a94d-e67e9df49c73/main/0.log"
Jul 08 03:42:49.934591 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:49.934563    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-s4zj7_c7f93999-ca21-489b-841c-fdcc7ee84097/main/0.log"
Jul 08 03:42:57.150177 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:57.150143    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g4z7x_c039d8af-51c0-4e88-b104-9c7ec5d407aa/global-pull-secret-syncer/0.log"
Jul 08 03:42:57.259484 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:57.259459    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ckmrk_2126287b-3317-43ab-988a-c76c4a29c0ac/konnectivity-agent/0.log"
Jul 08 03:42:57.299797 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:42:57.299768    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-199.ec2.internal_f0d215397ef53c1ac6c0801c250e71f7/haproxy/0.log"
Jul 08 03:43:01.849451 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:01.849405    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9_0482e618-69f4-4bba-bfd1-c72ea5dde0bd/extract/0.log"
Jul 08 03:43:01.881371 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:01.881342    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9_0482e618-69f4-4bba-bfd1-c72ea5dde0bd/util/0.log"
Jul 08 03:43:01.912661 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:01.912633    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f86s9_0482e618-69f4-4bba-bfd1-c72ea5dde0bd/pull/0.log"
Jul 08 03:43:01.947966 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:01.947939    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz_1308bace-3157-4bf6-ab3d-5cf22cf72ed8/extract/0.log"
Jul 08 03:43:01.968978 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:01.968950    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz_1308bace-3157-4bf6-ab3d-5cf22cf72ed8/util/0.log"
Jul 08 03:43:01.990669 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:01.990642    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ck7mz_1308bace-3157-4bf6-ab3d-5cf22cf72ed8/pull/0.log"
Jul 08 03:43:02.023420 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:02.023393    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs_36346dad-a9eb-483c-b78f-3328116652a8/extract/0.log"
Jul 08 03:43:02.045258 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:02.045229    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs_36346dad-a9eb-483c-b78f-3328116652a8/util/0.log"
Jul 08 03:43:02.065081 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:02.065056    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bggs_36346dad-a9eb-483c-b78f-3328116652a8/pull/0.log"
Jul 08 03:43:02.090503 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:02.090476    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2_5e2b3c56-7e81-4019-83ec-f57ec67c9c66/extract/0.log"
Jul 08 03:43:02.109365 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:02.109290    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2_5e2b3c56-7e81-4019-83ec-f57ec67c9c66/util/0.log"
Jul 08 03:43:02.135529 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:02.135482    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lxdb2_5e2b3c56-7e81-4019-83ec-f57ec67c9c66/pull/0.log"
Jul 08 03:43:02.375559 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:02.375474    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d679799f-tlvkn_dc8ef898-c00c-4cbd-8fc8-bc4712533499/authorino/0.log"
Jul 08 03:43:04.570977 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:04.570940    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-678745d87-s7qx9_514b1b93-eea1-42bb-b74a-3a9c76cf21fe/metrics-server/0.log"
Jul 08 03:43:04.603862 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:04.603827    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-xlpf7_47e6d129-dec3-4d58-8758-1e5eaa03596b/monitoring-plugin/0.log"
Jul 08 03:43:04.650219 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:04.650180    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h7qr6_d0b7cd4d-577b-4d13-afaf-a0460fee4934/node-exporter/0.log"
Jul 08 03:43:04.673354 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:04.673327    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h7qr6_d0b7cd4d-577b-4d13-afaf-a0460fee4934/kube-rbac-proxy/0.log"
Jul 08 03:43:04.696537 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:04.696510    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h7qr6_d0b7cd4d-577b-4d13-afaf-a0460fee4934/init-textfile/0.log"
Jul 08 03:43:04.867040 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:04.867005    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-rc9gw_87871047-e75a-4fdc-9e4f-73891b052829/kube-rbac-proxy-main/0.log"
Jul 08 03:43:04.889375 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:04.889346    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-rc9gw_87871047-e75a-4fdc-9e4f-73891b052829/kube-rbac-proxy-self/0.log"
Jul 08 03:43:04.911155 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:04.911123    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-rc9gw_87871047-e75a-4fdc-9e4f-73891b052829/openshift-state-metrics/0.log"
Jul 08 03:43:05.192423 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:05.192350    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7659658c45-mxxh2_523e877e-d1a4-42c4-be4a-494b064d5822/telemeter-client/0.log"
Jul 08 03:43:05.212522 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:05.212494    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7659658c45-mxxh2_523e877e-d1a4-42c4-be4a-494b064d5822/reload/0.log"
Jul 08 03:43:05.235434 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:05.235397    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7659658c45-mxxh2_523e877e-d1a4-42c4-be4a-494b064d5822/kube-rbac-proxy/0.log"
Jul 08 03:43:07.109426 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.109393    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"]
Jul 08 03:43:07.109821 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.109721    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f78be967-06ff-4571-bc30-73fb15018fc6" containerName="maas-api"
Jul 08 03:43:07.109821 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.109731    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f78be967-06ff-4571-bc30-73fb15018fc6" containerName="maas-api"
Jul 08 03:43:07.109821 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.109754    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb318b2-d94b-4c04-91fa-d4f600a7a721" containerName="maas-api"
Jul 08 03:43:07.109821 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.109761    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb318b2-d94b-4c04-91fa-d4f600a7a721" containerName="maas-api"
Jul 08 03:43:07.109821 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.109819    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bb318b2-d94b-4c04-91fa-d4f600a7a721" containerName="maas-api"
Jul 08 03:43:07.109986 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.109828    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f78be967-06ff-4571-bc30-73fb15018fc6" containerName="maas-api"
Jul 08 03:43:07.113031 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.113014    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:07.115270 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.115248    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l26gf\"/\"kube-root-ca.crt\""
Jul 08 03:43:07.115430 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.115408    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-l26gf\"/\"default-dockercfg-x5rmv\""
Jul 08 03:43:07.115927 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.115909    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l26gf\"/\"openshift-service-ca.crt\""
Jul 08 03:43:07.121398 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.121376    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"]
Jul 08 03:43:07.214209 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.214179    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hxhh\" (UniqueName: \"kubernetes.io/projected/f6d04c24-0a63-47eb-a667-ebbdb0028896-kube-api-access-4hxhh\") pod \"perf-node-gather-daemonset-bnh7m\" (UID: \"f6d04c24-0a63-47eb-a667-ebbdb0028896\") " pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:07.214366 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.214228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6d04c24-0a63-47eb-a667-ebbdb0028896-lib-modules\") pod \"perf-node-gather-daemonset-bnh7m\" (UID: \"f6d04c24-0a63-47eb-a667-ebbdb0028896\") " pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:07.214366 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.214252    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6d04c24-0a63-47eb-a667-ebbdb0028896-podres\") pod \"perf-node-gather-daemonset-bnh7m\" (UID: \"f6d04c24-0a63-47eb-a667-ebbdb0028896\") " pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:07.214366 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.214302    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6d04c24-0a63-47eb-a667-ebbdb0028896-proc\") pod \"perf-node-gather-daemonset-bnh7m\" (UID: \"f6d04c24-0a63-47eb-a667-ebbdb0028896\") " pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:07.214366 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.214329    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6d04c24-0a63-47eb-a667-ebbdb0028896-sys\") pod \"perf-node-gather-daemonset-bnh7m\" (UID: \"f6d04c24-0a63-47eb-a667-ebbdb0028896\") " pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:07.315210 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.315181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6d04c24-0a63-47eb-a667-ebbdb0028896-lib-modules\") pod \"perf-node-gather-daemonset-bnh7m\" (UID: \"f6d04c24-0a63-47eb-a667-ebbdb0028896\") " pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:07.315210 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.315215    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6d04c24-0a63-47eb-a667-ebbdb0028896-podres\") pod \"perf-node-gather-daemonset-bnh7m\" (UID: \"f6d04c24-0a63-47eb-a667-ebbdb0028896\") " pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:07.315415 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.315233    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6d04c24-0a63-47eb-a667-ebbdb0028896-proc\") pod \"perf-node-gather-daemonset-bnh7m\" (UID: \"f6d04c24-0a63-47eb-a667-ebbdb0028896\") " pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:07.315415 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.315251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6d04c24-0a63-47eb-a667-ebbdb0028896-sys\") pod \"perf-node-gather-daemonset-bnh7m\" (UID: \"f6d04c24-0a63-47eb-a667-ebbdb0028896\") " pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:07.315415 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.315323    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hxhh\" (UniqueName: \"kubernetes.io/projected/f6d04c24-0a63-47eb-a667-ebbdb0028896-kube-api-access-4hxhh\") pod \"perf-node-gather-daemonset-bnh7m\" (UID: \"f6d04c24-0a63-47eb-a667-ebbdb0028896\") " pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:07.315415 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.315341    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6d04c24-0a63-47eb-a667-ebbdb0028896-proc\") pod \"perf-node-gather-daemonset-bnh7m\" (UID: \"f6d04c24-0a63-47eb-a667-ebbdb0028896\") " pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:07.315415 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.315359    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6d04c24-0a63-47eb-a667-ebbdb0028896-lib-modules\") pod \"perf-node-gather-daemonset-bnh7m\" (UID: \"f6d04c24-0a63-47eb-a667-ebbdb0028896\") " pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:07.315415 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.315362    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6d04c24-0a63-47eb-a667-ebbdb0028896-podres\") pod \"perf-node-gather-daemonset-bnh7m\" (UID: \"f6d04c24-0a63-47eb-a667-ebbdb0028896\") " pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:07.315415 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.315401    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6d04c24-0a63-47eb-a667-ebbdb0028896-sys\") pod \"perf-node-gather-daemonset-bnh7m\" (UID: \"f6d04c24-0a63-47eb-a667-ebbdb0028896\") " pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:07.324584 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.324558    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hxhh\" (UniqueName: \"kubernetes.io/projected/f6d04c24-0a63-47eb-a667-ebbdb0028896-kube-api-access-4hxhh\") pod \"perf-node-gather-daemonset-bnh7m\" (UID: \"f6d04c24-0a63-47eb-a667-ebbdb0028896\") " pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:07.424726 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.424643    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:07.556820 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:07.556787    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"]
Jul 08 03:43:08.026277 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:08.026234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m" event={"ID":"f6d04c24-0a63-47eb-a667-ebbdb0028896","Type":"ContainerStarted","Data":"b597666673dfdd33fe90aabc174001e871d4d4141cf63b7026c86e23c5c22582"}
Jul 08 03:43:08.026477 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:08.026299    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m" event={"ID":"f6d04c24-0a63-47eb-a667-ebbdb0028896","Type":"ContainerStarted","Data":"dbe7d5d3a20005b6a6958e11cad963e0ee44ab8fd5b5f6015e133e0535feed39"}
Jul 08 03:43:08.026477 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:08.026343    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:08.044547 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:08.044501    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m" podStartSLOduration=1.044486268 podStartE2EDuration="1.044486268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 03:43:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 03:43:08.043189418 +0000 UTC m=+2672.355467952" watchObservedRunningTime="2026-07-08 03:43:08.044486268 +0000 UTC m=+2672.356764802"
Jul 08 03:43:09.490990 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:09.490963    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4l7xp_42809e4a-365b-407c-84fb-bf886bef4038/dns/0.log"
Jul 08 03:43:09.512471 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:09.512447    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4l7xp_42809e4a-365b-407c-84fb-bf886bef4038/kube-rbac-proxy/0.log"
Jul 08 03:43:09.667573 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:09.667545    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xkw9w_7185a770-f816-4a15-a0d4-96f547358ca4/dns-node-resolver/0.log"
Jul 08 03:43:10.157510 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:10.157482    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-55d5c74b8b-mzrwx_41a3dbb6-2a2f-4634-9140-eedc76a46180/registry/0.log"
Jul 08 03:43:10.219511 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:10.219482    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n6xhm_85004f35-1268-4e27-baef-42b30549f61a/node-ca/0.log"
Jul 08 03:43:11.239006 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:11.238977    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-78m6p_b7a4454d-3688-4766-925f-882cf38819a7/discovery/0.log"
Jul 08 03:43:11.375815 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:11.375791    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-pjjrf_90a0a0d8-6e82-4ae6-9ddc-6ad6e99384c8/payload-pre-processing/0.log"
Jul 08 03:43:11.424698 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:11.424652    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-cs2dn_a2c1fb59-2cc8-44f7-9e88-672d2a467f33/payload-processing/0.log"
Jul 08 03:43:12.169536 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:12.169511    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kxv7r_0c8fcdd1-b268-4c5b-b089-7ce11183cd27/serve-healthcheck-canary/0.log"
Jul 08 03:43:12.665021 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:12.664995    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lzlzt_81c1f76e-7365-461b-97c3-f1d59ba67af9/kube-rbac-proxy/0.log"
Jul 08 03:43:12.687485 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:12.687458    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lzlzt_81c1f76e-7365-461b-97c3-f1d59ba67af9/exporter/0.log"
Jul 08 03:43:12.708821 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:12.708797    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lzlzt_81c1f76e-7365-461b-97c3-f1d59ba67af9/extractor/0.log"
Jul 08 03:43:14.041512 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:14.041481    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-l26gf/perf-node-gather-daemonset-bnh7m"
Jul 08 03:43:15.119803 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:15.119773    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d7d866b75-dmktk_d85dd141-59c6-4607-a81e-1e5675769ff2/manager/0.log"
Jul 08 03:43:15.240876 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:15.240834    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64b8ffddd6-2gj42_b3723836-e219-403a-8e47-8eef454876c2/manager/0.log"
Jul 08 03:43:15.260900 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:15.260881    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64b8ffddd6-2gj42_b3723836-e219-403a-8e47-8eef454876c2/copy-manifests/0.log"
Jul 08 03:43:16.889433 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:16.889405    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65cfbc7dbc-sb72k_e82f9af7-dcc1-406e-a4f0-aceb36995ab7/manager/0.log"
Jul 08 03:43:17.904597 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:17.904565    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-78m6p_b7a4454d-3688-4766-925f-882cf38819a7/discovery/0.log"
Jul 08 03:43:18.005765 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:18.005723    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-pjjrf_90a0a0d8-6e82-4ae6-9ddc-6ad6e99384c8/payload-pre-processing/0.log"
Jul 08 03:43:18.042075 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:18.042048    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-cs2dn_a2c1fb59-2cc8-44f7-9e88-672d2a467f33/payload-processing/0.log"
Jul 08 03:43:19.388290 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:19.388247    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-78m6p_b7a4454d-3688-4766-925f-882cf38819a7/discovery/0.log"
Jul 08 03:43:19.495170 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:19.495144    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-pjjrf_90a0a0d8-6e82-4ae6-9ddc-6ad6e99384c8/payload-pre-processing/0.log"
Jul 08 03:43:19.531601 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:19.531575    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-cs2dn_a2c1fb59-2cc8-44f7-9e88-672d2a467f33/payload-processing/0.log"
Jul 08 03:43:23.276616 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:23.276530    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmppx_7bad4d47-f01a-458a-97e6-ed54b119e2f5/kube-multus-additional-cni-plugins/0.log"
Jul 08 03:43:23.296410 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:23.296390    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmppx_7bad4d47-f01a-458a-97e6-ed54b119e2f5/egress-router-binary-copy/0.log"
Jul 08 03:43:23.316292 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:23.316273    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmppx_7bad4d47-f01a-458a-97e6-ed54b119e2f5/cni-plugins/0.log"
Jul 08 03:43:23.336297 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:23.336276    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmppx_7bad4d47-f01a-458a-97e6-ed54b119e2f5/bond-cni-plugin/0.log"
Jul 08 03:43:23.355813 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:23.355788    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmppx_7bad4d47-f01a-458a-97e6-ed54b119e2f5/routeoverride-cni/0.log"
Jul 08 03:43:23.375286 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:23.375267    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmppx_7bad4d47-f01a-458a-97e6-ed54b119e2f5/whereabouts-cni-bincopy/0.log"
Jul 08 03:43:23.394925 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:23.394893    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmppx_7bad4d47-f01a-458a-97e6-ed54b119e2f5/whereabouts-cni/0.log"
Jul 08 03:43:23.718436 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:23.718411    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mjsmm_a341499c-4d33-4b75-8da2-7d2f54ef4919/kube-multus/0.log"
Jul 08 03:43:23.842189 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:23.842155    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x592x_5e6bae47-a81a-461c-94da-98c89694c300/network-metrics-daemon/0.log"
Jul 08 03:43:23.860706 ip-10-0-129-199 kubenswrapper[2578]: I0708 03:43:23.860675    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x592x_5e6bae47-a81a-461c-94da-98c89694c300/kube-rbac-proxy/0.log"